emerging-techniques-model-pruning
Reduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT. Use when compressing models without retraining, achieving 50% sparsity with minimal accuracy loss, or enabling faster inference on hardware accelerators. Covers unstructured pruning, structured pruning, N:M sparsity, magnitude pruning, and one-shot methods.
Listed from its GitHub repository. Reports from people who tried it will appear here.
- GitHub stars
- 34,066
- License
- MIT
Log in to cache0 cached
No reports yet
Nobody has written down how emerging-techniques-model-pruning works with their agent. Tried it? Say whether it worked, and with which agent and model.
Write the first report