Optimized for Dark Mode

The website is optimized for dark mode to enhance your user experience. Switch to dark mode to enjoy it.

quantization

Faster LLMs with Quantization - How to get faster inference times with quantization
quantization awq gptq llm opensource transformers vllm Hugging Face
Published On
January 17, 2025
A practical look at LLM quantization tradeoffs, benchmark results, and what actually improves vLLM inference speed in production.
Read more ->
Why LLM Benchmarks Can Be Misleading - AWQ vs. GPTQ
llm tools vllm quantization llama gptq awq local-llm-series
Published On
December 3, 2024
Why official LLM benchmarks can mislead you: AWQ vs GPTQ results, custom tests, and what matters more than leaderboard scores.
Read more ->

Tags