Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models
Paper
•
2506.19697
•
Published
•
44
Compression
-
-
Winning the Pruning Gamble: A Unified Approach to Joint Sample and Token Pruning for Efficient Supervised Fine-Tuning
Paper • 2509.23873 • Published • 67 -
Efficient Multi-modal Large Language Models via Progressive Consistency Distillation
Paper • 2510.00515 • Published • 42 -
SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights
Paper • 2509.22944 • Published • 80 -
QeRL: Beyond Efficiency -- Quantization-enhanced Reinforcement Learning for LLMs
Paper • 2510.11696 • Published • 180 -
AdaSPEC: Selective Knowledge Distillation for Efficient Speculative Decoders
Paper • 2510.19779 • Published • 61 -
Black-Box On-Policy Distillation of Large Language Models
Paper • 2511.10643 • Published • 52 -
Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation
Paper • 2601.22813 • Published • 55