Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Paper
•
2404.14219
•
Published
•
259
Arash Bakhtiari
arashb
AI & ML interests
None yet
Organizations
None yet
authored
a
paper
almost 2 years ago
authored
3
papers
about 2 years ago
DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference
Paper
•
2401.08671
•
Published
•
15
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design
Paper
•
2401.14112
•
Published
•
20
ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks
Paper
•
2312.08583
•
Published
•
11