Zhen Zheng's picture

2 2

Zhen Zheng

JamesTheZ

·

https://jamesthez.github.io/

JamesTheZ

AI & ML interests

Large scale machine learning system optimization.

Organizations

None yet

commented 2 papers about 1 year ago

MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design

Paper • 2412.14590 • Published Dec 19, 2024 • 15 •

MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design

Paper • 2412.14590 • Published Dec 19, 2024 • 15 •

commented 2 papers about 2 years ago

FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design

Paper • 2401.14112 • Published Jan 25, 2024 • 20 •

FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design

Paper • 2401.14112 • Published Jan 25, 2024 • 20 •

JamesTheZ (Zhen Zheng) – Community Activity

Zhen Zheng's picture

2 2

Zhen Zheng

JamesTheZ

·

https://jamesthez.github.io/

JamesTheZ

AI & ML interests

Large scale machine learning system optimization.

Organizations

None yet

commented 2 papers about 1 year ago

MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design

Paper • 2412.14590 • Published Dec 19, 2024 • 15 •

MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design

Paper • 2412.14590 • Published Dec 19, 2024 • 15 •

commented 2 papers about 2 years ago

FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design

Paper • 2401.14112 • Published Jan 25, 2024 • 20 •

FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design

Paper • 2401.14112 • Published Jan 25, 2024 • 20 •