·
AI & ML interests
I like to fine-tune the small models of the Doge series.
Organizations
Trainable Dynamic Mask Sparse Attention: Bridging Efficiency and Effectiveness in Long-Context Language Models
datasets 15
wubingheng/MixtureOfThoughts-Chinese-tryrun
Viewer
• Updated
• 10 • 83
wubingheng/Mixture-of-Thoughts-zh-try-run
Viewer
• Updated
• 10 • 74
wubingheng/Budget-aware-2048
Viewer
• Updated
• 25k • 4
wubingheng/Budget-aware-2048-in
Viewer
• Updated
• 25k • 4
wubingheng/Budget-aware-2048-in-try-run
Viewer
• Updated
• 2 • 4
wubingheng/Budget-aware-2048-try-run
Viewer
• Updated
• 2 • 4
Viewer
• Updated
• 25k • 3
Viewer
• Updated
• 25k • 4
wubingheng/compressed-openthoughts-50
Viewer
• Updated
• 25k • 13
wubingheng/compressed-openthoughts-90
Viewer
• Updated
• 25k • 6