Shamane's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in jetmoe/jetmoe-8b almost 2 years ago

When can we have the training code as illustrated in the paper.

12

#5 opened almost 2 years ago by

Shamane

New activity in jetmoe/jetmoe-8b-chat almost 2 years ago

Seems like still we can't load this model with the Transformers library?

2

#2 opened almost 2 years ago by

Shamane

New activity in arcee-ai/Mistral-7B-Instruct-v0.2-sliced-24-layer almost 2 years ago

Why is the size of pruned model bigger than the original ones after 24 layers been sliced?

4

#1 opened almost 2 years ago by

iheardyoulooking

commented 2 papers almost 2 years ago

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26, 2024 • 82 •

14

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26, 2024 • 82 •

14

New activity in Aryanne/Zephyr-3.43B about 2 years ago

What is the secret behind selecting layers from different models ? :)

4

#1 opened about 2 years ago by

Shamane

New activity in upstage/SOLAR-10.7B-Instruct-v1.0 about 2 years ago

Depth Up-Scaling

👍 1

6

#7 opened about 2 years ago by

mrfakename

New activity in Aryanne/Zephyr-3.43B about 2 years ago

What is the secret behind selecting layers from different models ? :)

4

#1 opened about 2 years ago by

Shamane