dball (David Faragó) – Community Activity

commented 2 papers about 1 year ago

A Survey on Large Language Model based Autonomous Agents

Paper • 2308.11432 • Published Aug 22, 2023 • 3 •

2

A Survey on Large Language Model based Autonomous Agents

Paper • 2308.11432 • Published Aug 22, 2023 • 3 •

2

commented 3 papers over 1 year ago

Data curation via joint example selection further accelerates multimodal learning

Paper • 2406.17711 • Published Jun 25, 2024 • 3 •

2

Data curation via joint example selection further accelerates multimodal learning

Paper • 2406.17711 • Published Jun 25, 2024 • 3 •

2

Self-Taught Evaluators

Paper • 2408.02666 • Published Aug 5, 2024 • 29 •

4

New activity in PatronusAI/Llama-3-Patronus-Lynx-8B-Instruct-v1.1 over 1 year ago

Error when deploying an inference endpoint

2

#1 opened over 1 year ago by

dball

commented 12 papers almost 2 years ago

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2, 2024 • 107 •

7

Training LLMs over Neurally Compressed Text

Paper • 2404.03626 • Published Apr 4, 2024 • 23 •

3

ReFT: Representation Finetuning for Language Models

Paper • 2404.03592 • Published Apr 4, 2024 • 101 •

17

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18, 2024 • 152 •

17

Self-Consuming Generative Models Go MAD

Paper • 2307.01850 • Published Jul 4, 2023 • 1 •

1

New activity in dball/zephyr-7b-sft-qlora about 2 years ago

Is the drop in many metrics expected? Why do SFT first if it makes the model worse? Why not do DPO directly on the mistral model?

1

#1 opened about 2 years ago by

dball

New activity in dball/zephyr-7b-dpo-qlora about 2 years ago

Is the high drop in GSM8K usual?

1

#1 opened about 2 years ago by

dball

David Faragó

AI & ML interests

Organizations

dball's activity

Error when deploying an inference endpoint

Is the drop in many metrics expected? Why do SFT first if it makes the model worse? Why not do DPO directly on the mistral model?

Is the high drop in GSM8K usual?

David Faragó

AI & ML interests

Organizations

dball's activity

Error when deploying an inference endpoint

Is the drop in many metrics expected? Why do SFT first if it makes the model worse? Why not do DPO directly on the mistral model?

Is the high drop in GSM8K usual?