DPO Alpaca Setpember/Alpaca_GPT2M_DPSGD_epi_01 Updated Mar 31, 2025 Setpember/Alpaca_GPT2M_DPSGD_epi_05 Updated Mar 30, 2025 Setpember/Alpaca_GPT2M_DPSGD_epi_1 Updated Mar 30, 2025 Setpember/Alpaca_GPT2M_DPSGD_epi_2 Updated Mar 30, 2025
PPO Jon Setpember/Jon_reward_stage1_epi_2 0.1B • Updated Nov 20, 2024 • 2 Setpember/Jon_ppo_stage1_epi_2 Reinforcement Learning • Updated Nov 20, 2024 • 1 Setpember/Jon_reward_stage2_epi_2 0.1B • Updated Nov 20, 2024 Setpember/Jon_ppo_stage2_epi_2 Reinforcement Learning • Updated Nov 20, 2024
MIMIC MIMIC Bert and Llama Setpember/bert-small_lora_r128_epsilon10 Updated Mar 25, 2025 Setpember/bert-small_lora_r128_epsilon5 Updated Mar 25, 2025 Setpember/bert-small_lora_r128_epsilon2 Updated Mar 25, 2025 • 3 Setpember/bert-small_lora_r128_epsilon1 Updated Mar 24, 2025
DPO HH Setpember/pythia-1b-helpful-sft Updated Nov 26, 2024 Setpember/HH_pythia_DPO_props_epi_point1 Text Generation • 1B • Updated Nov 26, 2024 • 2 Setpember/HH_pythia_DPO_props_epi_point5 Text Generation • 1B • Updated Nov 26, 2024 Setpember/HH_pythia_DPO_props_epi_1 Text Generation • 1B • Updated Nov 26, 2024
DPO Alpaca Setpember/Alpaca_GPT2M_DPSGD_epi_01 Updated Mar 31, 2025 Setpember/Alpaca_GPT2M_DPSGD_epi_05 Updated Mar 30, 2025 Setpember/Alpaca_GPT2M_DPSGD_epi_1 Updated Mar 30, 2025 Setpember/Alpaca_GPT2M_DPSGD_epi_2 Updated Mar 30, 2025
DPO HH Setpember/pythia-1b-helpful-sft Updated Nov 26, 2024 Setpember/HH_pythia_DPO_props_epi_point1 Text Generation • 1B • Updated Nov 26, 2024 • 2 Setpember/HH_pythia_DPO_props_epi_point5 Text Generation • 1B • Updated Nov 26, 2024 Setpember/HH_pythia_DPO_props_epi_1 Text Generation • 1B • Updated Nov 26, 2024
PPO Jon Setpember/Jon_reward_stage1_epi_2 0.1B • Updated Nov 20, 2024 • 2 Setpember/Jon_ppo_stage1_epi_2 Reinforcement Learning • Updated Nov 20, 2024 • 1 Setpember/Jon_reward_stage2_epi_2 0.1B • Updated Nov 20, 2024 Setpember/Jon_ppo_stage2_epi_2 Reinforcement Learning • Updated Nov 20, 2024
MIMIC MIMIC Bert and Llama Setpember/bert-small_lora_r128_epsilon10 Updated Mar 25, 2025 Setpember/bert-small_lora_r128_epsilon5 Updated Mar 25, 2025 Setpember/bert-small_lora_r128_epsilon2 Updated Mar 25, 2025 • 3 Setpember/bert-small_lora_r128_epsilon1 Updated Mar 24, 2025
