Adversarial Goodhart RLHF

classroom

AI & ML interests

None defined yet.

AdversarialRLHF 's datasets 43

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-184_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-26_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 4

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-78_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-52_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-104_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-255_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 1

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-255_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_checkpoint-255_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_checkpoint-104_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 7

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_checkpoint-52_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_checkpoint-26_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 4

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_kl0.005_52_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 4

AdversarialRLHF/generations_ppo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/ppo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_full_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-104_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-78_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 2

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-52_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/pythia410m-sft-tldr-allprefix_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-26_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/sffop_1706381144_410msft_relabel_pythia6.9b_logprobs_prefix_chosen

Viewer • Updated Apr 29, 2025 • 130k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 4

AdversarialRLHF/sft_pythia410m_tldr_prefix_0.25_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 6

AdversarialRLHF/pythia410m-sft-tldr-propprefix_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 4

AdversarialRLHF/ppo_pythia410m_tldr6.9b_rm410mdata_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 1

AdversarialRLHF/ppo_pythia410m_tldr6.9b_rm410mdata_mergedsft_propprefix_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 3

AdversarialRLHF/410M-sft-tldr-eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 2

AdversarialRLHF/summarize_from_feedback_tldr_3_filtered_oai_preprocessing_1706381144_propprefix

Viewer • Updated Apr 29, 2025 • 130k • 3

AdversarialRLHF/sffop_1706381144_410msft_relabel_pythia6.9b_logprobs_cond3emojiepropprefix

Viewer • Updated Apr 27, 2025 • 130k • 4

AdversarialRLHF (Adversarial Goodhart RLHF)

Adversarial Goodhart RLHF

classroom

AI & ML interests

None defined yet.

AdversarialRLHF 's datasets 43

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-184_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-26_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 4

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-78_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-52_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-104_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_checkpoint-255_eval-dataset

Viewer • Updated May 1, 2025 • 6.45k • 1

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-255_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_checkpoint-255_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_checkpoint-104_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 7

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_checkpoint-52_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_checkpoint-26_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft0.3_prefix_nokl_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 4

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_kl0.005_52_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 4

AdversarialRLHF/generations_ppo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/ppo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_full_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-104_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-78_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 2

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-52_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/pythia410m-sft-tldr-allprefix_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 6

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_nokl_checkpoint-26_eval-dataset

Viewer • Updated Apr 30, 2025 • 6.45k • 1

AdversarialRLHF/sffop_1706381144_410msft_relabel_pythia6.9b_logprobs_prefix_chosen

Viewer • Updated Apr 29, 2025 • 130k • 3

AdversarialRLHF/rloo_pythia410m_tldr6.9b_rm410mdata_mergedsft_prefix_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 4

AdversarialRLHF/sft_pythia410m_tldr_prefix_0.25_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 6

AdversarialRLHF/pythia410m-sft-tldr-propprefix_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 4

AdversarialRLHF/ppo_pythia410m_tldr6.9b_rm410mdata_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 1

AdversarialRLHF/ppo_pythia410m_tldr6.9b_rm410mdata_mergedsft_propprefix_eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 3

AdversarialRLHF/410M-sft-tldr-eval-dataset

Viewer • Updated Apr 29, 2025 • 6.45k • 2

AdversarialRLHF/summarize_from_feedback_tldr_3_filtered_oai_preprocessing_1706381144_propprefix

Viewer • Updated Apr 29, 2025 • 130k • 3

AdversarialRLHF/sffop_1706381144_410msft_relabel_pythia6.9b_logprobs_cond3emojiepropprefix

Viewer • Updated Apr 27, 2025 • 130k • 4