DeepSeek-R1-Distill-Llama-8B SpectralPO/DeepSeek-R1-Distill-Llama-8B-SPO 8B • Updated May 18, 2025 SpectralPO/DeepSeek-R1-Distill-Llama-8B-GRPO 8B • Updated May 18, 2025 • 2
Qwen2.5-32B-Instruct SpectralPO/Qwen2.5-32B-Instruct-SPO 33B • Updated May 13, 2025 SpectralPO/Qwen2.5-32B-Instruct-GRPO 33B • Updated May 13, 2025
DeepSeek-R1-Distill-Qwen-7B SpectralPO/DeepSeek-R1-Distill-Qwen-7B-GRPO 8B • Updated May 2, 2025 • 1 SpectralPO/DeepSeek-R1-Distill-Qwen-7B-SPO 8B • Updated May 2, 2025
Offline RL with Neg Samples SpectralPO/s1K-7B-RSPO-neg 8B • Updated Apr 12, 2025 SpectralPO/Qwen2.5-32B-Instruct-neg 33B • Updated Apr 13, 2025 SpectralPO/Qwen2.5-14B-Instruct-neg 15B • Updated Apr 18, 2025
DeepSeek-R1-Distill-Qwen-32B SpectralPO/DeepSeek-R1-Distill-Qwen-32B-SPO Updated Jul 19, 2025 SpectralPO/DeepSeek-R1-Distill-Qwen-32B-GRPO Updated Jul 19, 2025
Qwen2.5-14B-Instruct SpectralPO/Qwen2.5-14B-Instruct-GRPO 15B • Updated May 9, 2025 SpectralPO/Qwen2.5-14B-Instruct-SPO 15B • Updated May 9, 2025 • 1
Qwen2.5-7B-Instruct SpectralPO/Qwen2.5-7B-Instruct-GRPO 8B • Updated Apr 27, 2025 SpectralPO/Qwen2.5-7B-Instruct-SPO 8B • Updated Apr 27, 2025
DeepSeek-R1-Distill-Llama-8B SpectralPO/DeepSeek-R1-Distill-Llama-8B-SPO 8B • Updated May 18, 2025 SpectralPO/DeepSeek-R1-Distill-Llama-8B-GRPO 8B • Updated May 18, 2025 • 2
DeepSeek-R1-Distill-Qwen-32B SpectralPO/DeepSeek-R1-Distill-Qwen-32B-SPO Updated Jul 19, 2025 SpectralPO/DeepSeek-R1-Distill-Qwen-32B-GRPO Updated Jul 19, 2025
Qwen2.5-32B-Instruct SpectralPO/Qwen2.5-32B-Instruct-SPO 33B • Updated May 13, 2025 SpectralPO/Qwen2.5-32B-Instruct-GRPO 33B • Updated May 13, 2025
Qwen2.5-14B-Instruct SpectralPO/Qwen2.5-14B-Instruct-GRPO 15B • Updated May 9, 2025 SpectralPO/Qwen2.5-14B-Instruct-SPO 15B • Updated May 9, 2025 • 1
DeepSeek-R1-Distill-Qwen-7B SpectralPO/DeepSeek-R1-Distill-Qwen-7B-GRPO 8B • Updated May 2, 2025 • 1 SpectralPO/DeepSeek-R1-Distill-Qwen-7B-SPO 8B • Updated May 2, 2025
Qwen2.5-7B-Instruct SpectralPO/Qwen2.5-7B-Instruct-GRPO 8B • Updated Apr 27, 2025 SpectralPO/Qwen2.5-7B-Instruct-SPO 8B • Updated Apr 27, 2025
Offline RL with Neg Samples SpectralPO/s1K-7B-RSPO-neg 8B • Updated Apr 12, 2025 SpectralPO/Qwen2.5-32B-Instruct-neg 33B • Updated Apr 13, 2025 SpectralPO/Qwen2.5-14B-Instruct-neg 15B • Updated Apr 18, 2025
