Configurable Safety Tuning of Language Models with Synthetic Preference Data
Paper
•
2404.00495
•
Published
•
2
Configurable Safety Tuning ⚙️🛡️
CST allows for configurable inference-time control of LLM safety levels, so users can dictate model behavior based on the system prompt
-
-
vicgalle/configurable-system-prompt-multitask
Viewer • Updated • 1.95k • 63 • 29 -
vicgalle/ConfigurableHermes-7B
Text Generation • 7B • Updated • 7.39k • 3 -
vicgalle/ConfigurableSOLAR-10.7B
Text Generation • 11B • Updated • 46 • • 3 -
vicgalle/ConfigurableBeagle-11B
Text Generation • 11B • Updated • 7.45k • • 3 -
vicgalle/Configurable-Llama-3-8B-v0.3
Text Generation • 8B • Updated • 7.4k • • 15 -
vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B
Text Generation • 8B • Updated • 9.11k • 6 -
vicgalle/Configurable-Yi-1.5-9B-Chat
Text Generation • 9B • Updated • 7.45k • 3 -
vicgalle/Configurable-SmolLM-1.7B
Text Generation • 2B • Updated • 2 • 1 -
vicgalle/Configurable-Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 33 • • 16 -
vicgalle/Configurable-Hermes-3-Llama-3.1-8B
Text Generation • 8B • Updated • 40 • • 7