Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice
Text-to-Speech
•
Updated
•
878k
•
1.11k
Max
moock
·
AI & ML interests
None yet
Recent Activity
liked
a model
4 days ago
Qwen/Qwen3-TTS-12Hz-1.7B-CustomVoice
upvoted
an
article
about 1 year ago
Use Models from the Hugging Face Hub in LM Studio
liked
a model
over 1 year ago
ostris/OpenFLUX.1
Organizations
liked
a
model
4 days ago
upvoted
an
article
about 1 year ago
Article
Use Models from the Hugging Face Hub in LM Studio
•
141
liked
a
model
over 1 year ago
liked
3
Spaces
over 1 year ago
upvoted
a
collection
over 1 year ago
reacted to
clem's
post with 🚀
over 1 year ago
Post
5809
5,000 new repos (models, datasets, spaces) are created EVERY DAY on HF now. The community is amazing!
liked
a
Space
over 1 year ago
It would be fun to have a prediction of my future daily activities 🪄
reacted to
adamm-hf's
post with 🔥
over 1 year ago
Post
2144
cooking up something....anyone interested in a daily activity tracker for HF?
-
- 12 replies
reacted to
singhsidhukuldeep's
post with 👍
over 1 year ago
Post
2087
🎭 You picked an LLM for your work but then you find out it hallucinates! 🤖
🤔 Your first thought might be to fine-tune it on more training data.... but should you? 🛠️
📜 This is what @Google is exploring in the paper "Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?" 🕵️♂️
📘 When LLMs undergo supervised fine-tuning with new factual knowledge not present in their initial training data, there is a risk they might "hallucinate" or produce factually incorrect information. 🚨
🔍 The paper investigates how fine-tuning LLMs with new facts influences their ability to leverage pre-existing knowledge and the extent to which they generate errors. 📊
⚙️Technical Setup:
🔧 Approach: They introduce a system named SliCK (this stands for Sampling-based Categorization of Knowledge, don't even bother understanding how) to categorize knowledge into four levels (HighlyKnown, MaybeKnown, WeaklyKnown, and Unknown) based on how well the model's generated responses agree with known facts. 🗂️
📝 Experimental Setup: The study uses a controlled setup focusing on closed-book QA, adjusting the proportion of fine-tuning examples that introduce new facts versus those that do not. 🧪
👉 Here is the gist of the findings:
🚸 LLMs struggle to integrate new factual knowledge during fine-tuning, and such examples are learned slower than those consistent with the model's pre-existing knowledge. 🐢
📈 As LLMs learn from examples containing new knowledge, their propensity to hallucinate increases. 👻
⏱️ Early stopping during training can mitigate the risks of hallucinations by minimizing exposure to unlearned new facts. 🛑
🧠 Training LLMs mostly with known examples leads to better utilization of pre-existing knowledge, whereas examples introducing new knowledge increase the risk of generating incorrect information. 🏗️
📄 Paper: Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations? (2405.05904) 📚
🤔 Your first thought might be to fine-tune it on more training data.... but should you? 🛠️
📜 This is what @Google is exploring in the paper "Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?" 🕵️♂️
📘 When LLMs undergo supervised fine-tuning with new factual knowledge not present in their initial training data, there is a risk they might "hallucinate" or produce factually incorrect information. 🚨
🔍 The paper investigates how fine-tuning LLMs with new facts influences their ability to leverage pre-existing knowledge and the extent to which they generate errors. 📊
⚙️Technical Setup:
🔧 Approach: They introduce a system named SliCK (this stands for Sampling-based Categorization of Knowledge, don't even bother understanding how) to categorize knowledge into four levels (HighlyKnown, MaybeKnown, WeaklyKnown, and Unknown) based on how well the model's generated responses agree with known facts. 🗂️
📝 Experimental Setup: The study uses a controlled setup focusing on closed-book QA, adjusting the proportion of fine-tuning examples that introduce new facts versus those that do not. 🧪
👉 Here is the gist of the findings:
🚸 LLMs struggle to integrate new factual knowledge during fine-tuning, and such examples are learned slower than those consistent with the model's pre-existing knowledge. 🐢
📈 As LLMs learn from examples containing new knowledge, their propensity to hallucinate increases. 👻
⏱️ Early stopping during training can mitigate the risks of hallucinations by minimizing exposure to unlearned new facts. 🛑
🧠 Training LLMs mostly with known examples leads to better utilization of pre-existing knowledge, whereas examples introducing new knowledge increase the risk of generating incorrect information. 🏗️
📄 Paper: Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations? (2405.05904) 📚
- 2 replies
liked
a
model
over 1 year ago
liked
a
Space
almost 2 years ago
upvoted
a
paper
almost 2 years ago
liked
a
model
almost 2 years ago
liked
a
Space
almost 2 years ago
liked
2
models
almost 2 years ago
liked
a
dataset
almost 2 years ago