ViTucano is our first attempt at creating a vision assistant natively pretrained in Portuguese. ViTucano is built on top of the Tucano series.
AI & ML interests
Developing foundation models for low-resource languages.
Recent Activity
View all activity
TeenyTinyLlama is a pair of compact language models based on the Llama 2 architecture trained on a Brazilian Portuguese corpus.
-
TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguese
Paper • 2401.16640 • Published • 11 -
TeenyTinyLlama-Chat
🦙5Generate text responses to questions or instructions
-
nicholasKluge/TeenyTinyLlama-460m
Text Generation • 0.5B • Updated • 58 • 11 -
nicholasKluge/TeenyTinyLlama-460m-awq
Text Generation • 0.5B • Updated • 4 • 1
ViTucano is our first attempt at creating a vision assistant natively pretrained in Portuguese. ViTucano is built on top of the Tucano series.
Tucano is a series of decoder-transformers based on the Llama 2 architecture, natively pre-trained in Portuguese.
TeenyTinyLlama is a pair of compact language models based on the Llama 2 architecture trained on a Brazilian Portuguese corpus.
-
TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguese
Paper • 2401.16640 • Published • 11 -
TeenyTinyLlama-Chat
🦙5Generate text responses to questions or instructions
-
nicholasKluge/TeenyTinyLlama-460m
Text Generation • 0.5B • Updated • 58 • 11 -
nicholasKluge/TeenyTinyLlama-460m-awq
Text Generation • 0.5B • Updated • 4 • 1