Peter Kis
NePe
AI & ML interests
None yet
Organizations
variable_cache.py compatibility for v4.57.2 / python3.12
1
#12 opened 3 months ago
by
NePe
Since `transformers` v4.56.0` the dictionary `ALL_STATIC_CACHE_IMPLEMENTATIONS` replaced `NEED_SETUP_CACHE_CLASSES_MAPPING`
4
#9 opened 3 months ago
by
blewis-hir
cannot import name 'NEED_SETUP_CACHE_CLASSES_MAPPING'
1
#11 opened 3 months ago
by
uygarkurt
Slow GPTQ inference
13
#1 opened 10 months ago
by
NePe
Slow GPTQ inference
5
#2 opened 10 months ago
by
NePe
PEFT finetuning support
#14 opened 10 months ago
by
NePe
Can't determine properly which is greater between 9.9 and 9.11
🧠
➕
2
10
#38 opened 11 months ago
by
sniffski
with load_in_4bit it just generates <pad> tokens
2
#16 opened over 1 year ago
by
NePe
it just keeps generating <pad> tokens
3
#1 opened over 1 year ago
by
NePe
Seems like the GPTQ versions are broken
4
#2 opened about 2 years ago
by
NePe
What is this model?
3
#1 opened about 2 years ago
by
Yuuru
Build AutoGPTQ from source
3
#1 opened about 2 years ago
by
PeePants
Impossible to search/filter for 13B GPTQ models.
9
#293 opened over 2 years ago
by
NePe
How to do inferance?
9
#2 opened almost 3 years ago
by
NePe
How to do inferance?
9
#2 opened almost 3 years ago
by
NePe
How to do inferance?
9
#2 opened almost 3 years ago
by
NePe