Kyle Sayers's picture

15 3 2

Kyle Sayers

kylesayrs

·

https://github.com/kylesayrs

AI & ML interests

Accelerating ML inference @ Red Hat

Recent Activity

updated a model 1 day ago

nm-testing/woah

published a model 1 day ago

nm-testing/woah

updated a model 13 days ago

inference-optimization/DeepSeek-V3-debug-multiply-FP8_DYNAMIC

View all activity

Organizations

New activity in Xenova/llama2.c-stories110M 6 months ago

[Bug] Model loads with meta tensors

#4 opened 6 months ago by

New activity in ptb-text-only/ptb_text_only 7 months ago

No longer supported by `datasets>=4.0.0`

#3 opened 7 months ago by

New activity in unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit 11 months ago

Update preprocessor_config.json

#2 opened 12 months ago by

New activity in deepseek-ai/DeepSeek-V3 11 months ago

fix for transformers 4.49 compatibility.

#91 opened 11 months ago by

New activity in Xenova/llama2.c-stories15M 11 months ago

Model fails to load with AutoModelForCausalLM

#4 opened 11 months ago by

New activity in moonshotai/Moonlight-16B-A3B 12 months ago

Fix generation with latest transformers

#1 opened 12 months ago by

New activity in deepseek-ai/DeepSeek-V3 12 months ago

Fix generation with latest transformers

#87 opened 12 months ago by

Fix generation with latest transformers

#88 opened 12 months ago by

New activity in microsoft/Phi-3-vision-128k-instruct 12 months ago

[Bug] Model Breaking Dynamic Cache

#69 opened 12 months ago by

New activity in mistral-community/pixtral-12b 12 months ago

Getting shape mismatch while loading saved Pixtral model

#24 opened about 1 year ago by

New activity in zai-org/glm-4v-9b about 1 year ago

Fix tokenizer reloading

#42 opened about 1 year ago by

How to run the Int4 quantized model？

#10 opened over 1 year ago by

fix image size unchangeable

#32 opened over 1 year ago by

Tokenizer参数保存到本地之后再重新读入会所改变？

#35 opened over 1 year ago by

New activity in nm-testing/pixtral-12b-w4a16-actorder-group about 1 year ago

What is an actorder group and what are the advantages of running this in vLLM?

#1 opened about 1 year ago by

What is an actorder group and what are the advantages of running this in vLLM?

#1 opened about 1 year ago by

kylesayrs (Kyle Sayers) – Community Activity

Kyle Sayers's picture

15 3 2

Kyle Sayers

kylesayrs

·

https://github.com/kylesayrs

AI & ML interests

Accelerating ML inference @ Red Hat

Recent Activity

updated a model 1 day ago

nm-testing/woah

published a model 1 day ago

nm-testing/woah

updated a model 13 days ago

inference-optimization/DeepSeek-V3-debug-multiply-FP8_DYNAMIC

View all activity

Organizations

New activity in Xenova/llama2.c-stories110M 6 months ago

[Bug] Model loads with meta tensors

#4 opened 6 months ago by

New activity in ptb-text-only/ptb_text_only 7 months ago

No longer supported by `datasets>=4.0.0`

#3 opened 7 months ago by

New activity in unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit 11 months ago

Update preprocessor_config.json

#2 opened 12 months ago by

New activity in deepseek-ai/DeepSeek-V3 11 months ago

fix for transformers 4.49 compatibility.

#91 opened 11 months ago by

New activity in Xenova/llama2.c-stories15M 11 months ago

Model fails to load with AutoModelForCausalLM

#4 opened 11 months ago by

New activity in moonshotai/Moonlight-16B-A3B 12 months ago

Fix generation with latest transformers

#1 opened 12 months ago by

New activity in deepseek-ai/DeepSeek-V3 12 months ago

Fix generation with latest transformers

#87 opened 12 months ago by

Fix generation with latest transformers

#88 opened 12 months ago by

New activity in microsoft/Phi-3-vision-128k-instruct 12 months ago

[Bug] Model Breaking Dynamic Cache

#69 opened 12 months ago by

New activity in mistral-community/pixtral-12b 12 months ago

Getting shape mismatch while loading saved Pixtral model

#24 opened about 1 year ago by

New activity in zai-org/glm-4v-9b about 1 year ago

Fix tokenizer reloading

#42 opened about 1 year ago by

How to run the Int4 quantized model？

#10 opened over 1 year ago by

fix image size unchangeable

#32 opened over 1 year ago by

Tokenizer参数保存到本地之后再重新读入会所改变？

#35 opened over 1 year ago by

New activity in nm-testing/pixtral-12b-w4a16-actorder-group about 1 year ago

What is an actorder group and what are the advantages of running this in vLLM?

#1 opened about 1 year ago by

What is an actorder group and what are the advantages of running this in vLLM?

#1 opened about 1 year ago by