Post
2771
📢 Who want's to have a quick start for adapting CoT schema for any LLM, this post would be relevant.
Excited to share a new version of 🌟 bulk-chain 🌟!
Bulk-chain is high-level wrapper over LLM providers for efficient quering LLMs hosted by third-party services.
It brings native batching via support of async clients.
🌟 https://github.com/nicolay-r/bulk-chain/tree/master
What's new:
☑️ Simplified inference setup
The API is now closer to the OpenAI paradigm for toggling streaming.
Instead of separate patterns in 1.2.0, now it is possible to simple toggles to enable streaming and async behavior.
☑️ 🛠️ Fixed issues when passing code contain {} blocks
☑️ 🛠️ Async streaming + batching now works properly
☑️ 🛠️ Logging of prompts could be disabled
https://github.com/nicolay-r/bulk-chain
🚨 Guys, I am open to work as developer / researcher in AI / NLP / IR in the UK 🇬🇧
🌟 Feel free to support bulk-chain on Github if you like so, or this post.
It helps alot!
Excited to share a new version of 🌟 bulk-chain 🌟!
Bulk-chain is high-level wrapper over LLM providers for efficient quering LLMs hosted by third-party services.
It brings native batching via support of async clients.
🌟 https://github.com/nicolay-r/bulk-chain/tree/master
What's new:
☑️ Simplified inference setup
The API is now closer to the OpenAI paradigm for toggling streaming.
Instead of separate patterns in 1.2.0, now it is possible to simple toggles to enable streaming and async behavior.
☑️ 🛠️ Fixed issues when passing code contain {} blocks
☑️ 🛠️ Async streaming + batching now works properly
☑️ 🛠️ Logging of prompts could be disabled
https://github.com/nicolay-r/bulk-chain
🚨 Guys, I am open to work as developer / researcher in AI / NLP / IR in the UK 🇬🇧
🌟 Feel free to support bulk-chain on Github if you like so, or this post.
It helps alot!
