VernLLM is the LLM call framework for TypeScript. This video tests out its features, which includes adaptive AIMD rate-limiting, advanced circuit-breakers, multi provider fallbacks, developed retries with budget and observability. Open source with MIT license.
Website: https://vernllm.dev
GitHub: https://github.com/LakBud/vernLLM
npm: https://www.npmjs.com/package/vern-llm
This article was originally published by DEV Community and written by LakBud.
Read original article on DEV Community