0.14.0
·
1996 commits
to master
since this release
OpenAI-compatible endpoints
With the latest update, we are extending the service configuration in dstack to enable you to optionally map your custom LLM to an OpenAI-compatible endpoint.
To learn more about how the new feature, read our blog post on it.
What's changed
- Make gateway active by @Egor-S in #829
- Implement OpenAI streaming for TGI by @Egor-S in #833
- Make get_latest_runner_build robuster for editable installs by @Egor-S in #834
- Fix descending logs by @r4victor in #839
- Reraise Jinja2 TemplateError by @Egor-S in #840
Full Changelog: 0.13.1...0.14.0
Contributors
r4victor and Egor-S