Skip to content

Use Pydantic AI on the backend so you don't have to keep up with model updates #405

@whillas-yabble

Description

@whillas-yabble

Is your feature request related to a problem? Please describe.
Latest models and/or providers not kept up to date.

Describe the solution you'd like
Use the Pydantic AI module on the backend to get lists of models and make calls. See their list of supported providers: https://ai.pydantic.dev/models/overview/
They have a bigger community that keeps this list up-to-date on a daily basis. This is boring stuff that I don't imagine drives you so why not out-source it?

Its primarily an Agent framework (AgentForge in the future?) But they do give you access to their lower level API: https://ai.pydantic.dev/direct/

You might also consider only showing provider/models in your list that there are API keys for.

Describe alternatives you've considered
I've stated vibe coding a clone of this project which does this but got bogged down with the front-end stuff. Looking at litegraph.js, now, to solve this problem. Might finish it this Xmas holidays.

Additional context
You might also then start looking at structured results as this is the main use case of Pydantic in AI

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions