Skip to content

Provides API access to cloud-hosted large language models for use in other projects

License

Notifications You must be signed in to change notification settings

PraxisAppDev/llm-service

Repository files navigation

Afterhours LLM Service Monorepo

This monorepo contains all of the backend, frontend, and IaC code for the Afterhours LLM Service.

About

The Afterhours LLM Service provides API access to large language models (LLMs) for authorized users via API keys. The API is meant to be used for Praxis Engineering "Afterhours" projects that require access to LLMs that are too big to run on local development machines.

Setup

You'll need:

  • An AWS account
  • AWS credentials setup in a local profile
  • Node.js 22.x

Clone the repo and run npm install in both the root and ui directories.

Development

Start SST to deploy a development environment in AWS and run the UI locally:

$ AWS_PROFILE=<profile> npm run dev

Use the provided script to seed an admin user in your development environment:

$ AWS_PROFILE=<profile> npm run seed:admin "Name" "email address" password

To tear down your development environment in AWS:

$ AWS_PROFILE=<profile> npm run remove

About

Provides API access to cloud-hosted large language models for use in other projects

Topics

Resources

License

Stars

Watchers

Forks

Packages