This folder contains an example of a web application (app.py) using Flask and LLMProxy, a simple script(test_query) to test the deployment, and additional files (requirements.txt, Procfile) required for a Koyeb deployment.
1. Sign-up to the service using this link: https://app.koyeb.com/auth/signup
2. Create service and follow steps to link either your Github repo or you could try this public repo example https://github.com/koyeb/example-flask
3. Use "Secrets" to add your LLMProxy API key and end-point information. More info at this link https://www.koyeb.com/docs/reference/secrets
4. Update your deployment with the environment variables where variables names must be "endPoint" and "apiKey". Then redeploy with a build triggered option.
5. Click on the service link and it should open a web page with the mesage "Hello from Koyeb - you reached the main page!".
1. Edit the "test.py" file and replace the links in below lines with your service link - keep the "/query" part in the second line
response_main = requests.get("https://replace_with_your_web_server_link")
response_llmproxy = requests.post("https://replace_with_your_web_server_link/query", json=data)
2. Run the test file locally on your machine and you should receive two responses from the web application and LLMProxy respectively.