forking-llama-cpp-api

This API can be used to create a chatbot based on llama.cpp. Besides interaction, it allows user to create new chats initialized with given prompt and fork existing chats.

Check simple-frontend to see how to interact with it.