NETLLMBENCH

This repository contains the source code for the NETLLMBENCH framework.

Repository Structure

docker: folder containing the docker-compose file for required Docker environment
statistics: folder where the statistics will be collected by the framework
config.py: the configuration file for the model names and the server where the model is hosted
prompts.py: prompts for the used tasks in evaluation

In order to reproduce our measurement results, a working Docker version 27.0.3 and Docker Compose version v2.28.1 is required.

Run main.py for evaluation.

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
docker		docker
statistics		statistics
.gitignore		.gitignore
README.md		README.md
config.py		config.py
framework.py		framework.py
interactor.py		interactor.py
kathara.py		kathara.py
logger_config.py		logger_config.py
main.py		main.py
prompts.py		prompts.py
statistics_collector.py		statistics_collector.py