Work in progress Agent flow (AI generated non-sense so far)#5

Draft

multiarc wants to merge 58 commits intomainfrom

Commits on Aug 14, 2025

Cleanup
multiarc
committed

Commits on Aug 15, 2025

Add optimum docs
multiarc
committed

Commits on Aug 17, 2025

Work in progress Agent flow (AI generated non-sense so far)
multiarc
committed

Commits on Aug 24, 2025

Update docs for ROCm model optimization
multiarc
committed
More docs
multiarc
committed
Remap to use nuget packages from GitHub
multiarc
committed
Add pre-built python wheels for ROCm and MIgraphX. ROCm one does not include MigraphX and vice versa. This is needed for optimum to function for model optimization and default package containing mu…
multiarc
committed
Finish package alignment and default to CPU for all tests. Should work on Windows and Linux
multiarc
committed
Add OpenVINO runtime wheel
multiarc
committed

Commits on Aug 25, 2025

Commits on Aug 26, 2025

Commits on Aug 27, 2025

Finish
multiarc
committed
Model outputs non-sense, but any output is better than no output at all :)
multiarc
committed
Cleanup
multiarc
committed
WIP
multiarc
committed
KV cache fixes
multiarc
committed
Fixed tensor size issue
multiarc
committed
Remove debug
multiarc
committed
WIP
multiarc
committed
WIP
multiarc
committed
WIP
multiarc
committed
WIP
multiarc
committed
WIP
multiarc
committed
WIP
multiarc
committed
First chat turn works
multiarc
committed
WIP
multiarc
committed
WIP
multiarc
committed
Functioning chat
multiarc
committed
RAW chat interaction
multiarc
committed

Commits on Aug 28, 2025

Commits on Aug 29, 2025

Commits on Aug 30, 2025

Refactor inference from scratch
multiarc
committed

Commits on Aug 31, 2025

Refactor inference. Cleanup tokenization and simplify things
multiarc
committed

Commits on Dec 14, 2025

Inference fixes, part 1
multiarc
committed

Commits on Dec 26, 2025