perf: Pilgrim accumulated optimizations — CPU, CUDA, Vulkan#25

hai-pilgrim wants to merge 26 commits into

heiervang-technologies:htheiervang-technologies/ht-llama.cpp:htfrom

hai-pilgrim:pilgrim/accumulated-optimizationshai-pilgrim/ht-llama.cpp:pilgrim/accumulated-optimizationsCopy head branch name to clipboard