CUDA: Improve performance via less synchronizations between token#17795

ggerganov merged 13 commits into

ggml-org:masterggml-org/llama.cpp:masterfrom

aendk:akieslinger/reduce-per-token-syncsaendk/llama.cpp:akieslinger/reduce-per-token-syncsCopy head branch name to clipboard