Implement context-length dependent KV-cache and Compute Buffer aware …#335

Nexesenex merged 1 commit into

Nexesenex:lcpp_pr_kv_aware_layer_distribNexesenex/croco.cpp:lcpp_pr_kv_aware_layer_distribfrom

borebot:kv-compute-buffer-cache-aware-allocationborebot/llama.cpp:kv-compute-buffer-cache-aware-allocationCopy head branch name to clipboard