llama + CUDA: flash_attn_ext_rows (fix unified kv for multi-seq) by am17an · Pull Request #29510 · ggml-org/llama.cpp

🌐 链接: https://www.reddit.com/r/LocalLLaMA/comments/1xm27fp/llama_cuda_flash_attn_ext_rows_fix_unified_kv_for/
🏷️ 分组: Reddit｜AI·自托管·VPS
🕒 时间: 2026-11-03 00:41:34
Reddit
From the LocalLLaMA community on Reddit: llama + CUDA: flash_attn_ext_rows (fix unified kv for multi-seq) by am17an · Pull Request…
From the LocalLLaMA community on Reddit: llama + CUDA: flash_attn_ext_rows (fix unified kv for multi-seq) by am17an · Pull Request…
Posted by jacek2023 - 1 vote and 0 comments