mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-01-04 01:30:08 -06:00
Code Issues Packages Projects Releases Wiki Activity
Files
4ac7956f6868b5814df6cf8e774bea4eccd43d9a
LocalAI/backend/cpp/llama/grpc-server.cpp
Ettore Di Giacinto e49ea0123b feat(llama.cpp): add flash_attention and no_kv_offloading (#2310) 
feat(llama.cpp): add flash_attn and no_kv_offload

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-05-13 19:07:51 +02:00

90 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink