fakezeta 4a239a4bff feat(transformers): various enhancements to the transformers backend (#2468) ...

update transformers

*Handle Temperature = 0 as greedy search
*Handle custom works as stop words
*Implement KV cache
*Phi 3 no more requires trust_remote_code: true

2024-06-03 08:52:55 +02:00

17 KiB

Raw Blame History

View Raw