Ettore Di Giacinto e28e80857b feat(shutdown): allow force shutdown of backends (#3733) ...

We default to a soft kill, however, we might want to force killing
backends after a while to avoid hanging requests (which may hallucinate
indefinetly)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2024-10-05 10:41:35 +02:00

4.6 KiB

Raw Blame History

View Raw