accelerate
auto-gptq==0.7.1
grpcio==1.65.1
protobuf
torch
certifi
transformers