mirror of
https://github.com/mudler/LocalAI.git
synced 2026-01-16 23:49:44 -06:00
An example output of `rocm-smi --showproductname --showmeminfo vram --showuniqueid --csv`: ``` device,Unique ID,VRAM Total Memory (B),VRAM Total Used Memory (B),Card Series,Card Model,Card Vendor,Card SKU,Subsystem ID,Device Rev,Node ID,GUID,GFX Version card0,0x9246____________,17163091968,692142080,Navi 21 [Radeon RX 6800/6800 XT / 6900 XT],0x73bf,Advanced Micro Devices Inc. [AMD/ATI],001,0x2406,0xc1,1,45534,gfx1030 card1,N/A,67108864,26079232,Raphael,0x164e,Advanced Micro Devices Inc. [AMD/ATI],RAPHAEL,0x364e,0xc6,2,52156,gfx1036 ``` Total memory is actually showed before the total used memory as can be seen in https://github.com/LostRuins/koboldcpp/issues/1104#issuecomment-2321143507. This PR fixes https://github.com/mudler/LocalAI/issues/7724 Signed-off-by: Ettore Di Giacinto <mudler@localai.io>