vLLM officially supports MI200 and MI300 series GPUs, but older cards like the MI100 (gfx908) are not officially supported. With some modifications it is possible to run vLLM on these GPUs. The MI100 ...
Customer stories Events & webinars Ebooks & reports Business insights GitHub Skills ...