[New!!] Multimodal Support for Llama 3.2 11B Command line interaction with popular LLMs such as Llama 3, Llama 2, Stories, Mistral and more PyTorch-native execution with performance Supports popular ...
Note: The project requires an NVIDIA GPU with CUDA support. The code is tested on Ubuntu 20.04 with CUDA 12.1 and PyTorch 2.3.1. Windows system is strongly ...