Inference | Unsloth Documentation

unslotUnsloth makes it super easy for you to train models like Llama 3 locally or on platforms such as Google Colab and Kaggle. We stream the entire training workflow, including model loading, quantizing, training, evaluating, running,Unsloth is a product that makes LLM training 30x faster, 60% less memory intensive, and compatible with NVIDIA, Intel and AMD GPUs. It uses manual autograd, OpenAI Triton kernels, and LoRA adapters to optimize performance