Windows Installation

To run Unsloth directly on Windows:

• Install Triton from this Windows fork and follow the instructions: https://github.com/woct0rdho/triton-windows

• In the SFTTrainer, set dataset_num_proc=1 to avoid a crashing issue:

trainer = SFTTrainer(
    dataset_num_proc=1,
    ...
)

For advanced installation instructions or if you see weird errors during installations:

1. Install torch and triton. Go to https://pytorch.org to install it. For example pip install torch torchvision torchaudio triton

2. Confirm if CUDA is installated correctly. Try nvcc. If that fails, you need to install cudatoolkit or CUDA drivers.

3. Install xformers manually. You can try installing vllm and seeing if vllm succeeds. Check if xformers succeeded with python -m xformers.info Go to https://github.com/facebookresearch/xformers. Another option is to install flash-attn for Ampere GPUs.

4. Finally, install bitsandbytes and check it with python -m bitsandbytes