examples.md

title	Examples
description	Collection of examples for training, inference, and clusters
hide	navigation footer

<style> .md-main .md-main__inner.md-grid { flex-direction: row-reverse; } </style>

Single-node training

TRL

    <p>
        Fine-tune Llama 3.1 8B on a custom dataset using TRL.
    </p>
</a>

<a href="/examples/single-node-training/axolotl"
   class="feature-cell">
    <h3>
        Axolotl
    </h3>

    <p>
        Fine-tune Llama 4 on a custom dataset using Axolotl.
    </p>
</a>

Distributed training

TRL

    <p>
        Fine-tune LLM on multiple nodes
        with TRL, Accelerate, and Deepspeed.
    </p>
</a>
<a href="/examples/distributed-training/axolotl"
   class="feature-cell sky">
    <h3>
        Axolotl
    </h3>

    <p>
        Fine-tune LLM on multiple nodes
        with Axolotl.
    </p>
</a>
<a href="/examples/distributed-training/ray-ragen"
   class="feature-cell sky">
    <h3>
        Ray+RAGEN
    </h3>

    <p>
        Fine-tune an agent on multiple nodes
        with RAGEN, verl, and Ray.
    </p>
</a>

Clusters

GCP

    <p>
        Set up GCP A4 and A3 clusters with optimized networking
    </p>
</a>
<a href="/examples/clusters/efa"
   class="feature-cell sky">
    <h3>
        AWS
    </h3>

    <p>
        Set up AWS EFA clusters with optimized networking
    </p>
</a>
<a href="/examples/clusters/lambda"
   class="feature-cell sky">
    <h3>
        Lambda
    </h3>

    <p>
        Set up Lambda clusters with optimized networking
    </p>
</a>
<a href="/examples/clusters/crusoe"
   class="feature-cell sky">
    <h3>
        Crusoe
    </h3>

    <p>
        Set up Crusoe clusters with optimized networking
    </p>
</a>
<a href="/examples/clusters/nebius"
   class="feature-cell sky">
    <h3>
        Nebius
    </h3>

    <p>
        Set up Nebius clusters with optimized networking
    </p>
</a>
<a href="/examples/clusters/nccl-rccl-tests"
   class="feature-cell sky">
    <h3>
        NCCL/RCCL tests
    </h3>

    <p>
        Run multi-node NCCL tests with MPI
    </p>
</a>

Inference

SGLang

Deploy DeepSeek distilled models with SGLang

vLLM

Deploy Llama 3.1 with vLLM

TGI

Deploy Llama 4 with TGI

NIM

Deploy a DeepSeek distilled model with NIM

TensorRT-LLM

Deploy DeepSeek models with TensorRT-LLM

Accelerators

AMD

    <p>
        Deploy and fine-tune LLMs on AMD
    </p>
</a>

<a href="/examples/accelerators/tpu"
   class="feature-cell sky">
    <h3>
        TPU
    </h3>

    <p>
        Deploy and fine-tune LLMs on TPU
    </p>
</a>

<a href="/examples/accelerators/intel"
   class="feature-cell sky">
    <h3>
        Intel Gaudi
    </h3>

    <p>
        Deploy and fine-tune LLMs on Intel Gaudi
    </p>
</a>

<a href="/examples/accelerators/tenstorrent"
   class="feature-cell sky">
    <h3>
        Tenstorrent
    </h3>

    <p>
        Deploy and fine-tune LLMs on Tenstorrent
    </p>
</a>

Models

Wan2.2

    <p>
        Use Wan2.2 to generate videos from text
    </p>
</a>