Implementing Llms Litgpt

Implements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral). Use when need clean model implementations, educational understanding of architectures, or production fine-tuning with LoRA/QLoRA. Single-file implementations, no abstraction layers.

Originally published by orchestra. Licensed under MIT. View original: https://github.com/Orchestra-Research/AI-Research-SKILLs/tree/main/01-model-architecture/litgpt

Anthropic and OpenAI are registered trademarks of their respective owners. skill.ski is not affiliated with or endorsed by Anthropic or OpenAI.

Add the free skill.ski MCP server to your .mcp.json or equivalent config file:

{
  "mcpServers": {
    "skill-ski-free": {
      "url": "https://mcp.skill.ski/free",
      "type": "http"
    }
  }
}

Once connected, this Oski is available as a callable tool at your runtime. No paywall. No sign-in required for free-tier Oskis.