Skip to content
@flagos-ai

FlagOS

A Unified, Open-Source AI System Software Stack
README.md

FlagOS: A Unified, Open-Source AI System Software Stack

GitHub License

Language: English | 中文

📖 About FlagOS

FlagOS is a unified, open-source AI system software stack designed for multi-chip scenarios. It was jointly initiated and established by over ten domestic and international organizations, including chip companies, system manufacturers, algorithm and software-related entities, non-profit organizations, and research institutions.

Addressing core pain points in utilizing diverse AI chips, FlagOS builds a comprehensive system software ecosystem that demonstrates the potential to break down ecosystem barriers between different chip software stacks, effectively reducing migration costs for developers.

🎯 Core Components

Component Purpose Repository
FlagGems High-performance universal AI operator library FlagGems
FlagTree Unified AI compiler FlagTree
FlagScale Unified parallel training and inference framework FlagScale
FlagCX Unified communication library FlagCX
FlagPerf Multi-chip evaluation tool FlagPerf
FlagRelease Large model release platform FlagRelease
KernelGen AI enabled operator develop tool KernelGen
FlagOS-Robo End-to-end toolkit for embodied intelligence FlagOS-Robo

🚀 Extended Ecosystem Components

Developer Tools & Utilities

  • KernelGen: Next-generation AI-assisted kernel engineering for multi-chip systems → KernelGen

  • libtriton_jit: Triton JIT C++ runtime for reduced Python overhead → libtriton_jit

Framework Enhancements

  • Megatron-LM-FL: GPU-optimized library for training transformer models at scale → Megatron-LM-FL

  • TransformerEngine-FL: FP8 mixed precision training for transformer models → TransformerEngine-FL

Inference & Serving

  • vllm-FL: A vLLM plugin built on FlagOS unified multi-chip backend for LLM serving → vllm-FL

  • vllm-plugin-FL: Advanced vLLM plugin for enhanced multi-chip support → vllm-plugin-FL

Community & Resources

  • EasyOfUse: Simplify development for open compute - plug-and-play solutions and best practices → EasyOfUse

  • Community: FlagOS community governance, contribution guides, and communication hub → Community

📚 Documentation & Resources

Knowledge Base

Model Repositories

Community Channels

  • WeChat Official Account: FlagOpen
  • WeChat Channels Account: FlagOpen

🌐 Join the Community

Ready to contribute or learn more? Visit the FlagOS Community Repository for:

  • 📖 Comprehensive contribution guidelines
  • 💬 Community discussions and support
  • 🤝 Ways to get involved
  • 📚 Resources and documentation

💕 Contributing

We welcome contributions from the community! Whether through starring, forking, or submitting pull requests, your involvement helps make FlagOS better.

  • ⭐ Star - Show your support!
  • 🔔 Watch - Stay updated with our latest releases
  • 🍴 Fork - Start contributing!

Code of Conduct

Please read and respect our Code of Conduct:

📄 License

FlagOS and its components are licensed under the Apache License 2.0. See individual repositories for details.

🤝 Partners & Contributors

FlagOS is jointly supported by leading organizations in chip manufacturing, system software, and AI research. This collaborative effort demonstrates the commitment to building an open, unified ecosystem for AI system software across diverse hardware platforms.

Join us in building the future of AI system software! 🚀

Pinned Loading

  1. FlagGems FlagGems Public

    FlagGems is an operator library for large language models implemented in the Triton Language.

    Python 892 231

  2. FlagScale FlagScale Public

    FlagScale is a large model toolkit based on open-sourced projects.

    Python 471 137

  3. FlagAttention FlagAttention Public

    A collection of memory efficient attention operators implemented in the Triton language.

    Python 287 19

  4. FlagTree FlagTree Public

    FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang/triton.

    C++ 199 38

  5. community community Public

    FlagOS community governance, developer contribution guide, contribution agreement, and community communication | 包含FlagOS社区治理、开发者贡献指南、开发者贡献协议、社区交流等内容

    5 2

  6. EasyOfUse EasyOfUse Public

    Repo to collect easy of use issues for all FlagOS components | 收集FlagOS易用性问题，欢迎多提建议。

    1

Repositories

Showing 10 of 26 repositories
  • FlagCX Public

    FlagCX is a scalable and adaptive cross-chip communication library.

    flagos-ai/FlagCX’s past year of commit activity
    C++ 170 Apache-2.0 50 2 4 Updated Feb 3, 2026
  • TransformerEngine-FL Public Forked from NVIDIA/TransformerEngine

    TransformerEngine-FL is a fork of TransformerEngine that introduces a plugin-based architecture for supporting diverse AI chips, built on top of FlagOS, a unified open-source AI system software stack.

    flagos-ai/TransformerEngine-FL’s past year of commit activity
    Python 3 Apache-2.0 625 0 5 Updated Feb 3, 2026
  • vllm-FL Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    flagos-ai/vllm-FL’s past year of commit activity
    Python 2 Apache-2.0 13,260 0 1 Updated Feb 3, 2026
  • FlagGems Public

    FlagGems is an operator library for large language models implemented in the Triton Language.

    flagos-ai/FlagGems’s past year of commit activity
    Python 892 Apache-2.0 231 82 (2 issues need help) 107 Updated Feb 3, 2026
  • vllm-plugin-FL Public

    A vLLM plugin built on the FlagOS unified multi-chip backend.

    flagos-ai/vllm-plugin-FL’s past year of commit activity
    Python 10 14 4 6 Updated Feb 3, 2026
  • Megatron-LM-FL Public Forked from NVIDIA/Megatron-LM

    Megatron-LM-FL is a fork of Megatron-LM that introduces a plugin-based architecture for supporting diverse AI chips, built on top of FlagOS, a unified open-source AI system software stack.

    flagos-ai/Megatron-LM-FL’s past year of commit activity
    Python 2 3,635 0 3 Updated Feb 3, 2026
  • flir Public

    FlagTree IR is forked from microsoft/triton-shared, which is a Shared Middle-Layer for Triton Compilation. It is used for FlagTree.

    flagos-ai/flir’s past year of commit activity
    MLIR 9 MIT 4 0 2 Updated Feb 3, 2026
  • FlagTree Public

    FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang/triton.

    flagos-ai/FlagTree’s past year of commit activity
    C++ 199 MIT 37 6 (1 issue needs help) 16 Updated Feb 3, 2026
  • FlagScale Public

    FlagScale is a large model toolkit based on open-sourced projects.

    flagos-ai/FlagScale’s past year of commit activity
    Python 471 Apache-2.0 137 11 14 Updated Feb 3, 2026
  • docs Public

    Documentation for the FlagOS.

    flagos-ai/docs’s past year of commit activity
    1 CC0-1.0 3 0 2 Updated Feb 3, 2026
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…