awesome-ai-infra 人工智能系统基础架构知识库

We will introduce all knowledges of artificial intelligence system infrastructure.

本文试图构建AI基础设施领域的知识 Roadmap 学习路线图。

Cloud Native Infrastructure 云原生基础设施

• kubernets: Production-Grade Container Scheduling and Management

AI workload scheduling AI 工作负载调度与编排

• volcano: A Cloud Native Batch System
• koordinator: QoS based scheduling system for hybrid orchestration workloads on Kubernetes, bringing workloads the best layout and status.

Serverless AI Inference Platform 在线推理平台框架

• kserve: Standardized Serverless ML Inference Platform on Kubernetes
• triton: an open-source inference serving software

Distributed Learning 分布式训练

• Horovod: Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
• fluid: an open source Kubernetes-native Distributed Dataset Orchestrator and Accelerator for data-intensive applications, such as big data and AI applications.
• kubeDL: Run your deep learning workloads on Kubernetes more easily and efficiently.

MLDevops

• kubeflow: Machine Learning Toolkit for Kubernetes
• Argo-workflows: Workflow engine for Kubernetes