YC Yc.W home Systems · C++ · AI Infrastructure

Docker Articles

15 articles


AI & LLM · curated-v1

GPU / CUDA / Docker 部署兼容性清单:从镜像到模型服务

Curated guide
用版本矩阵、镜像 digest、模型校验、GPU 可见性、安全边界和功能验收,把消费级 GPU 部署记录整理成可复用的兼容性案例。
AI & LLM · curated-v1

Ray + vLLM 离线多节点部署:从可复现安装到安全运维

Curated guide
把 Ray wheelhouse、GPU 容器、并行策略、私有网络、认证、健康检查和回滚拆开,避免把一条历史启动命令误当成生产保证。
DevOps & Infrastructure · curated-v1

DevOps 交付手册:Git、GitLab、Docker 与可恢复的发布流程

Curated guide
把版本控制、CI/CD、容器、GitLab 运维、备份恢复和常见故障整理成一条适合小团队落地的交付与回滚路径。
AI & LLM · curated-v1

LLM 推理服务上线清单:从单机验证到多节点运维

Curated guide
整合 vLLM、Ray、Docker、模型网关和离线部署笔记,给出模型服务从容量估算到灰度、监控与回滚的生产检查表。
AI & LLM

Agent Swarm: 部署一个自主协作的 AI 编程团队

Introduction to Agent Swarm, an open-source multi-agent AI operating system, with a step-by-step focus on offline deployment of its Docker-based Lead and Worker architecture.
AI & LLM

从零搭建 vLLM 多节点推理集群:Docker 部署全流程实战

手把手教你用 Docker + Ray + vLLM 在多节点 GPU 集群上部署 70B+ 大模型推理服务,覆盖在线/离线安装、模型选型、性能调优与生产运维。
AI & LLM

New-API 部署同一模型双进程双端口:实现负载均衡与高可用的完整指南

Deploy two New-API processes for the same model on separate ports to achieve load balancing and high availability, with complete Docker Compose configuration and tuning notes.
AI & LLM

Running DeepSeek-V4-Flash-0731 on 8x RTX 4090D with Docker

Step-by-step guide to building a Docker image and serving DeepSeek-V4-Flash-0731 on 8x RTX 4090D consumer GPUs using the vLLM SM89 fork.
AI & LLM

Multi-Node LLM Serving: vLLM + Ray

End-to-end offline deployment of vLLM with Ray across two nodes in Docker, covering worker discovery, tensor-parallel inference, and automated health checks.
AI & LLM

Deploying MiniCPM5-1B with llama.cpp

Offline deployment of MiniCPM5-1B using llama.cpp server in Docker, with Open-WebUI frontend and CPU-only inference configuration.
AI & LLM

Deploying MiniCPM5-1B with Ollama

Offline deployment of MiniCPM5-1B using Ollama and Open-WebUI in Docker, covering image loading, model import, and CPU-only inference setup.
DevOps & Infrastructure

以ubuntu:latest为例

Docker engine installation on Ubuntu using the official repository method, with post-install permissions and basic container management commands.
DevOps & Infrastructure

DM8 Docker 镜像

Running DM8 (达梦数据库) in Docker, including image pull, initialization, and basic SQL client configuration for development and testing.
DevOps & Infrastructure

Ubuntu18.04

DevOps & Infrastructure

First exploration