Agent Articles
2 articles
Multi-Node LLM Serving: vLLM + Ray
End-to-end offline deployment of vLLM with Ray across two nodes in Docker, covering worker discovery, tensor-parallel inference, and automated health checks.
AI Coding Agent: OpenCode
Overview of OpenCode, an open-source AI coding assistant with intelligent completion, multi-model support, and a CLI-based conversational workflow.
Tag navigation
Featured tags