2 phút đọc
modular/llm-inference-handbook: Everything you need to know about LLM inference – Repository modular/llm-inference-handbook. Mô tả: Everything you need to know about LLM inference. 462 stars, 53 forks, ngôn ngữ chính TypeScript, cập nhật 2026-10-23.
1. Repository làm gì?
This repository contains the source for the LLM Inference Handbook, a practical guide for understanding, optimizing, scaling, and operating LLM inference systems.
The handbook is a standalone Docusaurus site styled with the Modular design language system. Its future canonical source home is modular/llm-inference-handbook.
Install dependencies and start the local development server:
The site runs at http://localhost:3000/.
To build or serve the production output locally:
Markdown files are linted with rumdl. Prose is wrapped at 80 characters. Run the same checks as CI locally:
2. Dữ liệu và cấu trúc đáng chú ý
Some line-length violations (long URLs, API references) may need manual reflow or blocks.
rumdl supports in-editor linting via:
By default the extension uses its own built-in rules, not this repo's config. To match CI, point it at .rumdl.toml and apply rumdl fixes on save.
This repo ships recommended settings in .vscode/recommended_settings.json. Either copy those keys into .vscode/settings.json (workspace-scoped, gitignored) or into your user settings (~/Library/Application Support/Cursor/User/settings.json on macOS):
Install the recommended extensions when prompted, or open the Extensions view and run Extensions: Show Recommended Extensions.
Contributions are welcome! Feel free to open issues, suggest improvements, or submit pull requests.
This handbook follows the upstream dual-license posture:
Số liệu repository có thể thay đổi; nên mở liên kết nguồn để kiểm tra README, giấy phép và trạng thái phát hành.
Nguồn tham khảo: Xem bài gốc
