Home

LLMOps Python Package

Welcome to the LLMOps Python Package wiki. This package provides tools and utilities for LLM Operations, structured using Domain-Driven Design (DDD) principles.

LLMOps Lifecycle Documentation

Important

These documents provide a comprehensive view of the project's business, data, architecture, and requirements context.

1. Business Understanding: Objectives, success metrics, and project plan.
2. Data Understanding: Data sources, quality analysis, and exploration.
3. Solution Architecture Report: Detailed architectural components and repository mapping.
4. SRS Index (Package Requirements): Central hub for all package-level requirements.
   • SRS MCP: Requirements for the Model Context Protocol server.
5. Test Plan & Report: Verification strategy and evaluation results.

Technical Architecture

• Architecture Overview (DDD): Overview of the layers, domains, and project structure.

Documentation Stories

Application Layer

• Base Stories (Job Context)
• Evaluations Stories
• Explanations Stories
• Inference Stories
• Inference Stories (Hatchet Async)
• MCP Stories
• Promotions Stories
• Training Stories
• Tuning Stories

Domain Layers

• Models Stories
• Metrics Stories
• Schemas Stories

Infrastructure Layer

• Configs Stories
• OS Variables Stories
• Services Stories
• Settings Stories
• Signers Stories
• Searchers Stories
• Splitters Stories
• Scripts Stories

Data Access Layer

• Datasets Stories
• Registries Stories

---

• Backlog LLMOps Autogen