What belongs in a project
- Prompts and prompt versions.
- Project tools and optional prompt MCP configuration used by those prompts.
- Evaluators and datasets.
- Production traces and monitor charts.
- Behavior analysis and Improve cycles.
- Deployment environments and history.
Project boundaries
Project boundaries matter because Platform workflows join data inside a project:- Monitor and Traces read project traffic.
- Behaviors analyze project traces and subject-specific patterns.
- Improve cycles target prompts and behaviors inside the project.
- Evaluators and datasets are selected from the project context.
- Deployment environments are project-scoped release targets.
Project setup checklist
For a production project, create or verify:- Prompts for each runtime behavior.
- Deployment environments for the release lanes your application uses.
- Provider credentials at the workspace level.
- API keys for runtime logging, deployment reads, and automation.
- Tools for external actions and data access.
- Evaluators for quality, safety, schema, cost, and latency requirements.
- Golden and regression datasets.
- Trace metadata standards for environment, route, release, and segment.
- Webhooks or cache refresh logic if your runtime caches deployments.
Common project patterns
| Pattern | Use it when |
|---|---|
| One AI product | A support assistant, research agent, coding assistant, or workflow has shared prompts and traffic. |
| One release lifecycle | Prompts deploy through the same staging and production environments. |
| One evaluation policy | The same datasets and evaluators define quality across related prompts. |
| One observability scope | Operators should review Monitor, Traces, Behaviors, and Improve together. |
Next steps
Prompts
Build and test prompt behavior inside a project.
Monitor
Track production health for the project.
Improve
Turn production evidence into reviewed prompt candidates.
Deploy
Ship prompt versions to project environments.