Run Agent Locally
Start the Server
uv run start-appThis starts the agent at http://localhost:8000
Server Options
# Hot-reload on code changes (development)
uv run start-server --reload
# Custom port
uv run start-server --port 8001
# Multiple workers (production-like)
uv run start-server --workers 4
# Combine options
uv run start-server --reload --port 8001Test the API
Streaming request:
curl -X POST http://localhost:8000/invocations \
-H "Content-Type: application/json" \
-d '{ "input": [{ "role": "user", "content": "hi" }], "stream": true }'Non-streaming request:
curl -X POST http://localhost:8000/invocations \
-H "Content-Type: application/json" \
-d '{ "input": [{ "role": "user", "content": "hi" }] }'Run Evaluation
uv run agent-evaluateUses MLflow scorers (RelevanceToQuery, Safety).
Run Unit Tests
pytest [path]Troubleshooting
| Issue | Solution |
|---|---|
| Port already in use | Use --port 8001 or kill existing process |
| Authentication errors | Verify .env is correct; run quickstart skill |
| Module not found | Run uv sync to install dependencies |
| MLflow experiment not found | Ensure MLFLOW_TRACKING_URI in .env is databricks://<profile-name> |
MLflow Experiment Not Found
If you see: "The provided MLFLOW_EXPERIMENT_ID environment variable value does not exist"
Verify the experiment exists:
databricks -p <profile> experiments get-experiment <experiment_id>Fix: Ensure .env has the correct tracking URI format:
MLFLOW_TRACKING_URI="databricks://DEFAULT" # Include profile nameThe quickstart script configures this automatically. If you manually edited .env, ensure the profile name is included.
Next Steps
- Modify your agent: see modify-agent skill
- Deploy to Databricks: see deploy skill