AI telemetry contract
The custom dashboards use this placeholder contract. Applications must emit these metrics before the corresponding panels populate.
OpenTelemetry Generative AI
Instrument model operations with the pinned version of the OpenTelemetry Generative AI semantic conventions. The Prometheus exporter typically translates dotted OpenTelemetry metric names to underscore-separated names.
Expected metrics include:
gen_ai_client_operation_duration_secondsgen_ai_client_token_usage_totaldockprom_ai_genai_time_to_first_token_secondsdockprom_ai_genai_context_utilization_ratiodockprom_ai_genai_queue_depthdockprom_ai_genai_model_load_duration_seconds
Expected bounded attributes include model, operation, token type, error type, and service. Do not attach prompt or response content.
Workflow and RAG metrics
dockprom_ai_workflow_total{outcome}dockprom_ai_workflow_duration_secondsdockprom_ai_workflow_stage_total{stage}dockprom_ai_workflow_stage_duration_seconds{stage}dockprom_ai_workflow_errors_total{stage,error_type}dockprom_ai_chainlit_active_sessionsdockprom_ai_stream_total{outcome}dockprom_ai_genui_component_intent_total{component_type}dockprom_ai_openui_navigation_totaldockprom_ai_rag_retrieval_total{outcome,service}dockprom_ai_rag_retrieval_duration_secondsdockprom_ai_rag_similarity_score{service}
Security and MCP metrics
dockprom_ai_security_detection_totaldockprom_ai_mcp_tool_invocation_totaldockprom_ai_mcp_tool_duration_secondsdockprom_ai_mcp_confirmation_totaldockprom_ai_mcp_jsonrpc_error_totaldockprom_ai_service_public_binddockprom_ai_agent_run_totaldockprom_ai_agent_tool_call_totaldockprom_ai_agent_policy_decision_totaldockprom_ai_agent_approval_totaldockprom_ai_agent_delegation_depthdockprom_ai_agent_budget_exhausted_totaldockprom_ai_agent_safety_action_totaldockprom_ai_agent_security_event_total
Use bounded labels such as detection type, severity, policy action, tool name, tool risk, outcome, and error code. User/session identity belongs in restricted structured events as a hash, not in Prometheus.
Structured security event fields
event.action
event.outcome
security.detection.type
security.severity
gen_ai.operation.name
gen_ai.request.model
session.id_hash
user.id_hash
source.ip
tool.name
tool.risk
policy.name
policy.action
trace_id
Raw prompts, responses, runbook content, credentials, and PII must not be included unless an explicitly approved, access-controlled redaction and retention policy is in place.