curl --request POST \
--url https://api.mnemom.ai/v1/policies/evaluate/historical \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"policy": {
"meta": {
"schema_version": "<string>",
"name": "<string>",
"description": "<string>",
"scope": "agent"
},
"capability_mappings": {},
"forbidden": [
{
"pattern": "<string>",
"reason": "<string>",
"severity": "high"
}
],
"escalation_triggers": [
{
"condition": "<string>",
"action": "notify",
"reason": "<string>"
}
],
"defaults": {
"unmapped_tool_action": "warn",
"unmapped_severity": "medium",
"fail_open": false,
"enforcement_mode": "observe",
"grace_period_hours": 0
}
},
"agent_id": "<string>",
"from": "2023-11-07T05:31:56Z",
"to": "2023-11-07T05:31:56Z",
"limit": 100
}
'{
"evaluation": {
"verdict": "pass",
"violations": [
{
"type": "forbidden",
"tool": "<string>",
"capability": "<string>",
"rule": "<string>",
"reason": "<string>",
"severity": "low"
}
],
"warnings": [
{
"tool": "<string>",
"message": "<string>"
}
],
"card_gaps": [
{
"capability": "<string>",
"missing_card_field": "<string>",
"suggestion": "<string>"
}
],
"coverage": 0.5
},
"traces_evaluated": 123,
"time_range": {
"from": "2023-11-07T05:31:56Z",
"to": "2023-11-07T05:31:56Z"
}
}Evaluate a CLPI policy against historical AIP traces for an agent. Replays past tool invocations through the policy to identify what would have been blocked, escalated, or flagged. Useful for understanding the impact of a policy change before rolling it out.
curl --request POST \
--url https://api.mnemom.ai/v1/policies/evaluate/historical \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"policy": {
"meta": {
"schema_version": "<string>",
"name": "<string>",
"description": "<string>",
"scope": "agent"
},
"capability_mappings": {},
"forbidden": [
{
"pattern": "<string>",
"reason": "<string>",
"severity": "high"
}
],
"escalation_triggers": [
{
"condition": "<string>",
"action": "notify",
"reason": "<string>"
}
],
"defaults": {
"unmapped_tool_action": "warn",
"unmapped_severity": "medium",
"fail_open": false,
"enforcement_mode": "observe",
"grace_period_hours": 0
}
},
"agent_id": "<string>",
"from": "2023-11-07T05:31:56Z",
"to": "2023-11-07T05:31:56Z",
"limit": 100
}
'{
"evaluation": {
"verdict": "pass",
"violations": [
{
"type": "forbidden",
"tool": "<string>",
"capability": "<string>",
"rule": "<string>",
"reason": "<string>",
"severity": "low"
}
],
"warnings": [
{
"tool": "<string>",
"message": "<string>"
}
],
"card_gaps": [
{
"capability": "<string>",
"missing_card_field": "<string>",
"suggestion": "<string>"
}
],
"coverage": 0.5
},
"traces_evaluated": 123,
"time_range": {
"from": "2023-11-07T05:31:56Z",
"to": "2023-11-07T05:31:56Z"
}
}Supabase JWT token in Authorization: Bearer header
A complete CLPI policy document defining capability mappings, forbidden tools, escalation triggers, and enforcement defaults.
Show child attributes
Agent whose historical traces will be evaluated
Start of time range for historical traces
End of time range for historical traces
Maximum number of traces to evaluate