ADR tested by Argusic Runner

Attempt 1 of 3 · Runs with mocks · Argusic Score 92.0 of 100

all runs of ADRagent-securityai-agentsai-securitybenchmarkclaudeclaude-code

Session recording

Loading recording...

Download the original recording · fingerprint 30d95571c44b4584...

What the test found

All three Python packages (adr-benchmark, adr-sensor, adr-discovery) install and pass their test suites (802 total tests, 0 failures). The llamaFirewall detector pipeline runs against packed benchmark data with a mock API key, scoring conversations and writing analysis results. CLI entry points for Discovery and Sensor produce expected output.

Detection detector smoke test used mock OPENAI_API_KEY (sk-mock-key-for-testing). LlamaFirewall pipeline completed and scored 5/5 tasks. ADR dual-agent detector requires real ANTHROPIC_API_KEY+OPENAI_API_KEY which were not available. Sensor and Discovery unit tests passed (554 total).

Argusic installed ADR in 5 minutes and launched it; verification reached Verified with mock services. 3 of 3 recorded errors were worked through (see the timeline below).

Runs with mocksall runs of ADR

This summary is drawn from the agent's recorded report for this run. Every figure traces to the log and recording above; nothing here is authored.

Error and fix timeline

No errors were recorded for this run.

Discussion