apo
Demo · read-only
Sign in
Agent Testing
Tasks
Runs
Schedules
Observability
Traces
Toggle Sidebar
demo
Runs
Runs
demo-bch
real-agent/security/security-audit
demo-run_4
Failed
real-agent/security/security-audit
·
anthropic/claude-haiku-4-5
·
cli
·
8w ago
Details
▸
Task
Run
Trace home
Delete
43%
pass rate
3
passed
·
4
failed
·
7
checks
28.4s
duration
$0.0462
28.4k tok
—
reasoning
⚑ model drift — 6/7 gens
▸
run notices
Checks
7
Conversation History
Deliverables
Trace home
3
/7 passed
4 failed
Click to expand
✗
audited-both-files
expected exactly 2 "read_file" calls, got 3
✓
found-injection-vulnerabilities
✗
found-secrets-and-crypto-vulns
expected expected finding: hardcoded ADMIN_EMAIL findings include hardcoded ADMIN_EMAIL; expected expected finding: weak MD5 hashing findings include weak MD5 hashing
✓
caught-majority-of-vulns
✗
audit-is-comprehensive
Analyzing the provided audit values against the instruction requirements:
✗
findings-have-severity-and-location
Evaluating whether each security finding includes: (1) specific file name, (2) function name, (3) vulnerability type, and (4) severity level with justification. Analysis of all 29 values:
✓
source-files-present