BitssyBytes logoAgent Safety Score

Directory / Pydantic AI

B

Pydantic AI

Agent framework · Pydantic · 5/7 verified · Last checked 2026-10-16

requires_approval and ApprovalRequired pause tool calls for a human. Toolsets can filter which tools are visible each step. Commands can run in Modal or E2B sandboxes.

Overall: B (2.00 avg, 5/7 controls verified)

Lock this down first

Mark write tools requires_approval=True and run the coding harness in an E2B or Modal sandbox.

Scorecard

CriterionRatingNotes
Permission granularity2/3FilteredToolset decides per step which tools are available, based on run context.
Human approval gates2/3requires_approval=True or raising ApprovalRequired defers the call; you approve or deny it before the run resumes. Nothing admin-lockable.
Sandboxing2/3Off by default. Opt-in Modal and E2B sandboxes run commands and file edits off your machine.
Secrets handlingUnverifiedNot confirmed in the docs we checked.
Audit logs2/3Logfire / OpenTelemetry instrumentation emits spans for each model request and tool call.
Kill switch / interrupt2/3A CancellationToken cancels a run in flight and raises RunCancelled with the history so far.
Network egress controlUnverifiedNot confirmed in the docs we checked.

Unverified: Secrets handling, Network egress control. That means we could not confirm it in public docs, not that it is missing.

Sources

Vendor? Request a correction. We review corrections within 7 days.