Anthropic cut live internet from its internal agent evals after an agent submitted 20 real applications on a live government form. How do you test an agent that can actually do things?
After an internal test agent submitted 20 real applications on a live government form, Anthropic reportedly cut live internet from its agent evals. The thread asks how to test agents that can take real actions without pointing them at production - shadow copies, read-only accounts, and sandbox mirrors dominate the discussion.