Poke & Wiggle

Poke & Wiggle is launching Reality Check, a public leaderboard and benchmark that measures how well robot manipulation policies actually perform when tested on physical hardware. The first release, PAW-GEN-10, puts four open robot policies through ten real-world environments with 3,600 reproducible rollouts per policy, totaling 14,400 rollouts , and studies three axes of generalization: task-specific data regimes, spatial generalization to unseen object placements, and embodiment-specific pre or mid-training . The environments cover bimanual skills spanning basic manipulation like sorting and pouring screws, tool use, high-precision tasks such as connecting a DC jack and routing cable through hoops, and coordinated two-arm work . The launch matters because much of the public discourse around physical AI still relies on cherry-picked demo videos rather than statistically meaningful evaluation. Poke & Wiggle argues that rollouts should be treated as measurements, which means running many of them and keeping conditions repeatable so nothing changes between runs except the policy under test . To support that, the team operates the largest independent Franka FR3 Duo farm, helping groups building frontier world models and robot foundation models evaluate them in the real world, uncover failure modes, and close the loop with high-quality data , with the physical operations housed inside Munich's Deutsches Museum. The company was founded in 2025 by CEO Nicolas Keller and CTO José Ramón Medina Hernández, with offices in San Francisco, London, and Munich. Reality Check is aimed at robotics research groups, foundation model teams, and industrial buyers who need evidence-backed comparisons before committing to a policy or a deployment, and Poke & Wiggle plans to keep publishing rollouts and expanding the leaderboard as new models are added.