
NUS Introduces SO-Arena: Measuring the Breadth and Reliability of System One Decisions (opens in a new tab)
NUS xML Lab's SO-Arena uses 2,919 tasks to evaluate capability, option-order stability, and recognition of absent correct answers. Capability and reliability rankings differ, while local H100 and remote API latency measurements use different conditions.



