Inspect the stored artifact, then independently label whether the frozen task should pass. The default policy balances domains and evaluator outcomes without revealing those outcomes during labeling.
Labels are stored locally with full artifact provenance and are automatically included by benchmark and calibration commands using this corpus. Queue sampling policy v1 caps each source run at 4 items.
0 qualifying case(s) · 0 excluded · policy v1
Find the page's primary call to action, activate it, and observe a meaningful response such as navigation, scrolling, a dialog, a new window, or changed visible content.
Evaluator observation and runtime evidence are hidden for independent labeling.
artifact 03bcd9e2c25d
Find the page's primary call to action, activate it, and observe a meaningful response such as navigation, scrolling, a dialog, a new window, or changed visible content.
Evaluator observation and runtime evidence are hidden for independent labeling.
artifact a096c202820d
Reach the primary call to action with keyboard focus, activate it with Enter, and observe a meaningful response without runtime errors.
Evaluator observation and runtime evidence are hidden for independent labeling.
artifact 03bcd9e2c25d
Reach the primary call to action with keyboard focus, activate it with Enter, and observe a meaningful response without runtime errors.
Evaluator observation and runtime evidence are hidden for independent labeling.
artifact a096c202820d