Items: haiku on dev

Prompt v1, 2026-10-22 04:01 UTC. Back to the scores

This run predates stored predictions, so only its labels are shown.

Showing 24 of 24 items

spec-01

Not judged

Expected

COMMITMENT

    Predicted

    Labels only: COMMITMENT

      spec-02

      Not judged

      Expected

      COMMITMENT

        Predicted

        Labels only: COMMITMENT

          spec-03

          Not judged

          Expected

          COMMITMENT

            Predicted

            Labels only: COMMITMENT

              spec-04

              Not judged

              Expected

              COMMITMENT

                Predicted

                Labels only: COMMITMENT

                  spec-05

                  Not judgedmulti turn

                  Expected

                  REQUEST, COMMITMENT

                    Predicted

                    Labels only: REQUEST, COMMITMENT

                      spec-06

                      Not judged

                      Expected

                      COMMITMENT, COMMITMENT

                        Predicted

                        Labels only: COMMITMENT, COMMITMENT

                          spec-07

                          Not judged

                          Expected

                          HEDGED

                            Predicted

                            Labels only: HEDGED

                              spec-08

                              Not judged

                              Expected

                              HEDGED

                                Predicted

                                Labels only: HEDGED

                                  spec-09

                                  Not judged

                                  Expected

                                  HEDGED

                                    Predicted

                                    Labels only: HEDGED

                                      spec-10

                                      Not judged

                                      Expected

                                      HEDGED

                                        Predicted

                                        Labels only: HEDGED

                                          spec-11

                                          Not judged

                                          Expected

                                          CONDITIONAL

                                            Predicted

                                            Labels only: CONDITIONAL

                                              spec-12

                                              Not judged

                                              Expected

                                              CONDITIONAL

                                                Predicted

                                                Labels only: CONDITIONAL

                                                  spec-13

                                                  Not judged

                                                  Expected

                                                  SUGGESTION

                                                    Predicted

                                                    Labels only: SUGGESTION

                                                      spec-14

                                                      Not judged

                                                      Expected

                                                      SUGGESTION

                                                        Predicted

                                                        Labels only: SUGGESTION

                                                          spec-15

                                                          Not judged

                                                          Expected

                                                          REQUEST

                                                            Predicted

                                                            Labels only: REQUEST

                                                              spec-16

                                                              Not judged

                                                              Expected

                                                              REQUEST

                                                                Predicted

                                                                Labels only: REQUEST

                                                                  spec-17

                                                                  Not judged

                                                                  Expected

                                                                  REPORTED

                                                                    Predicted

                                                                    Labels only: REPORTED

                                                                      spec-18

                                                                      Not judgedkeyword trap

                                                                      Expected

                                                                      REPORTED

                                                                        Predicted

                                                                        Labels only: REPORTED

                                                                          spec-19

                                                                          Not judgedkeyword trap

                                                                          Expected

                                                                          REFUSAL

                                                                            Predicted

                                                                            Labels only: REFUSAL

                                                                              spec-20

                                                                              Not judged

                                                                              Expected

                                                                              REFUSAL

                                                                                Predicted

                                                                                Labels only: REFUSAL

                                                                                  spec-21

                                                                                  Not judgedkeyword trap

                                                                                  Expected

                                                                                  NONE

                                                                                    Predicted

                                                                                    Labels only: NONE

                                                                                      spec-22

                                                                                      Not judgedambiguous

                                                                                      Expected

                                                                                      NONE

                                                                                        Predicted

                                                                                        Labels only: NONE

                                                                                          spec-23

                                                                                          Not judged

                                                                                          Expected

                                                                                          NONE

                                                                                            Predicted

                                                                                            Labels only: NONE

                                                                                              spec-24

                                                                                              Not judgedambiguous

                                                                                              Expected

                                                                                              NONE

                                                                                                Predicted

                                                                                                Labels only: NONE