Runs
Each run is one pass of the questions over the pages. Pick two to see what changed.
| Run | Date | Question set | Model | Pages | Cost | Took |
|---|---|---|---|---|---|---|
| 2026-09-28-original | 2026-09-28 | 33a4c412 | jev-latest | 110 | $0.0000 | 0 s |
| 2026-09-29-rerun | 2026-09-29 | 33a4c412 | jev-latest | 36 | $0.8774 | 20 s |
| 2026-10-01-new120 | 2026-10-01 | 33a4c412 | jev-1.13.0 | 538 | $0.1693 | 59 s |
| 2026-10-02-baseline | 2026-10-02 | 33a4c412 | jev-1.13.0 | 110 | $0.0383 | 23 s |
| 2026-10-02-date-code-picks | 2026-10-02 | 225a8e98 | jev-1.13.0 | 110 | $0.0347 | 22 s |
| 2026-10-02-date-each | 2026-10-02 | 14a42b39 | jev-1.13.0 | 110 | $0.0389 | 23 s |
| 2026-10-02-date-fix | 2026-10-02 | 33a4c412 | jev-1.13.0 | 110 | $0.0348 | 23 s |
| 2026-10-02-desc | 2026-10-02 | 0b5c9783 | jev-1.13.0 | 110 | $0.0436 | 23 s |
| 2026-10-02-desc-clean | 2026-10-02 | 0b5c9783 | jev-1.13.0 | 110 | $0.0321 | 21 s |
| 2026-10-02-desc-final | 2026-10-02 | 0b5c9783 | jev-1.13.0 | 110 | $0.0027 | 17 s |
| 2026-10-02-on-sale | 2026-10-02 | d8cc7e5a | jev-1.13.0 | 110 | $0.0384 | 23 s |
| 2026-10-02-structured | 2026-10-02 | 0b5c9783 | jev-1.13.0 | 110 | $0.0000 | 17 s |
| 2026-10-02-tags | 2026-10-02 | 0b5c9783 | jev-1.13.0 | 110 | $0.0405 | 22 s |
| 2026-10-02-venue-clean | 2026-10-02 | 225a8e98 | jev-1.13.0 | 110 | $0.0265 | 21 s |
| 2026-10-02-venue-fix | 2026-10-02 | 33a4c412 | jev-1.13.0 | 110 | $0.0404 | 24 s |
| 2026-10-02-venue-phrases | 2026-10-02 | 225a8e98 | jev-1.13.0 | 110 | $0.0061 | 18 s |
| 2026-10-02-venue-phrases2 | 2026-10-02 | 225a8e98 | jev-1.13.0 | 110 | $0.0018 | 17 s |
| 2026-10-03-review-fixes | 2026-10-02 | 0b5c9783 | jev-1.13.0 | 110 | $0.0010 | 17 s |
| 2026-10-03-site-venue | 2026-10-02 | 0b5c9783 | jev-1.13.0 | 110 | $0.0339 | 21 s |
| 2026-10-03-venue-confirm | 2026-10-02 | 3654ee6b | jev-1.13.0 | 110 | $0.0012 | 18 s |
| 2026-10-04-heldout-sample | 2026-10-04 | 3654ee6b | jev-1.13.0 | 200 | $0.0854 | 37 s |
| 2026-10-04-heldout-title | 2026-10-04 | 1ff8fff0 | jev-1.13.0 | 200 | $0.0031 | 19 s |
| 2026-10-04-tune100-before | 2026-10-04 | 3654ee6b | jev-1.13.0 | 100 | $0.0416 | 11 s |
| 2026-10-04-tune100-title | 2026-10-04 | 1ff8fff0 | jev-1.13.0 | 100 | $0.0014 | 2 s |
| 2026-10-05-area-kind-title | 2026-10-05 | c4a3f8ac | jev-1.13.0 | 110 | $0.0447 | 24 s |
| 2026-10-05-card-facts | 2026-10-05 | f06bacc4 | jev-1.13.0 | 110 | $0.0126 | 18 s |
| 2026-10-05-card-facts2 | 2026-10-05 | f06bacc4 | jev-1.13.0 | 110 | $0.0011 | 17 s |
| 2026-10-05-card-facts3 | 2026-10-05 | dcde50d0 | jev-1.13.0 | 110 | $0.0451 | 23 s |
| 2026-10-05-dates-app | 2026-10-05 | 36b3d47f | jev-1.13.0 | 110 | $0.0358 | 22 s |
| 2026-10-05-dates-dry150 | 2026-10-05 | 36b3d47f | jev-1.13.0 | 150 | $0.0488 | 25 s |
| 2026-10-05-dates-heldout | 2026-10-05 | 36b3d47f | jev-1.13.0 | 200 | $0.0557 | 26 s |
| 2026-10-05-dates-one | 2026-10-05 | 36b3d47f | jev-1.13.0 | 1 | $0.0004 | 1 s |
| 2026-10-05-dates-tune100 | 2026-10-05 | 36b3d47f | jev-1.13.0 | 100 | $0.0291 | 7 s |
| 2026-10-05-dates2-app | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 110 | $0.0392 | 23 s |
| 2026-10-05-dates2-dry150 | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 150 | $0.0526 | 26 s |
| 2026-10-05-dates2-heldout | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 200 | $0.0689 | 29 s |
| 2026-10-05-dates2-one | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 3 | $0.0011 | 1 s |
| 2026-10-05-dates2-tune100 | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 100 | $0.0346 | 9 s |
| 2026-10-05-dates3-app | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 110 | $0.0000 | 17 s |
| 2026-10-05-dates3-dry150 | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 150 | $0.0001 | 17 s |
| 2026-10-05-dates3-heldout | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 200 | $0.0000 | 17 s |
| 2026-10-05-dates3-tune100 | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 100 | $0.0000 | 1 s |
| 2026-10-05-dryrun-4073 | 2026-10-05 | dcde50d0 | jev-1.13.0 | 4070 | $1.7535 | 9 min |
| 2026-10-05-dryrun2 | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 4070 | $1.4246 | 8 min |
| 2026-10-05-heldout-facts | 2026-10-05 | f06bacc4 | jev-1.13.0 | 200 | $0.0182 | 20 s |
| 2026-10-05-heldout-facts2 | 2026-10-05 | f06bacc4 | jev-1.13.0 | 200 | $0.0027 | 18 s |
| 2026-10-05-heldout-v2 | 2026-10-05 | c4a3f8ac | jev-1.13.0 | 200 | $0.0797 | 30 s |
| 2026-10-05-heldout-v3 | 2026-10-05 | 29f96b9b | jev-1.13.0 | 200 | $0.0796 | 30 s |
| 2026-10-05-pairs-300 | 2026-10-05 | 8e9c9fa0 | jev-1.13.0 | 300 | $0.0816 | 45 s |
| 2026-10-05-pairs-four | 2026-10-05 | 8e9c9fa0 | jev-1.13.0 | 1 | $0.0000 | 0 s |
| 2026-10-05-pairs-one | 2026-10-05 | 8e9c9fa0 | jev-1.13.0 | 5 | $0.0012 | 1 s |
| 2026-10-05-pairs-sw | 2026-10-05 | 8e9c9fa0 | jev-1.13.0 | 1 | $0.0000 | 0 s |
| 2026-10-05-pairs-three | 2026-10-05 | 8e9c9fa0 | jev-1.13.0 | 1 | $0.0004 | 1 s |
| 2026-10-05-pairs-two | 2026-10-05 | 8e9c9fa0 | jev-1.13.0 | 5 | $0.0004 | 1 s |
| 2026-10-05-pairs2-300 | 2026-10-05 | 8e9c9fa0 | jev-1.13.0 | 300 | $0.0000 | 33 s |
| 2026-10-05-prune-app | 2026-10-05 | 406e7e35 | jev-1.13.0 | 110 | $0.0369 | 22 s |
| 2026-10-05-prune-dry150 | 2026-10-05 | 406e7e35 | jev-1.13.0 | 150 | $0.0501 | 26 s |
| 2026-10-05-prune-heldout | 2026-10-05 | 406e7e35 | jev-1.13.0 | 200 | $0.0661 | 29 s |
| 2026-10-05-prune-one | 2026-10-05 | 406e7e35 | jev-1.13.0 | 1 | $0.0003 | 1 s |
| 2026-10-05-prune-tune100 | 2026-10-05 | 406e7e35 | jev-1.13.0 | 100 | $0.0329 | 8 s |
| 2026-10-05-prune-weekly | 2026-10-05 | 406e7e35 | jev-1.13.0 | 2 | $0.0000 | 0 s |
| 2026-10-05-prune2-app | 2026-10-05 | 406e7e35 | jev-1.13.0 | 110 | $0.0000 | 17 s |
| 2026-10-05-prune2-dry150 | 2026-10-05 | 406e7e35 | jev-1.13.0 | 150 | $0.0000 | 17 s |
| 2026-10-05-prune2-heldout | 2026-10-05 | 406e7e35 | jev-1.13.0 | 200 | $0.0000 | 17 s |
| 2026-10-05-prune2-tune100 | 2026-10-05 | 406e7e35 | jev-1.13.0 | 100 | $0.0000 | 1 s |
| 2026-10-05-rule-dates | 2026-10-05 | c4a3f8ac | jev-1.13.0 | 110 | $0.0041 | 18 s |
| 2026-10-05-several-dates | 2026-10-05 | 29f96b9b | jev-1.13.0 | 110 | $0.0451 | 23 s |
| 2026-10-05-several-dates2 | 2026-10-05 | 29f96b9b | jev-1.13.0 | 110 | $0.0000 | 17 s |
| 2026-10-05-titles-one | 2026-10-05 | 0485a7a3 | jev-1.13.0 | 5 | $0.0019 | 1 s |
| 2026-10-05-tune100-facts | 2026-10-05 | f06bacc4 | jev-1.13.0 | 100 | $0.0061 | 2 s |
| 2026-10-05-tune100-rules | 2026-10-05 | c4a3f8ac | jev-1.13.0 | 100 | $0.0025 | 1 s |
| 2026-10-05-tune100-shape | 2026-10-05 | 29f96b9b | jev-1.13.0 | 100 | $0.0402 | 10 s |
| 2026-10-05-tune100-v2 | 2026-10-05 | c4a3f8ac | jev-1.13.0 | 100 | $0.0398 | 10 s |
| 2026-10-05-venue-app | 2026-10-05 | 406e7e35 | jev-1.13.0 | 110 | $0.0322 | 22 s |
| 2026-10-05-venue-dry150 | 2026-10-05 | 406e7e35 | jev-1.13.0 | 150 | $0.0433 | 25 s |
| 2026-10-05-venue-heldout | 2026-10-05 | 406e7e35 | jev-1.13.0 | 200 | $0.0542 | 27 s |
| 2026-10-05-venue-ocis | 2026-10-05 | 406e7e35 | jev-1.13.0 | 2 | $0.0005 | 1 s |
| 2026-10-05-venue-one | 2026-10-05 | 406e7e35 | jev-1.13.0 | 1 | $0.0004 | 1 s |
| 2026-10-05-venue-tune100 | 2026-10-05 | 406e7e35 | jev-1.13.0 | 100 | $0.0282 | 7 s |
| 2026-10-05-venue2-app | 2026-10-05 | 406e7e35 | jev-1.13.0 | 110 | $0.0081 | 19 s |
| 2026-10-05-venue2-dry150 | 2026-10-05 | 406e7e35 | jev-1.13.0 | 150 | $0.0140 | 20 s |
| 2026-10-05-venue2-heldout | 2026-10-05 | 406e7e35 | jev-1.13.0 | 200 | $0.0122 | 19 s |
| 2026-10-05-venue2-tune100 | 2026-10-05 | 406e7e35 | jev-1.13.0 | 100 | $0.0067 | 3 s |
| 2026-10-05-venue3-app | 2026-10-05 | 406e7e35 | jev-1.13.0 | 110 | $0.0000 | 17 s |
| 2026-10-07-dbg | 2026-10-07 | 7535be7e | jev-1.13.0 | 0 | $0.0000 | 1 s |
| 2026-10-07-key-baseline | 2026-10-07 | 8e9c9fa0 | jev-1.13.0 | 150 | $0.0340 | 17 s |
| 2026-10-07-key-listing | 2026-10-07 | 7535be7e | jev-1.13.0 | 0 | $0.0000 | 18 s |
| 2026-10-07-key-listing2 | 2026-10-07 | 7535be7e | jev-1.13.0 | 150 | $0.0558 | 20 s |
| 2026-10-07-key-start | 2026-10-07 | 8ded3eca | jev-1.13.0 | 150 | $0.0544 | 20 s |
| 2026-10-08-audit-conflict-k2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0024 | 21 s |
| 2026-10-08-audit-conflict-k3 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0005 | 14 s |
| 2026-10-08-audit-fill-k2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0000 | 20 s |
| 2026-10-08-audit-fill-k3 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0000 | 14 s |
| 2026-10-08-audit-lean-k2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0000 | 21 s |
| 2026-10-08-audit-lean-k3 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0000 | 14 s |
| 2026-10-08-audit-none-k2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0000 | 20 s |
| 2026-10-08-audit-none-k3 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0000 | 14 s |
| 2026-10-08-audit-onetime-k2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0000 | 21 s |
| 2026-10-08-audit-onetime-k3 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0000 | 14 s |
| 2026-10-08-audit-pairs-k2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0003 | 21 s |
| 2026-10-08-audit-pairs-k3 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0001 | 14 s |
| 2026-10-08-audit-sessions-k2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0000 | 21 s |
| 2026-10-08-audit-sessions-k3 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0001 | 14 s |
| 2026-10-08-audit-siblings-k2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0001 | 21 s |
| 2026-10-08-audit-siblings-k3 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0000 | 14 s |
| 2026-10-08-final-app | 2026-10-08 | 7535be7e | jev-1.13.0 | 110 | $0.0421 | 23 s |
| 2026-10-08-final-review | 2026-10-08 | 7535be7e | jev-1.13.0 | 700 | $0.1140 | 1 min |
| 2026-10-08-fresh100 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0339 | 20 s |
| 2026-10-08-fresh100-fill | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0000 | 14 s |
| 2026-10-08-fresh100-strip | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0316 | 41 s |
| 2026-10-08-fresh100-strip2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 100 | $0.0304 | 13 s |
| 2026-10-08-key300 | 2026-10-07 | 7535be7e | jev-1.13.0 | 300 | $0.0576 | 29 s |
| 2026-10-08-key300-fill | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0000 | 21 s |
| 2026-10-08-key300-lean | 2026-10-07 | 7535be7e | jev-1.13.0 | 300 | $0.0000 | 21 s |
| 2026-10-08-key300-strip | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.1007 | 2 min |
| 2026-10-08-key300-strip2 | 2026-10-08 | 7535be7e | jev-1.13.0 | 300 | $0.0921 | 35 s |
| 2026-10-10-refetch | 2026-10-11 | cf90bfbd | jev-1.13.0 | 12309 | $4.7956 | 49 min |
| 2026-10-15-all | 2026-10-15 | 7535be7e | jev-1.13.0 | 5018 | $1.3321 | 10 min |
| 2026-10-15-new121 | 2026-10-15 | 7535be7e | jev-1.13.0 | 538 | $0.1878 | 54 s |
| 2026-10-15-new121-test1 | 2026-10-15 | 7535be7e | jev-1.13.0 | 1 | $0.0004 | 1 s |
| 2026-10-16-bf-all | 2026-10-16 | c4d406be | jev-1.13.0 | 5018 | $2.2513 | 12 min |
| 2026-10-16-bf-new121 | 2026-10-16 | c4d406be | jev-1.13.0 | 538 | $0.2537 | 54 s |
| 2026-10-16-bf-test1 | 2026-10-16 | c4d406be | jev-1.13.0 | 1 | $0.0005 | 1 s |
| 2026-10-16-flat-100 | 2026-10-16 | ae4ca9e4 | jev-1.13.0 | 100 | $0.0550 | 11 s |