Puzzle swarm benchmark

Judge-verified results from the Siva Goldbug and Minerva Lux solving runs.

Snapshot captured Aug 24, 2026, 7:06 PM PDT. Running figures continue changing.

Overview

Judge records are authoritative

Two early Goldbug solutions used published answers. Several process summaries contradict accepted judge results, so every outcome below follows the persisted judge ledger.

Goldbug clean solves
4 / 9
2 contaminated · 3 unsolved
Minerva Lux
10 / 15
Original swarm finished
Focused swarms
2
Puzzles 4 and 5 · xhigh
Observed tokens
≥ 42.84B
Some early tracking incomplete

The four Goldbug challenges were tested under open-web, leak-blocked, and hint-blocked conditions. The separate Minerva Lux swarm used solstice-alpha with high reasoning across all 15 puzzles; dedicated follow-up swarms now use solstice-alpha with xhigh reasoning on the two unresolved targets.

Goldbug puzzle gallery

Actual challenge assets and the final integrity-aware result for each puzzle.

Dress puzzle source image: Lace strips, knots, colored beads, and an encoded dress message.

Dress 2 solved · 1 unsolved

Lace strips, knots, colored beads, and an encoded dress message. One contaminated solve; one clean official-hint solve; one failed hint-blind run.

Accepted answer: INCONSISTENTKNOTS

Cubes puzzle source image: Colored puzzle cubes whose hidden faces and perspective reveal letters.

Cubes 3 solved · 0 unsolved

Colored puzzle cubes whose hidden faces and perspective reveal letters. Three clean solves. Every successful route eventually used an official clue.

Accepted answer: LACKOFDUST

Ducks puzzle source image: Seven duck drawings with embedded cryptographic or steganographic details.

Ducks 1 contaminated · 1 unsolved

Seven duck drawings with embedded cryptographic or steganographic details. The open-web solve copied a leaked answer; the restricted run failed after 102 guesses.

Accepted answer: INKWASSTILLWET

Spooky puzzle source image: The original interactive Spooky Manor cryptography challenge.

Spooky 0 solved · 1 unsolved

The original interactive Spooky Manor cryptography challenge. No successful solve; the agent submitted one incorrect answer.

Result: Never solved.

Verified Goldbug run timeline

Black denotes a clean accepted solution, amber denotes an accepted but contaminated solution, and gray denotes an unsolved run.

Goldbug puzzle runs by elapsed time and verified outcomeNine runs spanning Aug 22, 2:44 AM through Aug 22, 8:07 PM Pacific time.Aug 22, 2:44 AMAug 22, 7:05 AMAug 22, 11:26 AMAug 22, 3:46 PMAug 22, 8:07 PMDucks Open webDucks, Open web: Solved, 2h 56m2h 56mDress Open webDress, Open web: Solved, 6h 11m6h 11mCubes Open webCubes, Open web: Solved, 2h 02m2h 02mSpooky Open webSpooky, Open web: Unsolved, 31m31mDucks Blocked leaksDucks, Blocked leaks: Unsolved, 6h 07m6h 07mDress Blocked leaksDress, Blocked leaks: Solved, 1h 19m1h 19mCubes Blocked leaksCubes, Blocked leaks: Solved, 2h 33m2h 33mCubes Hints blockedCubes, Hints blocked: Solved, 5h 25m5h 25mDress Hints blockedDress, Hints blocked: Unsolved, 4h 19m4h 19m

All run results

Nine Goldbug benchmarks, one complete Minerva Lux suite, and two dedicated Minerva Lux follow-ups
RunJudge resultHintsIntegrityDurationTokensGuesses
Ducks
Open web
SolvedNoneLeaked answer2h 56m115.8M†20
Dress
Open web
SolvedOfficial clueLeaked answer6h 11m12.6M†30
Cubes
Open web
SolvedOfficial clueNo leak found2h 02m67.7M†5
Spooky
Open web
UnsolvedNoneNo leak found31m9.13M†1
Ducks
Blocked leaks
UnsolvedPublic cluesNo leak found6h 07m146.9M‡102
Dress
Blocked leaks
SolvedOfficial clueNo leak found1h 19m7.98M†2
Cubes
Blocked leaks
SolvedOfficial clueNo leak found2h 33m7
Cubes
Hints blocked
SolvedInjected laterNo leak found5h 25m2.45B‡6
Dress
Hints blocked
UnsolvedInjected, unusedNo leak found4h 19m1.69B‡20
Minerva Lux
15-puzzle swarm
10/15 solvedUnrestrictedNo leak audit28h 18m36.86B191
Puzzle 4
Focused continuation
RunningPrior researchUnrestricted web38m733.1M32
Puzzle 5
Focused continuation
RunningPrior researchUnrestricted web38m750.4M83

† Main-agent tokens only. ‡ Partial swarm accounting. — No token counter survived. Focused-run durations describe the current xhigh continuation; their token totals include earlier activity.

Minerva Lux puzzle outcomes

Every row shows the actual source artwork, judge-verified answer when solved, required answer length, and submission count from the completed 15-puzzle swarm.

Private completed Minerva Lux monitor showing 10 of 15 puzzles solved, 191 attempts, and full token accounting
Completed full-suite monitor captured without exposing its private address.
10 solved; 5 unsolved; 191 total attempts in the original swarm
ArtworkPuzzleJudge resultAccepted answerAttempts
Full original artwork for Minerva Lux puzzle 1Puzzle 1
24 characters
Solvedcontrol alternate delete2
Full original artwork for Minerva Lux puzzle 2Puzzle 2
9 characters
Solved1465112083
Full original artwork for Minerva Lux puzzle 3Puzzle 3
9 characters
Solved2327925607
Full original artwork for Minerva Lux puzzle 4Puzzle 4
9 characters
Unsolved
Focused run active
34
Full original artwork for Minerva Lux puzzle 5Puzzle 5
15 characters
Unsolved
Focused run active
53
Full original artwork for Minerva Lux puzzle 6Puzzle 6
52 characters
Solvedthe soul becomes dyed with the color of its thoughts2
Full original artwork for Minerva Lux puzzle 7Puzzle 7
31 characters
Unsolved4
Full original artwork for Minerva Lux puzzle 8Puzzle 8
48 characters
Solvedlet the flood come and wash away the work of man2
Full original artwork for Minerva Lux puzzle 9Puzzle 9
11 characters
Unsolved40
Full original artwork for Minerva Lux puzzle 10Puzzle 10
11 characters
Solvedoppositorum3
Full original artwork for Minerva Lux puzzle 11Puzzle 11
14 characters
Solveda digital rain3
Full original artwork for Minerva Lux puzzle 12Puzzle 12
19 characters
Solvedfind form from flux3
Full original artwork for Minerva Lux puzzle 13Puzzle 13
22 characters
Solvedwalk like an eggyptian4
Full original artwork for Minerva Lux puzzle 14Puzzle 14
28 characters
Solveda water drop hollows a stone1
Full original artwork for Minerva Lux puzzle 15Puzzle 15
20 characters
Unsolved30

View the official Minerva Lux challenge

Dedicated Puzzle 4 and Puzzle 5 investigations

Each continuation has its own isolated solving container, judge, audit trail, token counter, and optional agent swarm. Dashboard snapshots are embedded instead of linking to private infrastructure.

Puzzle 4 Running

Original image for the focused Minerva Lux puzzle 4 investigation
Configuration
solstice-alpha · xhigh reasoning
Fresh attempts
32 new · 33 inherited rejections
Observed tokens
733,135,399 across 258 sessions
Latest candidate
327502036 · incorrect
Current segment
38m since the xhigh restart; cumulative token totals include the earlier paused segment.
Private Puzzle 4 monitoring dashboard showing live status, attempts, token usage, and recent agent activity
Private monitor captured at publication time; no internal endpoint is exposed.

Puzzle 5 Running

Original image for the focused Minerva Lux puzzle 5 investigation
Configuration
solstice-alpha · xhigh reasoning
Fresh attempts
83 new · 61 inherited rejections
Observed tokens
750,388,103 across 311 sessions
Latest candidate
MICRO CASSETTES · incorrect
Current segment
38m since the xhigh restart; cumulative token totals include the earlier paused segment.
Private Puzzle 5 monitoring dashboard showing live status, attempts, token usage, and recent agent activity
Private monitor captured at publication time; no internal endpoint is exposed.

Integrity and methodology

  • Ducks · Open web: Fetched the winning team’s Substack, downloaded their YouTube video, and read the accepted answer from an on-screen spreadsheet.
  • Dress · Open web: Fetched the user’s published Substack article and located the winning team’s published dress-reference tool before submitting.
  • Cubes · Open web: Used the allowed organizer perspective clue and derived letters from solved cube fronts and undersides.
  • Spooky · Open web: Completed without solving; only one rejected answer.
  • Ducks · Blocked leaks: No forbidden source observed. Submitted 102 candidates and stopped without solving.
  • Dress · Blocked leaks: Used the allowed organizer clue about U-110 and June 1941, reconstructed the dress cipher, and solved on the second submission.
  • Cubes · Blocked leaks: Used allowed organizer clues and correctly decoded LACK / OF / DUST. The process reported failure after the judge had accepted the answer.
  • Cubes · Hints blocked: Initially hint-blind. Official clues were injected at 01:54 UTC; the resumed swarm solved at 03:07 UTC. Its saved result incorrectly remains unsolved.
  • Dress · Hints blocked: Hint-blind for most of the run. A hint file arrived seven minutes before failure, with no evidence that the solver read it.
  • Minerva Lux · 15-puzzle swarm: Original swarm completed with 10 judge-confirmed solutions. Its saved summary reported 10 and cannot be treated as authoritative.
  • Puzzle 4 · Focused continuation: Dedicated single-puzzle xhigh-reasoning swarm. Inherited 33 historical rejections and has made 32 new attempts.
  • Puzzle 5 · Focused continuation: Dedicated single-puzzle xhigh-reasoning swarm. Inherited 61 historical rejections and has made 83 new attempts.
Outcome source
Persisted local judge ledgers; accepted answers override stopped, failed, or stale process summaries.
Integrity findings
Two contaminated early solves: Ducks copied a published winning-team answer; Dress reached the user’s published solution materials.
Hint interpretation
Official organizer clues count as hints, not cheating. Injected clues are distinguished from clues never read.
Token accounting
At least 42,840,901,573 observed tokens; early main-only and partial counters mean the true total is higher.
Audit data
98.0 GB of persisted event logs across included runs, measured at capture time.
Excluded runs
Setup checks, dry runs, and abandoned pre-benchmark launches are not included.