Stadium relaunch: full 127-page deep-dive report -- per-cell, per-ISA,

every factor interaction, and a raw-data appendix

Expanded the campaign-mechanism validation report from a condensed
6-page summary into the full depth Captain Bob asked for: analyze all 9
cells as a conglomerate Latin square, then dive into each cell's own
data, then cover every within-ISA and cross-factor interaction
explicitly rather than averaging it away.

Report structure (127 pages, compiled clean, no undefined references):
- Front matter: context, methodology, the SWAP-MTX bug narrative
  (console-interleaving fix + the Fisher-Yates correctness bug and its
  fix, both already committed separately)
- Layer 1: aggregate 3x3 Latin square (heatmap, invariant-metrics table)
- Per-Cell Deep Dive (9 sections): cfg-level distribution, summary
  table, and a rep-order execution-trajectory chart per cell -- the
  trajectory charts are what actually visualize the order-dependence
  finding rather than just stating it
- Per-ISA Deep Dive (3 sections): within-architecture seed comparison
  (violin plots, Kruskal-Wallis, per-factor main effects)
- Factor Interactions (6 sections, every pairwise combination of the 4
  L8 binary factors): both infer_dec_q and early_exit interaction plots
  faceted by architecture, plus the three-way
  factor x factor x architecture significance test
- Per-Factor Response (4 sections): linear response by architecture,
  with an explicit note that a true quadratic term isn't identifiable
  from this 2-level factorial design
- Appendix: full run_id-ordered raw data, all 4,320 rows across all 9
  cells, as the primary-source backing for every statistic above

Generated programmatically (analyse_stadium_relaunch_fixed.R for the
aggregate layer, generate_stadium_deepdive.R for the per-cell/per-ISA/
interaction/appendix layers) rather than hand-authored, since content at
this scale needs to be data-driven to stay honest.

Also includes analyse_stadium_relaunch.R, the earlier script built
against the pre-fix (buggy-shuffle) dataset -- superseded but kept for
the record, matching how the underlying data commits were handled.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
This commit is contained in:
Robert Allan James
2026-08-20 13:10:01 -04:00
co-authored by Claude Sonnet 5
parent dbe4b671a1
commit cf5b08fb65
140 changed files with 18891 additions and 0 deletions
@@ -0,0 +1,10 @@
"arch","seed","n_rows","n_cfg","n_run_id","mean_infer_dec_q","sd_infer_dec_q","early_exit_rate","l8_mode_const","win_div_const","fit_q_const"
"amd64","12345",480,16,480,56.8541666666667,29.2966182458014,0.9875,TRUE,TRUE,TRUE
"amd64","67890",480,16,480,28.0854166666667,38.3427977824838,0.989583333333333,TRUE,TRUE,TRUE
"amd64","13579",480,16,480,44.5,35.4835961394778,0.991666666666667,TRUE,TRUE,TRUE
"aarch64","12345",480,16,480,56.8541666666667,29.2966182458014,0.9875,TRUE,TRUE,TRUE
"aarch64","67890",480,16,480,28.0854166666667,38.3427977824838,0.989583333333333,TRUE,TRUE,TRUE
"aarch64","13579",480,16,480,44.5,35.4835961394778,0.991666666666667,TRUE,TRUE,TRUE
"riscv64","12345",480,16,480,56.8541666666667,29.2966182458014,0.9875,TRUE,TRUE,TRUE
"riscv64","67890",480,16,480,28.0854166666667,38.3427977824838,0.989583333333333,TRUE,TRUE,TRUE
"riscv64","13579",480,16,480,44.5,35.4835961394778,0.991666666666667,TRUE,TRUE,TRUE
1 arch seed n_rows n_cfg n_run_id mean_infer_dec_q sd_infer_dec_q early_exit_rate l8_mode_const win_div_const fit_q_const
2 amd64 12345 480 16 480 56.8541666666667 29.2966182458014 0.9875 TRUE TRUE TRUE
3 amd64 67890 480 16 480 28.0854166666667 38.3427977824838 0.989583333333333 TRUE TRUE TRUE
4 amd64 13579 480 16 480 44.5 35.4835961394778 0.991666666666667 TRUE TRUE TRUE
5 aarch64 12345 480 16 480 56.8541666666667 29.2966182458014 0.9875 TRUE TRUE TRUE
6 aarch64 67890 480 16 480 28.0854166666667 38.3427977824838 0.989583333333333 TRUE TRUE TRUE
7 aarch64 13579 480 16 480 44.5 35.4835961394778 0.991666666666667 TRUE TRUE TRUE
8 riscv64 12345 480 16 480 56.8541666666667 29.2966182458014 0.9875 TRUE TRUE TRUE
9 riscv64 67890 480 16 480 28.0854166666667 38.3427977824838 0.989583333333333 TRUE TRUE TRUE
10 riscv64 13579 480 16 480 44.5 35.4835961394778 0.991666666666667 TRUE TRUE TRUE