[Stack 5/17] Per-discrepancy test infrastructure

[jucor]

Summary

Per-discrepancy test infrastructure for TDD fixing of Python-Clojure differences.

Changes

• Add per-discrepancy test markers and parametrized test infrastructure
• Cold-start recorder: coordinate parallel runs with marker file, auto-pause math workers
• Update journal with xpassed test breakdown across all datasets
• Address Copilot review: remove unused import, fix script issues
• Add naming convention documentation

Test plan

• 223 passed, 4 skipped, 22 xfailed, 7 xpassed, 0 failures
  🤖 Generated with Claude Code

Squashed commits

• Address Copilot review feedback and fix pre-existing test failures
• Add per-discrepancy test infrastructure and fix journal
• Fix cold-start recorder: auto-pause math workers and clean up containers
• Cold-start recorder: coordinate parallel runs with marker file
• Address Copilot review: remove unused import, fix script issues
• Update journal: xpassed test breakdown with all 7 datasets
• Add naming convention
• Test both incremental and cold-start Clojure blobs
• Add repness blob comparison tests and fix tid type mismatches
• Address Copilot review on PR [Stack 9/27] Per-discrepancy test infrastructure #2420: fix stale references and clean up imports

commit-id:bdc830db

---

Stack:

• [Stack 17/17] Fix K-means k divergence: preserve vote-encounter row order #2524
• [Stack 16/17] Fix D15: match Clojure moderation handling (zero out columns, don't remove) #2523
• [Stack 15/17] Fix D8: match Clojure repful classification (rat > rdt) #2522
• [Stack 14/17] Fix D7: match Clojure repness metric formula (product of 4 signed values) #2521
• [Stack 13/17] Fix D6: match Clojure two-proportion test formula (+1 pseudocount) #2520
• [Stack 12/17] Fix D5: match Clojure prop_test formula (Wilson-score-like with +1 pseudocount) #2519
• [Stack 11/17] Fix D9: z-score thresholds from two-tailed to one-tailed #2518
• [Stack 10/17] Fix test DB connection: use DATABASE_URL with dotenv #2517
• [Stack 9/17] Vectorize participant info computation (3-15x speedup) #2516
• [Stack 8/17] Speed up regression tests #2515
• [Stack 7/17] Fix D4: pseudocount formula #2514
• [Stack 6/17] Fix D2: in-conv participant threshold + D2c vote count source #2513
• [Stack 5/17] Per-discrepancy test infrastructure #2512 ⬅
• [Stack 4/17] Deep analysis of Python-Clojure discrepancies and fix plan #2511
• [Stack 3/17] Speed up CI: replace pip with uv pip in Dockerfile (~2x faster installs) #2510
• [Stack 2/17] Add SKIP_GOLDEN env var to disable golden snapshot tests #2509
• [Stack 1/17] CI: add concurrency group to E2E workflow; run CI on spr/ branches #2508

---

⚠️ Part of a stack created by spr. Do not merge manually using the UI - doing so may have unexpected results.

[github-actions]

Delphi Coverage Report

File	Stmts	Miss	Cover
init.py	2	0	100%
benchmarks/bench_pca.py	76	76	0%
benchmarks/bench_repness.py	81	81	0%
benchmarks/bench_update_votes.py	38	38	0%
benchmarks/benchmark_utils.py	34	34	0%
components/init.py	1	0	100%
components/config.py	165	133	19%
conversation/init.py	2	0	100%
conversation/conversation.py	1118	336	70%
conversation/manager.py	131	42	68%
database/init.py	1	0	100%
database/dynamodb.py	387	233	40%
database/postgres.py	305	205	33%
pca_kmeans_rep/init.py	5	0	100%
pca_kmeans_rep/clusters.py	257	22	91%
pca_kmeans_rep/corr.py	98	17	83%
pca_kmeans_rep/pca.py	52	16	69%
pca_kmeans_rep/repness.py	361	48	87%
pca_kmeans_rep/stats.py	107	22	79%
regression/init.py	4	0	100%
regression/clojure_comparer.py	188	17	91%
regression/comparer.py	887	720	19%
regression/datasets.py	135	27	80%
regression/recorder.py	36	27	25%
regression/utils.py	137	118	14%
run_math_pipeline.py	260	114	56%
umap_narrative/500_generate_embedding_umap_cluster.py	210	109	48%
umap_narrative/501_calculate_comment_extremity.py	112	54	52%
umap_narrative/502_calculate_priorities.py	135	135	0%
umap_narrative/700_datamapplot_for_layer.py	502	502	0%
umap_narrative/701_static_datamapplot_for_layer.py	310	310	0%
umap_narrative/702_consensus_divisive_datamapplot.py	432	432	0%
umap_narrative/801_narrative_report_batch.py	785	785	0%
umap_narrative/802_process_batch_results.py	265	265	0%
umap_narrative/803_check_batch_status.py	175	175	0%
umap_narrative/llm_factory_constructor/init.py	2	2	0%
umap_narrative/llm_factory_constructor/model_provider.py	157	157	0%
umap_narrative/polismath_commentgraph/init.py	1	0	100%
umap_narrative/polismath_commentgraph/cli.py	270	270	0%
umap_narrative/polismath_commentgraph/core/init.py	3	3	0%
umap_narrative/polismath_commentgraph/core/clustering.py	108	108	0%
umap_narrative/polismath_commentgraph/core/embedding.py	104	104	0%
umap_narrative/polismath_commentgraph/lambda_handler.py	219	219	0%
umap_narrative/polismath_commentgraph/schemas/init.py	2	0	100%
umap_narrative/polismath_commentgraph/schemas/dynamo_models.py	160	9	94%
umap_narrative/polismath_commentgraph/tests/conftest.py	17	17	0%
umap_narrative/polismath_commentgraph/tests/test_clustering.py	74	74	0%
umap_narrative/polismath_commentgraph/tests/test_embedding.py	55	55	0%
umap_narrative/polismath_commentgraph/tests/test_storage.py	87	87	0%
umap_narrative/polismath_commentgraph/utils/init.py	3	0	100%
umap_narrative/polismath_commentgraph/utils/converter.py	283	237	16%
umap_narrative/polismath_commentgraph/utils/group_data.py	354	336	5%
umap_narrative/polismath_commentgraph/utils/storage.py	584	477	18%
umap_narrative/reset_conversation.py	159	50	69%
umap_narrative/run_pipeline.py	453	312	31%
utils/general.py	62	41	34%
Total	10951	7651	30%