Fold in leios testnet bugfixes from 20260708 stuck sync incident - #2112
Draft
nfrisby wants to merge 5 commits into
Draft
Fold in leios testnet bugfixes from 20260708 stuck sync incident#2112nfrisby wants to merge 5 commits into
nfrisby wants to merge 5 commits into
IOG Hydra / ci/hydra-build:x86_64-darwin.native.haskell96.checks.ouroboros-consensus:test:consensus-test
timed out
Jul 9, 2026 in 1h 1m 45s
Build timed out
1 failed steps
Details
Failed Steps
Step 1
Derivation
/nix/store/9jrypcinyb4610qjfdhhzh3vkd4v5fm9-ouroboros-consensus-test-consensus-test-3.0.1.0-check.drv
Log
Running phase: unpackPhase
unpacking source archive /nix/store/mkj9c840klmi1kvw7v18gq68bk94whp4-source-test-consensus-test
source root is source-test-consensus-test
Running phase: patchPhase
Running phase: buildPhase
/nix/store/6bwxqydicw03qfxqsqnp5lb2qdkbdjqn-ouroboros-consensus-test-consensus-test-3.0.1.0/bin:
patching script interpreter paths in /nix/var/nix/builds/nix-71182-460352147/tmp.rzzDTEKAAV/bin
ouroboros-consensus
WallClock
delayNextSlot: OK (2.05s)
+++ OK, passed 10 tests.
delayClockShift: OK (1.59s)
+++ OK, passed 100 tests.
schedule goes back (100 in total):
86% True
14% False
schedule length (100 in total):
82% R_Gt 20
13% R_Btwn (10,20)
1% R_Eq 0
1% R_Eq 1
1% R_Eq 2
1% R_Eq 3
1% R_Eq 4
schedule skips (100 in total):
41% R_Btwn (10,20)
20% R_Gt 20
13% R_Btwn (5,10)
7% R_Btwn (4,5)
7% R_Eq 4
5% R_Eq 0
3% R_Eq 3
2% R_Eq 1
2% R_Eq 2
delayNoClockShift: OK (0.40s)
+++ OK, passed 1 test.
weighted Fait-Accompli committee selection tests
weighted Fait-Accompli committee selection model property tests
prop_stakeDistrDecreasingStakes: OK (1.12s)
+++ OK, passed 10000 tests.
prop_weightedFaitAccompliPersistentSeats_persistentSeatsRespectNumSeats: OK (3.17s)
+++ OK, passed 10000 tests.
Persistent to non-persistent seat ratio (10000 in total):
23.69% 90%-100%
15.83% 80%-90%
14.00% 50%-60%
13.53% 60%-70%
12.11% 70%-80%
7.31% 0%-10%
5.47% 40%-50%
4.64% 30%-40%
2.79% 20%-30%
0.63% 10%-20%
Stake distribution size (10000 in total):
10.00% 10-19
10.00% 20-29
10.00% 30-39
10.00% 40-49
10.00% 50-59
10.00% 60-69
10.00% 70-79
10.00% 80-89
10.00% 90-99
9.00% 0-9
1.00% 100-109
Target number of seats (10000 in total):
29.25% 0-9
19.99% 10-19
14.12% 20-29
10.46% 30-39
8.46% 40-49
6.26% 50-59
5.13% 60-69
3.47% 70-79
2.01% 80-89
0.82% 90-99
0.03% 100-109
prop_weightedFaitAccompliPersistentSeats_persistentSeatsHaveLargeStake: OK (3.31s)
+++ OK, passed 10000 tests; 2493 discarded.
More target seats than nodes (10000 in total):
100.00% False
Persistent to non-persistent seat ratio (10000 in total):
22.03% 90%-100%
17.09% 50%-60%
16.69% 80%-90%
15.22% 60%-70%
13.93% 70%-80%
6.25% 40%-50%
5.14% 30%-40%
2.97% 20%-30%
0.67% 10%-20%
0.01% 0%-10%
Stake distribution size (10000 in total):
10.00% 10-19
10.00% 20-29
10.00% 30-39
10.00% 40-49
10.00% 50-59
10.00% 60-69
10.00% 70-79
10.00% 80-89
10.00% 90-99
9.00% 0-9
1.00% 100-109
Target number of seats (10000 in total):
26.41% 0-9
21.73% 10-19
15.06% 20-29
11.28% 30-39
8.46% 40-49
6.78% 50-59
4.78% 60-69
2.90% 70-79
2.00% 80-89
0.59% 90-99
0.01% 100-109
prop_weightedFaitAccompliPersistentSeats_totalStakePreserved: OK (3.93s)
+++ OK, passed 10000 tests.
More target seats than nodes (10000 in total):
95.97% False
4.03% True
Persistent to non-persistent seat ratio (10000 in total):
22.90% 90%-100%
15.59% 80%-90%
13.70% 60%-70%
13.63% 50%-60%
12.44% 70%-80%
7.91% 0%-10%
5.64% 40%-50%
4.95% 30%-40%
2.73% 20%-30%
0.51% 10%-20%
Stake distribution size (10000 in total):
10.00% 10-19
10.00% 20-29
10.00% 30-39
10.00% 40-49
10.00% 50-59
10.00% 60-69
10.00% 70-79
10.00% 80-89
10.00% 90-99
9.00% 0-9
1.00% 100-109
Target number of seats (10000 in total):
29.73% 0-9
19.44% 10-19
14.74% 20-29
11.12% 30-39
8.19% 40-49
6.43% 50-59
4.58% 60-69
3.01% 70-79
1.93% 80-89
0.81% 90-99
0.02% 100-109
prop_weightedFaitAccompliPersistentSeats_nonPersistentSeatsCountCorrect: OK (2.85s)
+++ OK, passed 10000 tests.
More target seats than nodes (10000 in total):
95.65% False
4.35% True
Persistent to non-persistent seat ratio (10000 in total):
22.41% 90%-100%
15.83% 80%-90%
14.83% 50%-60%
14.05% 60%-70%
12.40% 70%-80%
7.04% 0%-10%
5.75% 40%-50%
4.55% 30%-40%
2.57% 20%-30%
0.57% 10%-20%
Stake distribution size (10000 in total):
10.00% 10-19
10.00% 20-29
10.00% 30-39
10.00% 40-49
10.00% 50-59
10.00% 60-69
10.00% 70-79
10.00% 80-89
10.00% 90-99
9.00% 0-9
1.00% 100-109
Target number of seats (10000 in total):
29.34% 0-9
19.59% 10-19
14.55% 20-29
10.67% 30-39
8.70% 40-49
6.55% 50-59
4.84% 60-69
3.10% 70-79
1.80% 80-89
0.86% 90-99
prop_weightedFaitAccompliPersistentSeats_residualSeatsDoNotQualify: OK (3.77s)
+++ OK, passed 10000 tests.
More target seats than nodes (10000 in total):
95.69% False
4.31% True
Persistent to non-persistent seat ratio (10000 in total):
22.69% 90%-100%
15.48% 80%-90%
14.41% 60%-70%
14.16% 50%-60%
11.91% 70%-80%
7.59% 0%-10%
5.85% 40%-50%
4.54% 30%-40%
2.67% 20%-30%
0.70% 10%-20%
Stake distribution size (10000 in total):
10.00% 10-19
10.00% 20-29
10.00% 30-39
10.00% 40-49
10.00% 50-59
10.00% 60-69
10.00% 70-79
10.00% 80-89
10.00% 90-99
9.00% 0-9
1.00% 100-109
Target number of seats (10000 in total):
29.78% 0-9
19.99% 10-19
14.27% 20-29
10.95% 30-39
8.27% 40-49
6.07% 50-59
4.82% 60-69
3.09% 70-79
1.89% 80-89
0.86% 90-99
0.01% 100-109
model conforms to Rust implementation: OK (10.38s)
+++ OK, passed 1000 tests.
HeaderValidation
validateIfCheckpoint
non-checkpoints are ignored: OK
+++ OK, passed 100 tests.
checkpoint matches should be accepted: OK
+++ OK, passed 100 tests.
checkpoint mismatches should be rejected: OK
+++ OK, passed 100 tests.
BlockFetchClient
blockFetch: OK (26.87s)
+++ OK, passed 100 tests.
Narrow CSJ
CaughtUp: OK (0.23s)
+++ OK, passed 100 tests.
ChainSyncClient
chainSync: OK (0.95s)
+++ OK, passed 100 tests:
90% NoMoreIntersection
10% ForkTooDeep
TickArrivalTimeStats (100 in total):
24% OnlyNotEarly_SomeEarly One Many
19% OnlyNotEarly_SomeEarly Many Zero
14% OnlyNotEarly_SomeEarly Zero Many
13% OnlyNotEarly_SomeEarly One Zero
11% OnlyNotEarly_SomeEarly One One
10% OnlyNotEarly_SomeEarly Zero Zero
6% OnlyNotEarly_SomeEarly Many One
3% OnlyNotEarly_SomeEarly Many Many
LocalStateQueryServer
localStateQueryServer: OK (1.00s)
+++ OK, passed 100 tests.
Acquired (7285 in total):
52.04% Success
39.44% AcquireFailurePointNotOnChain
8.52% AcquireFailurePointTooOld
Mempool
Mempool
TxSeq
lookupByTicketNo complete: OK (0.02s)
+++ OK, passed 100 tests.
lookupByTicketNo sound: OK (0.01s)
+++ OK, passed 100 tests:
64% successful miss
36% successful hit
splitAfterTxSize: OK
+++ OK, passed 100 tests.
splitAfterTxSizeSpec: OK
+++ OK, passed 100 tests.
IOSim properties
snapshotTxs == snapshotTxsAfter zeroTicketNo: OK (0.68s)
+++ OK, passed 100 tests:
98% non-empty Mempool
83% MempoolCapacityBytesOverride
17% NoMempoolCapacityBytesOverride
2% empty Mempool
valid added txs == getTxs: OK (2.73s)
+++ OK, passed 100 tests:
96% non-empty Mempool
92% MempoolCapacityBytesOverride
8% NoMempoolCapacityBytesOverride
4% empty Mempool
addTxs [..] == forM [..] addTxs: OK (3.89s)
+++ OK, passed 100 tests:
96% non-empty Mempool
90% MempoolCapacityBytesOverride
10% NoMempoolCapacityBytesOverride
4% empty Mempool
result of addTxs: OK (2.96s)
+++ OK, passed 100 tests:
98% non-empty Mempool
89% MempoolCapacityBytesOverride
11% NoMempoolCapacityBytesOverride
2% empty Mempool
Invalid transactions are never added: OK (2.94s)
+++ OK, passed 100 tests:
95% non-empty Mempool
93% MempoolCapacityBytesOverride
7% NoMempoolCapacityBytesOverride
5% empty Mempool
removeTxs: OK (0.87s)
+++ OK, passed 100 tests:
100% non-empty Mempool
93% MempoolCapacityBytesOverride
7% NoMempoolCapacityBytesOverride
0% empty Mempool
removeTxs [..] == forM [..] removeTxs: OK (1.30s)
+++ OK, passed 100 tests:
100% non-empty Mempool
90% MempoolCapacityBytesOverride
10% NoMempoolCapacityBytesOverride
0% empty Mempool
result of getCapacity: OK (0.84s)
+++ OK, passed 100 tests:
100% MempoolCapacityBytesOverride
94% non-empty Mempool
6% empty Mempool
0% NoMempoolCapacityBytesOverride
Added valid transactions are traced: OK (3.11s)
+++ OK, passed 100 tests:
93% non-empty Mempool
87% MempoolCapacityBytesOverride
13% NoMempoolCapacityBytesOverride
7% empty Mempool
Rejected invalid txs are traced: OK (2.62s)
+++ OK, passed 100 tests:
95% non-empty Mempool
89% MempoolCapacityBytesOverride
11% NoMempoolCapacityBytesOverride
5% empty Mempool
Removed invalid txs are traced: OK (0.77s)
+++ OK, passed 100 tests:
98% Removed some transactions
98% non-empty Mempool
84% MempoolCapacityBytesOverride
16% NoMempoolCapacityBytesOverride
2% empty Mempool
idx consistency: OK (1.46s)
+++ OK, passed 100 tests:
100% MempoolCapacityBytesOverride
100% empty Mempool
0% Mempool became empty
0% NoMempoolCapacityBytesOverride
0% The last transaction in the mempool is removed
0% non-empty Mempool
Mempool timeout: OK (1.86s)
+++ OK, passed 100 tests:
94% non-empty Mempool
90% MempoolCapacityBytesOverride
10% NoMempoolCapacityBytesOverride
6% empty Mempool
6% soft-timeout for otherwise-valid tx
addTextTx expectation (522 in total):
38.3% MtcAccepted
24.3% MtcRejected
23.4% MtcDiscard
12.6% MtcDisconnect
1.3% MtcNoSpace
Mempool fairness
There is no substantial bias in added transaction sizes: OK (4.77s)
QSM
sequential: OK (92.45s)
+++ OK, passed 1000 tests.
Command sequence length (1000 in total):
32.8% [0-10)
19.7% [10-20)
13.4% [20-30)
10.2% [30-40)
8.9% [40-50)
5.3% [50-60)
4.5% [60-70)
3.2% [70-80)
1.7% [80-90)
0.3% [90-100)
Commands (2853 in total):
33.09% TryAddTxs
22.68% GetSnapshot
22.26% SyncLedger
21.98% ChangeLedger
Maximum ticket number (1000 in total):
6.2% [0-5)
1.6% [30-35)
1.3% [40-45)
1.2% [25-30)
1.1% [100-105)
1.1% [45-50)
1.0% [10-15)
1.0% [285-290)
1.0% [35-40)
1.0% [400-405)
1.0% [75-80)
1.0% [85-90)
0.9% [110-115)
0.9% [150-155)
0.9% [235-240)
0.9% [245-250)
0.9% [50-55)
0.8% [105-110)
0.8% [120-125)
0.8% [145-150)
0.8% [165-170)
0.8% [190-195)
0.8% [20-25)
0.8% [230-235)
0.8% [290-295)
0.8% [350-355)
0.8% [520-525)
0.8% [555-560)
0.7% [125-130)
0.7% [130-135)
0.7% [15-20)
0.7% [205-210)
0.7% [220-225)
0.7% [305-310)
0.7% [410-415)
0.7% [440-445)
0.7% [495-500)
0.7% [55-60)
0.6% [160-165)
0.6% [170-175)
0.6% [200-205)
0.6% [225-230)
0.6% [270-275)
0.6% [385-390)
0.6% [455-460)
0.6% [540-545)
0.6% [60-65)
0.6% [700-705)
0.6% [770-775)
0.6% [80-85)
0.6% [90-95)
0.5% [115-120)
0.5% [175-180)
0.5% [210-215)
0.5% [215-220)
0.5% [240-245)
0.5% [260-265)
0.5% [275-280)
0.5% [310-315)
0.5% [340-345)
0.5% [375-380)
0.5% [395-400)
0.5% [435-440)
0.5% [480-485)
0.5% [5-10)
0.5% [515-520)
0.5% [525-530)
0.5% [570-575)
0.5% [695-700)
0.5% [70-75)
0.5% [710-715)
0.5% [760-765)
0.5% [835-840)
0.5% [980-985)
0.4% [1055-1060)
0.4% [1310-1315)
0.4% [140-145)
0.4% [280-285)
0.4% [300-305)
0.4% [320-325)
0.4% [380-385)
0.4% [390-395)
0.4% [420-425)
0.4% [430-435)
0.4% [575-580)
0.4% [610-615)
0.4% [615-620)
0.4% [65-70)
0.4% [655-660)
0.4% [725-730)
0.4% [795-800)
0.4% [820-825)
0.4% [830-835)
0.4% [850-855)
0.4% [885-890)
0.3% [1065-1070)
0.3% [1080-1085)
0.3% [1105-1110)
0.3% [1150-1155)
0.3% [1160-1165)
0.3% [1440-1445)
0.3% [1465-1470)
0.3% [1650-1655)
0.3% [180-185)
0.3% [185-190)
0.3% [195-200)
0.3% [250-255)
0.3% [255-260)
0.3% [295-300)
0.3% [330-335)
0.3% [345-350)
0.3% [360-365)
0.3% [365-370)
0.3% [415-420)
0.3% [450-455)
0.3% [460-465)
0.3% [470-475)
0.3% [485-490)
0.3% [490-495)
0.3% [505-510)
0.3% [510-515)
0.3% [535-540)
0.3% [605-610)
0.3% [620-625)
0.3% [625-630)
0.3% [660-665)
0.3% [665-670)
0.3% [670-675)
0.3% [740-745)
0.3% [745-750)
0.3% [780-785)
0.3% [785-790)
0.3% [805-810)
0.3% [810-815)
0.3% [845-850)
0.3% [895-900)
0.3% [905-910)
0.3% [930-935)
0.3% [940-945)
0.3% [990-995)
0.2% [1010-1015)
0.2% [1015-1020)
0.2% [1020-1025)
0.2% [1025-1030)
0.2% [1030-1035)
0.2% [1085-1090)
0.2% [1120-1125)
0.2% [1125-1130)
0.2% [1170-1175)
0.2% [1215-1220)
0.2% [1225-1230)
0.2% [1230-1235)
0.2% [1260-1265)
0.2% [1270-1275)
0.2% [1305-1310)
0.2% [1315-1320)
0.2% [1325-1330)
0.2% [1330-1335)
0.2% [1385-1390)
0.2% [1395-1400)
0.2% [1420-1425)
0.2% [1435-1440)
0.2% [1505-1510)
0.2% [1580-1585)
0.2% [1610-1615)
0.2% [1620-1625)
0.2% [1715-1720)
0.2% [265-270)
0.2% [315-320)
0.2% [335-340)
0.2% [355-360)
0.2% [370-375)
0.2% [405-410)
0.2% [425-430)
0.2% [445-450)
0.2% [465-470)
0.2% [500-505)
0.2% [530-535)
0.2% [545-550)
0.2% [550-555)
0.2% [580-585)
0.2% [585-590)
0.2% [590-595)
0.2% [600-605)
0.2% [635-640)
0.2% [640-645)
0.2% [650-655)
0.2% [675-680)
0.2% [685-690)
0.2% [715-720)
0.2% [720-725)
0.2% [765-770)
0.2% [790-795)
0.2% [800-805)
0.2% [815-820)
0.2% [865-870)
0.2% [870-875)
0.2% [890-895)
0.2% [925-930)
0.2% [945-950)
0.2% [95-100)
0.2% [955-960)
0.2% [965-970)
0.1% [1005-1010)
0.1% [1035-1040)
0.1% [1040-1045)
0.1% [1045-1050)
0.1% [1050-1055)
0.1% [1060-1065)
0.1% [1070-1075)
0.1% [1090-1095)
0.1% [1115-1120)
0.1% [1130-1135)
0.1% [1165-1170)
0.1% [1175-1180)
0.1% [1195-1200)
0.1% [1200-1205)
0.1% [1205-1210)
0.1% [1210-1215)
0.1% [1245-1250)
0.1% [1250-1255)
0.1% [1265-1270)
0.1% [1275-1280)
0.1% [1280-1285)
0.1% [1290-1295)
0.1% [1300-1305)
0.1% [1335-1340)
0.1% [135-140)
0.1% [1350-1355)
0.1% [1355-1360)
0.1% [1375-1380)
0.1% [1405-1410)
0.1% [1410-1415)
0.1% [1425-1430)
0.1% [1430-1435)
0.1% [1455-1460)
0.1% [1460-1465)
0.1% [1480-1485)
0.1% [1490-1495)
0.1% [1500-1505)
0.1% [1510-1515)
0.1% [1515-1520)
0.1% [1535-1540)
0.1% [1540-1545)
0.1% [1545-1550)
0.1% [1555-1560)
0.1% [1560-1565)
0.1% [1565-1570)
0.1% [1595-1600)
0.1% [1600-1605)
0.1% [1615-1620)
0.1% [1665-1670)
0.1% [1675-1680)
0.1% [1700-1705)
0.1% [1760-1765)
0.1% [1765-1770)
0.1% [1790-1795)
0.1% [1830-1835)
0.1% [2025-2030)
0.1% [2095-2100)
0.1% [2205-2210)
0.1% [325-330)
0.1% [560-565)
0.1% [595-600)
0.1% [690-695)
0.1% [705-710)
0.1% [735-740)
0.1% [755-760)
0.1% [775-780)
0.1% [840-845)
0.1% [860-865)
0.1% [880-885)
0.1% [900-905)
0.1% [915-920)
0.1% [950-955)
0.1% [960-965)
0.1% [975-980)
Number of txs to add (19076 in total):
10.495% [80-90)
10.228% [10-20)
10.044% [20-30)
10.034% [90-100)
9.981% [30-40)
9.934% [40-50)
9.902% [50-60)
9.892% [60-70)
9.808% [70-80)
8.791% [0-10)
0.891% [100-110)
parallel
running auto-GC to free 6934528 bytes
finding garbage collector roots...
deleting garbage...
deleting '/nix/store/iy45cl8dz4k18zin8n0cl6psnxizjwa3-cardano-crypto-wrapper-lib-cardano-crypto-wrapper-1.7.0.0'
deleting '/nix/store/0w9rlbl9wznhmb5k93j5mvpbq7vn64gr-byron-spec-chain-lib-byron-spec-chain-1.0.1.1'
deleted more than 6934528 bytes; stopping
deleting unused links...
note: hard linking is currently saving 5.0 GiB
running auto-GC to free 5371027456 bytes
waiting for the big garbage collector lock...
finding garbage collector roots...
deleting garbage...
deleting '/nix/store/1xh65hsr7vnkcf6gb1w322i61i1p6hmd-hydra-node-exe-shell'
deleting '/nix/store/1w265ghrhncswpac26h9aqk35ll66si2-hydra-cluster-exe-hydra-cluster-2.2.0'
deleting '/nix/store/lb5436kjaandrira64khghm6mfyliv70-hydra-cluster-lib-hydra-cluster-2.2.0'
deleting '/nix/store/5d9ic8xpchi0xz17iv9wcxyskxarxhs0-hydra-tx-lib-testlib-2.2.0'
deleting '/nix/store/1vlyi0sc9hyrzbmak52b26q19mha4grw-hydra-cluster-tests'
deleting '/nix/store/sqqb03nlbnzm51k635r9k1z1rdi3kfyh-hydra-cluster-test-tests-2.2.0'
deleting '/nix/store/4jaldjzz0k3pm8n60kskcvnsrlbk9xxd-hydra-node-lib-testlib-2.2.0'
deleting '/nix/store/bg9i1h9nnai8gk58wsd1ap8zav60b53i-hydra-node'
deleting '/nix/store/6sf9hhawbbf8i54k84inqd33zwcmjj9r-hydra-chain-observer'
deleting '/nix/store/1r8wqar1gkjlg9253y51ciblf9cdnv11-hydra-node-lib-testlib-2.2.0-hie'
deleting '/nix/store/1r0sjyywyaph6jglk543mnb640h3s3ni-hydra-demo-shell'
deleting '/nix/store/1qdwjh9f4zmzlj7g65wy72zrjky47889-hydra-cluster-bench'
deleting '/nix/store/rrcp2cc6cq7bf54q2qxfsgjk3ngwap90-hydra-cluster-bench-bench-e2e-2.2.0'
deleting '/nix/store/zn5si1b8xdhyd66dxb8g2ajavkd9jinb-hydra-cluster-lib-hydra-cluster-2.2.0'
deleting '/nix/store/jw8sp33slx4j505k4l5qm021jah45jrj-hydra-node'
deleting '/nix/store/8f64ws0qidhv51xnkb0kmd7z7ghx94s1-hydra-node-lib-hydra-node-2.2.0'
deleting '/nix/store/1q0l6kaav0zwiwkk13r2khhry5i07fb8-hydra-node'
deleting '/nix/store/yzn399fsvhs6zvhz8h1j09fwfmqkjwzn-hydra-node-lib-hydra-node-2.2.0'
deleting '/nix/store/1mcy61kksf2f3hzsiybn3a5sqr8dz36k-hydra-cluster'
deleting '/nix/store/nvn190cyigfgp0yvi7k3k5nqnvzda9k4-hydra-node'
deleting '/nix/store/kasl8z2kv4fy9kjrfir29c74mpqjm4i3-hydra-cluster-exe-hydra-cluster-2.2.0'
deleting '/nix/store/7qlk8g8l8fqydcc3lq0swgqn1j2pkk15-hydra-cluster-lib-hydra-cluster-2.2.0'
deleting '/nix/store/db62rkqdvl6kkwy0czlsajvkc1k6v95f-hydra-tx-lib-testlib-2.2.0'
deleting '/nix/store/1k7gxf6iihy17z3gay73r3i326qc4lbg-hydra-node-lib-testlib-2.2.0'
deleting '/nix/store/zz0i66lanccm1g0bkyff899ynlrygc44-hydra-tx-lib-testlib-2.2.0'
deleting '/nix/store/rgjlqxwnj6s6ni9h1qdllzcaj2g4jirg-hydra-node-lib-hydra-node-2.2.0'
deleting '/nix/store/xnwr8pk0lvlnx0zsrm4079dslv3kdhf1-hydra-tx-lib-hydra-tx-2.2.0'
deleting '/nix/store/as8rqxndlqa84zy3q7cgqjlgfl5nj64p-hydra-plutus-lib-hydra-plutus-2.2.0'
deleting '/nix/store/9dzwzzb4ixff8xgx9fv8rjqgy36x98jl-hydra-cardano-api-lib-testlib-2.2.0'
deleting '/nix/store/1ijf22lhxn89f0d9viv1500jz2m5khfk-hydra-cluster-tests'
deleting '/nix/store/b34bwc7f38zwq70qhq5k04qk1jfl53z9-hydra-chain-observer'
deleting '/nix/store/6vw4a5fh8gcw85nyxj4zhswk9r4zklm1-hydra-node'
deleted more than 5371027456 bytes; stopping
deleting unused links...
note: hard linking is currently saving 5.0 GiB
running auto-GC to free 92368896 bytes
finding garbage collector roots...
deleting garbage...
deleting '/nix/store/5g18jx48mbzn7s4x5fszpy2l1q9n2w44-ouroboros-consensus-lib-unstable-cardano-tools-3.0.1.0'
deleting '/nix/store/yh9imzdlm17mnlhm8wzggzhx46vajjqd-ouroboros-consensus-lib-unstable-shelley-testlib-3.0.1.0'
deleting '/nix/store/ipwv0lccpb7kd05hgq3krrmvfzgiiw7c-cardano-ledger-alonzo-test-lib-cardano-ledger-alonzo-test-1.4.0.1'
deleting '/nix/store/bka9s5303c58j7ggdgcm12qs76qfv3qw-cardano-ledger-shelley-ma-test-lib-cardano-ledger-shelley-ma-test-1.4.0.2'
deleting '/nix/store/8r5szh8g0ms31knrlkzgd8svdsirw3ww-ouroboros-consensus-lib-unstable-protocol-testlib-3.0.1.0'
deleting '/nix/store/0jc6m9xxi7x6aqk2850k8bp9xkghz4bv-cardano-ledger-shelley-test-lib-cardano-ledger-shelley-test-1.9.0.0'
deleting '/nix/store/vv4610knk63gy2jxjb1yjn2jk81q76kw-cardano-protocol-tpraos-lib-testlib-1.6.0.0'
deleting '/nix/store/1dj8r2aj5v9k69rm7p8ka6hilw3cl2aj-hydra-node-lib-examples-2.2.0'
deleting '/nix/store/1df8xvfd79ajgy71060b5pjys410fp1b-hydra-node-test-tests-2.2.0-hie'
deleting '/nix/store/5wpz14yhhqflhfvpqlmd3h204pakc5qw-hydra-node-test-tests-2.2.0'
deleted more than 92368896 bytes; stopping
deleting unused links...
note: hard linking is currently saving 5.0 GiB
running auto-GC to free 3944939520 bytes
waiting for the big garbage collector lock...
finding garbage collector roots...
deleting garbage...
deleting '/nix/store/rikgx5j0r4ip9g2qkwvmsf7916pvbx3q-hydra-node-lib-testlib-2.2.0'
deleting '/nix/store/1wjgm3q7wcmd7vv5n9l3r2f9n97135sz-hydra-cluster-lib-hydra-cluster-2.2.0'
deleting '/nix/store/rqjxylp4dv4rmknk72dnnxlxwv1awqbr-hydra-node-lib-hydra-node-2.2.0'
deleting '/nix/store/11pz2rki2y50kxlr4pb12mpiwbic2723-hydra-tui-test-tests-2.2.0'
deleting '/nix/store/i09ivklivg52sb4fkb263xva4m75cw7d-hydra-cluster-lib-hydra-cluster-2.2.0'
deleting '/nix/store/43h81bxfcri83vdh6jg74jd2m67fwrsn-hydra-tui-lib-hydra-tui-2.2.0'
deleting '/nix/store/6b2q4ljmzgcw5jm9l0gdlwgzjg8g5j71-hydra-node-lib-hydra-node-2.2.0'
deleting '/nix/store/11gwy47p27w0bv60hqi328a0a84iicz6-hydra-cluster-bench'
deleting '/nix/store/85z2qmhk4i3wv3gp563lf10v9mjk9yma-hydra-node'
deleting '/nix/store/5bnlc5nr4rv558jk79hzzkz0xfn4a5db-hydra-cluster-bench-bench-e2e-2.2.0'
deleting '/nix/store/axard63y3w1rjd8gpd4hvxxpkqs5zcd1-hydra-cluster-lib-hydra-cluster-2.2.0'
deleting '/nix/store/0xkchj3h7qds0qscp7y2ih4xsnlr4qj0-hydra-demo-shell'
deleting '/nix/store/ds8qpgbzvlk1p8k61hhjwkb74k1biqqa-hydra-tui'
deleting '/nix/store/cnsssdl8f6zwdq92ynvsxgz3316b1fjj-hydra-node'
deleting '/nix/store/0xjkifk30z2gzs0kvmp5b3slbi4vjwl1-hydra-cluster-test-tests-2.2.0'
deleting '/nix/store/wdqdrqkw21f77w3l792vy2qy5yni50wb-hydra-cluster-lib-hydra-cluster-2.2.0'
deleting '/nix/store/hfv8xmkrhggph8gs3m6599p4x7ycz927-hydra-node-lib-testlib-2.2.0'
deleting '/nix/store/wz7pfkvl2wm5v2bzak010ra9rkj9hrxg-hydra-node-lib-hydra-node-2.2.0'
deleting '/nix/store/6ggrfpsbfajq9vfrqy2p97n91zxzxi8f-hydra-tx-lib-testlib-2.2.0'
deleting '/nix/store/0wpi37vngaczz699mgv9i9c5q7yra8ph-demo'
deleting '/nix/store/8dz0n93v9cpd9vn9wlys93hdynmjxilx-process-compose-demo.json'
deleting '/nix/store/vlinnzvjjzgvw2j1bma052glm2d1z0z1-hydra-node-alice-mirror'
deleting '/nix/store/qa9pbpcqw373zg7rvjarpiwgpl4pmgy4-alice-tui'
deleting '/nix/store/bz2pp671yhym7qlp0w4h9wadpzx0q5bc-bob-tui'
deleting '/nix/store/86fsbhd3k9kizfc1xwx8cmska7ic266m-hydra-node-carol'
deleting '/nix/store/7kw2f3gw1zy7m6wcpli4n1ivkijjiap6-carol'
deleting '/nix/store/hajq5cwqfzv5bfma7hjkn7gayj84g85z-hydra-tui'
deleting '/nix/store/ja308pn56s3ghpp2vx00anz85l53fbxq-hydra-tui-lib-hydra-tui-2.2.0'
deleting '/nix/store/548izjqkzf3pg9p8bsffwb88bw65c0ra-hydra-node-bob'
deleting '/nix/store/0wasxqqzbb5kr8kg6cq15sk4f1mc5h9q-process-compose-demo.json'
deleting '/nix/store/wpdjy6qrhldyvdys831vibwcdv5hw1lk-hydra-node-alice'
deleting '/nix/store/q9g2iaa1lra7dn4x90bh1vi89p4xx6fs-hydra-node-bob'
deleting '/nix/store/nbjgp2fhsnpvrpxzhkjfr9n2njf57frh-carol'
deleting '/nix/store/mlrzxivm1nzw30wd52fzgh92jhwqzxfk-alice-tui'
deleting '/nix/store/hmz9f1lryvwgn446fmfjb0fgggsxnm3b-hydra-node-alice-mirror'
deleting '/nix/store/6ays0dj3z1cz6bcj360gigpay2mnv751-bob-tui'
deleting '/nix/store/3hffh4gjwsvbpi09mdpgmfa63z9x2h08-hydra-tui'
deleted more than 3944939520 bytes; stopping
deleting unused links...
note: hard linking is currently saving 5.0 GiB
Loading