Remove 29 dead videos from the data - #240
Closed
banool wants to merge 1 commit into
Closed
Conversation
First cleanup pass of filter_dead_media.py against the committed data: 29 URLs answered 5/5 authentic Swift 404s across spaced rounds and were independently re-confirmed 4/4 by verify_removed_media.py ~40 minutes later. No entries or sub_entries were lost — every affected sub_entry has other working videos. These URLs drove the video_resolve_failed http_404 errors seen in ~5.6% of sessions. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_017bum5SFYEZD4gqX8PZhT6i
Owner
Author
|
Superseded by #241 — same branch, rebased onto Generated by Claude Code |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
First cleanup pass of
filter_dead_media.py(see #239), run standalone against the committed data with extra-patient re-checks (5-minute round spacing), then independently verified ~40 minutes later byverify_removed_media.py(4 rounds, 2-minute spacing, different code path).Result
x-trans-id/x-openstack-request-id+ exact not-found body), then 4/4 in the verifier: 29/29 confirmed, 0 false positives, 0 unconfirmed. All 30 sampled kept URLs alive.archive_orphaned_media.pyreports as referenced-but-missing from the mirror — two independent signals agreeing.These 29 URLs are what has been driving
video_resolve_failed/http_404in ~5.6% of Auslan sessions (they're heavily shared Definition/Gloss videos). After this merges and clients refresh their data, that metric should fall toward zero.The 29 removed URLs and the entries that referenced them
/mp4video/Definition/00/60.mp4/mp4video/Definition/00/83.mp4/mp4video/Definition/19/19233.mp4/mp4video/Definition/20/20442.mp4/mp4video/Definition/20/20443.mp4/mp4video/Definition/20/20446.mp4/mp4video/Definition/20/20450.mp4/mp4video/Definition/20/20451.mp4/mp4video/Definition/20/20452.mp4/mp4video/Definition/20/20453.mp4/mp4video/Definition/20/20495.mp4/mp4video/Definition/20/20501.mp4/mp4video/Definition/20/20502.mp4/mp4video/Definition/20/20503.mp4/mp4video/Definition/20/20504.mp4/mp4video/Definition/20/20510.mp4/mp4video/Definition/20/20514.mp4/mp4video/Definition/20/20515.mp4/mp4video/Definition/20/20516.mp4/mp4video/Definition/20/20518.mp4/mp4video/Definition/20/20530.mp4/mp4video/Definition/51/5108.mp4/mp4video/Definition/57/5773.mp4/mp4video/Definition/59/5923.mp4/mp4video/Definition/91/9184.mp4/mp4video/Definition/91/9185.mp4/mp4video/Definition/96/9661.mp4/mp4video/Gloss/79/7944.mp4/mp4video/Gloss/82/8271.mp4Full per-attempt evidence (headers, body hashes, timings) is in the filter/verify reports; ask if you want them attached.
🤖 Generated with Claude Code
https://claude.ai/code/session_017bum5SFYEZD4gqX8PZhT6i