Add "pull YT subs before Whisper" step + footgun - #4
Draft
evnchn wants to merge 1 commit into
Draft
Conversation
`yt-dlp --list-subs` before transcribing pays three ways: the `<lang>-orig` tag reveals the true source language (tripwire for a video already in the target language — a whole-pipeline no-op), a manual/creator track can beat Whisper for free, and an `-orig` auto-caption is a free second ASR to cross-check Whisper against. Adds a step-2 prelude + one footgun row. Grounded in a live run (yt=ohCAPyqlJpo): en-orig present -> already English; YT-vs-Whisper 98.2% word-agreement but split on Arthur Andersen (YT right, Whisper "Anderson" wrong) and both botched the brand "Saily". Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TL;DR
Add "pull YouTube's own subs before Whisper" to the pipeline (step-2 prelude + one footgun row).
yt-dlp --list-subscosts ~5s and pays three ways — most importantly it catches a video that's already in the target language before you download + transcribe it for nothing.Verdict from a live run: on
youtube.com/watch?v=ohCAPyqlJpo(a 16-min English talk), theen-origtag alone would have short-circuited the whole "localize to English" pipeline. And YouTube's auto-caption vs Whisperlarge-v3-turboagreed on 98.2% of words — but the 1.8% delta is exactly where a human is needed, and each engine was right where the other was wrong.Diff is +2 / −1 lines, matching the skill's dense-footgun house style. Doc-only.
The three payoffs (why this earns a line)
--list-subsshows a<lang>-origtrack = the video's true source-caption language. If that's already your target (e.g.en-orig), the localize job is a no-op — stop before downloading/whispering. This skill previously had no such tripwire; the trigger video is literally already English.[music]tokens.-origauto-caption is another ASR — diffing it against Whisper surfaces exactly the lines that need a human fix.Trap folded into the row: the 100+ other languages in
--list-subs(incl.zh-Hant,ja,ko) are YouTube auto-translations, not creator tracks — don't mistake azh-Hantrow for a real Chinese source.Evidence — YT auto-caption vs Whisper large-v3-turbo (same English audio)
[music]tokens[music]tokens). → Whisper is the better base transcript.Arthur Andersen— YT correct, Whisper wrong (Anderson). Context confirms the Enron-era auditor ("one of the big five", "$25 million in audit fees"), spelled Andersen.Saylite/Sayle, WhisperSaley. Ground truth is Saily (Nord Security's eSIM,saily.com/invisiblegame, code INVISIBLEGAME) — verified against saily.com.audits⇄orders— disagree both directions (context-dependent mishear).Takeaway baked into the wording: don't pick one engine blindly — cross-check them; the disagreements are a free proper-noun error detector. Neither engine alone catches "Andersen", and neither gets "Saily".
Repro:
yt-dlp --list-subs, pullen-orig, runwhisper --model large-v3-turbo --language en, diff normalized word sequences.🤖 Generated with Claude Code