Twitch
Twitch
Section titled “Twitch”Using Subtide for live stream translation on Twitch.
Overview
Section titled “Overview”Subtide supports Twitch streams with real-time transcription and translation:
- Live transcription using Whisper
- Real-time translation of spoken content
- Overlay subtitles that don’t interfere with the stream
Getting Started
Section titled “Getting Started”- Navigate to any Twitch stream
- Look for the Subtide controls in the player
- Click to start translation
- Subtitles appear as the streamer speaks
Warning: Requirements Twitch translation requires Tier 2 or higher since live streams don’t have pre-existing subtitles.
How It Works
Section titled “How It Works”- Audio Capture - The extension captures audio from the stream
- Transcription - Whisper processes audio chunks in real-time
- Translation - LLM translates the transcribed text
- Display - Subtitles appear with minimal delay
Controls
Section titled “Controls”Translation Toggle
Section titled “Translation Toggle”Located in the Twitch player controls:
- Click to start/stop translation
- Icon indicates active state
Subtitle Display
Section titled “Subtitle Display”- Position: Adjustable via drag-and-drop
- Size: Configurable in the menu
- Style: Matches Subtide’s dark theme
Configuration
Section titled “Configuration”For best results with Twitch:
Backend Settings
Section titled “Backend Settings”# Recommended for live streamingWHISPER_MODEL=base # Fast processingWHISPER_BACKEND=mlx # Or 'faster' for NVIDIATip: Model Selection For live streams, use smaller models (
tiny,base) for lower latency. Accuracy is less critical than speed.
Extension Settings
Section titled “Extension Settings”- Operation Mode: Tier 2 (Enhanced)
- Target Language: Your preferred language
Limitations
Section titled “Limitations”- Delay - There’s inherent latency in transcription/translation
- Audio quality - Depends on stream quality
- Multiple speakers - May have difficulty with overlapping speech
- Music/SFX - Background audio can affect transcription quality
Tips for Better Results
Section titled “Tips for Better Results”Reduce Latency
Section titled “Reduce Latency”- Use a smaller Whisper model (
tinyorbase) - Run backend locally for lowest network latency
- Use Apple Silicon MLX or CUDA for hardware acceleration
Improve Accuracy
Section titled “Improve Accuracy”- Higher quality streams have clearer audio
- Single-speaker streams work best
- Gaming streams with commentary work well
Handle Multiple Languages
Section titled “Handle Multiple Languages”If the streamer speaks multiple languages:
- Subtide will detect language changes
- Translation continues regardless of source language
- Some mixing may occur during transitions
VODs and Clips
Section titled “VODs and Clips”Subtide also works with:
- VODs (Video on Demand) - Past broadcasts
- Clips - Short highlight clips
- Highlights - Curated stream moments
These function like regular videos with full translation support.
Troubleshooting
Section titled “Troubleshooting”No audio captured
Section titled “No audio captured”- Ensure the stream is unmuted
- Check browser permissions for audio
- Verify the extension has necessary permissions
High latency
Section titled “High latency”- Use a smaller Whisper model
- Check your network connection
- Run backend locally instead of remote
Subtitles cutting off
Section titled “Subtitles cutting off”- Speech is being chunked for processing
- This is normal for live content
- Context is maintained between chunks
Next Steps
Section titled “Next Steps”- Generic Sites - Use on any video site
- Backend Overview - Optimize your backend