Skip to content

feat: add MLX Whisper backend for Apple Silicon - #141

Open
ben0724-ACE wants to merge 1 commit into
mli:mainfrom
ben0724-ACE:mlx-whisper
Open

feat: add MLX Whisper backend for Apple Silicon#141
ben0724-ACE wants to merge 1 commit into
mli:mainfrom
ben0724-ACE:mlx-whisper

Conversation

@ben0724-ACE

Copy link
Copy Markdown

Summary

Add an optional MLX Whisper backend for efficient local transcription on Apple Silicon Macs.

  • Support --whisper-mode mlx
  • Add mlx-whisper as an optional [mlx] dependency
  • Map existing model names to MLX Community checkpoints
  • Preserve the existing SRT, Markdown, and video-cutting workflow
  • Add MLX-specific tests and documentation

Compatibility

This backend is opt-in. The default whisper mode and the existing Whisper, Faster Whisper, and OpenAI backends remain unchanged.

MLX mode passes media files directly to mlx-whisper and skips the PyTorch/Silero VAD path.

Testing

Tested on an Apple Silicon Mac with Python 3.12.13 and mlx-whisper 0.4.3.

  • black --check .
  • pytest test/test_mlx.py test/test_cut.py — 8 passed
  • Successfully transcribed an MP4 using mlx-community/whisper-large-v3-turbo
  • Verified mixed Chinese and English SRT/Markdown output

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant