I've been using openAI small model because my crappy 6GB GPU. It would take around 40mn to 1h30 for any single movie. It was very discouraging.
Update: I've finally found time to make a build of whisper.cpp with cuda support.
After a little fine tuning of the params, a 2h movie takes 5mn with...