Whisper (OpenAI) - Automatic English Subtitles for Any Film in Any Language - An Intro & Guide to Subtitling JAV

You're referring to WhisperJAV, right? Some of the usual suspects are:
-- check that you're using the latest fixes. 07b had a minor fix a couple of days ago.
-- double check that you're not getting: your session has crashed pop up message from colab.
-- check the audio files extensions. Accepted extensions are: ".mp3", ".wav", ".aac", ".m4a", ".ogg", ".flac".
-- check that the audio files are uploaded correctly (say listen to them or check their sizes).
-- check that your folder name is exactly WhisperJAV (case sensitive).

If none of the above, send me a screenshot of the last screen output. I'll check it.
I have been using WhisperJAV for a few months now without issue but recently it's not working anymore for me.
you mention about "check that you're using the latest fixes. 07b had a minor fix a couple of days ago. " how exactly do we do that, is there a new release on github?

Edit: Nevermind, i figured it out i was using 07a which was no longer working for me, 07b works fine for me
 
Last edited:
  • Like
Reactions: panop857 and mei2
I've been getting a crash error my most recent time running. My files are in the drive folder as normal, no other changes have been made.

Edit: Nevermind, my bookmark was for an older version. Everything works fine with the most up to date WhisperJAV.
 

Attachments

  • Whisper Error.png
    Whisper Error.png
    19.6 KB · Views: 15
Last edited:
Credit goes to @anon_entity, the original developer of WhisperVAD. He had put together a robust algorithm.
I was not planning any update to that colab. But if there is any ideas for improvments or new features, I'm happy to look into it.
I think you can add some feature to clean up the transcriptions afterwards since it takes some time to do post editing the subs with the amount of hallucinations it produces specifically with moaning sounds and etc.. looking forward to see if it possible for you to add that feature. Thanks.
 
Does anybody know how to fix this ?
I am using WhisperJAV_v0_7a.ipynb in browser.
 

Attachments

  • error.png
    error.png
    84.1 KB · Views: 21
I've been using openAI small model because my crappy 6GB GPU. It would take around 40mn to 1h30 for any single movie. It was very discouraging.
Update: I've finally found time to make a build of whisper.cpp with cuda support.
After a little fine tuning of the params, a 2h movie takes 5mn with the medium model!
Direct translation looks even better and the only post processing are just dup lines and none of the gibrish I used to get before like "ahhhhhhhhh" "I like it that way.I like it that way.I like it that way.I like it that way.I like it that way.", etc...
Just clean text that makes sense.
Total game changer for me.
 
I've been using openAI small model because my crappy 6GB GPU. It would take around 40mn to 1h30 for any single movie. It was very discouraging.
Update: I've finally found time to make a build of whisper.cpp with cuda support.
After a little fine tuning of the params, a 2h movie takes 5mn with the medium model!
Direct translation looks even better and the only post processing are just dup lines and none of the gibrish I used to get before like "ahhhhhhhhh" "I like it that way.I like it that way.I like it that way.I like it that way.I like it that way.", etc...
Just clean text that makes sense.
Total game changer for me.
This line of dialog almost made me wonder if it was a take on the old song lyrics "Oooo, Baby....I like it like that!"
Was it making subs form a JAV or old MTV video?
 
  • Haha
Reactions: Elmerbs