This doesn't work for me, for some reason. When I tell it to extract the audio no file gets created.
Post your JAV subtitle files here - JAV Subtitle Repository (JSP)★NOT A SUB REQUEST THREAD★
- Thread starter Eastboyza
- Start date
-
Akiba-Online is sponsored by FileJoker.
FileJoker is a required filehost for all new posts and content replies in the Direct Downloads subforums.
Failure to include FileJoker links for Direct Download posts will result in deletion of your posts or worse.
For more information see this thread.
This doesn't work for me, for some reason. When I tell it to extract the audio no file gets created.
ffmpeg can do some processing on audio as it extracts it from a video file. I am currently using this command that will find all video files in a directory and then write out an mp3 for each. It also does a dynamic normalization to increase the volume of quiet parts of the track. (This is a bash shell command.)
There are other ffmpeg settings that can do dynamic range compression and other fancy things.
https://ffmpeg.org/ffmpeg-all.html#dynaudnorm
Have had very good luck w/ the above, so not seeing much need to try and isolate voices from the regular audio track,
Code:
find . -type f -iregex '.*\.\(m4v\|mp4\|mov\|wmv\|avi\|mpg\|mpeg\|rmvb\|rm\|flv\|asf\|mkv\|webm\)' -print0 | parallel -0 ffmpeg -loglevel 0 -i {} -af "dynaudnorm=f=150" -ac 1 -ar 16000 -vn {.}.mp3There are other ffmpeg settings that can do dynamic range compression and other fancy things.
https://ffmpeg.org/ffmpeg-all.html#dynaudnorm
Have had very good luck w/ the above, so not seeing much need to try and isolate voices from the regular audio track,
I'm going to write out the steps I have to take, and you tell me where it stops working for you.
Converting video to audio in VLC Player
1. Open VLC.2. Go to Media > Convert / save.
3. Select Add... and browse to your file(s).
4. After you files have been added, select Convert / Save at the bottom. This should take you to a new window.
5. Convert should already be selected. Click the wrench icon next to the dropdown by Profile.
6. Select your desired output on the Encapsulation tab. You can also change the audio codec settings if you desire.
7. Click Save.
8. Click Browse to choose where to save your file if you're only converting a single file.
- Note that if you do multiple files, it won't ask you where to save your output file, it will save the converted file to their original directories.
- If you only convert a single file, remember to select where to save it and to change the file extension to the correct one.
- If you don't select the save destination for the file, you can't start conversion.
- I'm speaking as a Windows user about changing the extension. I don't know about the Mac interface. You don't really have to change the file extension to the correct one, it's really just good practice so you don't confuse which file is which. For example, when I convert a single mp4 file and I don't change the file extension or the name of the file, it saves as the same file name as the video file. You don't want to lose memory accidentally translating a multi GB file.
9. Click Start. The conversion process will either happen automatically or you may have to hit the play button to start the conversion process. The latter is not very intuitive and I currently have no understanding why that happens, but it does.
My best guess is step 9 is where you may believe it's not working for you.
Last edited:
I didn't do the end of 5 and 6 before because it already said mp3. When I followed your steps but not actually changing the setting at that step and just hitting save it suddenly worked. No idea why you have to do that when it's already set to mp3, but at least it works now. Thanks.
Seriously, the gap in quality between Whisper and most JAV subtitles is huge. RBD-179's translation on Subtitle Cat's first 2 minutes:
Now let's look at even the Medium basic model from Whisper. The only thing it gets wrong is who married Mr. Kazuo. Her mother married Kazuo. I see that mistake a lot, with it incorrectly identifying the subject of a sentence. It is often after these types of intros, and is probably because of the link between sentences-- it is very common for introductions to be talking about themselves, so it is learning that incorrectly here.
I am getting these nice long sentences with punctuation because I set beam_size to 12 or 15. 20 crashes on my computer, but I think the misplaced "I" pronoun is because of where it chose to make the sentence/line break.
Last edited:
Ooh, nice suggestions on adjusting beam_size and temperature hyperparameters - will have to try those out.
One tuning that I have found useful to reduce hallucinations is to reduce no_speech_threshold down to 0.1 or lower. In addition, setting conditon_on_previous_text False also helps reduce repetition loops. (found at https://scanlover.com/d/17746-new-open-source-transcription-and-translation-software)
These two changes gave me results that were much better than using a VAD like in WhisperWithVAD is doing - using the VAD meant that there were nearly zero hallucinations, but it ended up missing a lot of lines.
One tuning that I have found useful to reduce hallucinations is to reduce no_speech_threshold down to 0.1 or lower. In addition, setting conditon_on_previous_text False also helps reduce repetition loops. (found at https://scanlover.com/d/17746-new-open-source-transcription-and-translation-software)
These two changes gave me results that were much better than using a VAD like in WhisperWithVAD is doing - using the VAD meant that there were nearly zero hallucinations, but it ended up missing a lot of lines.
BKD-168 Mother-to-child Copulation ~ Okunikko Road ~ Lena Fukiishi
I used Whisper to produce this subtitle file for BKD-168. I really like this actress's boobs, but probably not much of a story line. As always however, I still had to clean it up a bit and re-interpreted some of the meaningless dialog. Again, I don't understand Japanese or Chinese so my re-interpretations might not be totally accurate but I try to match what is happening in the scene. Anyway, enjoy and let me know what you think.
I took one of the files that porgate55555 included in his batch of Whisper files recently and tried to spruce it up a bit. I am afraid my linguistic and technical limitations prevented me from doing as well as I would like, but I think it was worth my efforts. My thanks to porgate for including that file and for introducing me to this particular JAV.
This is without a doubt one of the best JAVs I have ever seen. This surprised me because it includes a male actor I usually don't like and follows the BDSM training trope that can get pretty routine after you've seen a few of them. This one, though, is saved by some original touches in the script and the absolutely FANTASTIC acting by Nanami Kawakami! She has incredible chemistry with her co-star and is very believable as a happy housewife who just feels an emptiness in her life and finds a man that can fill it for her. (As an example of how good she is, just watch her face the first time she sees the man's cock.) I could go on and on about what I think is so great about this video, but I particularly like the framing device used here. The first scene immediately establishes the dynamic between Nanami and her Master; then there is a flashback 2 years to show how it all starts. As one would expect, near the end we come back to that opening scene again, but there are some subtle and significant changes when we go through it a second time.
Anyway, take a look and see what I mean. And if there is anyone with better skills than mine who wants to give the file another edit, that would be great.
ATID-497 A Two-Year Record Of Breaking Her In Until She Loses Her Head Over Sex And Awakens To Her Masochism. Nanami Kawakami
This is without a doubt one of the best JAVs I have ever seen. This surprised me because it includes a male actor I usually don't like and follows the BDSM training trope that can get pretty routine after you've seen a few of them. This one, though, is saved by some original touches in the script and the absolutely FANTASTIC acting by Nanami Kawakami! She has incredible chemistry with her co-star and is very believable as a happy housewife who just feels an emptiness in her life and finds a man that can fill it for her. (As an example of how good she is, just watch her face the first time she sees the man's cock.) I could go on and on about what I think is so great about this video, but I particularly like the framing device used here. The first scene immediately establishes the dynamic between Nanami and her Master; then there is a flashback 2 years to show how it all starts. As one would expect, near the end we come back to that opening scene again, but there are some subtle and significant changes when we go through it a second time.
Anyway, take a look and see what I mean. And if there is anyone with better skills than mine who wants to give the file another edit, that would be great.
Just a tip on Whisper about translation: Don't use it. Just choose No Translation and do that later in Google translate or DeepL translate (use Tor Browser so you don't get blocked for using up your free ratio (500.000 characters a month). You will need to separate the text from the timing first and then re-attach it as some of the translators introduces glitches in it.
I don't know how good the translator Whisper uses is (you can choose DeepL, too) but if you don't have a basic reference to what is actually transcribed, you can't figure out what the line is if the translator produces garbage.
I can only use the collab page so many of the 'settings' mentioned in posts before this can't be used. I have experimented with VAD-Threshold and have settled on 0.3. What does Chunk_Threshold (3.0) do? Size of the audio parts analyzed? I'll try to lower and raise the number to see if there are improvements. Source separation didn't work for me. I get error messages.
I don't know how good the translator Whisper uses is (you can choose DeepL, too) but if you don't have a basic reference to what is actually transcribed, you can't figure out what the line is if the translator produces garbage.
I can only use the collab page so many of the 'settings' mentioned in posts before this can't be used. I have experimented with VAD-Threshold and have settled on 0.3. What does Chunk_Threshold (3.0) do? Size of the audio parts analyzed? I'll try to lower and raise the number to see if there are improvements. Source separation didn't work for me. I get error messages.
Last edited:
Here are two raw Whisper files for BKD-127 and BKD-153. I don't intend to clean them as I just want to use them to compare to existing EroJapanese subtitles in an attempt to get a better understanding of what Whisper means with dialog like "I'm hungry", I'm sleepy, etc. rather than just relying on my wild ass guess. My goal is to create a spreadsheet to use with the more lewd EroJapanese vocabulary to use when re-interpreting Whisper's dialog.
It depends what you're going for. The value of Whisper isn't to get the highest quality translation possible, it is about lowering the effort bar to get something good enough. Medium Whisper, with well-chosen parameters and some manual editing from just watching the move and editing as you go, is going to be better and more complete than like 95% of the subtitles that are currently out there for JAV. The places that are good and doing manual translations tend to miss a bunch of the smaller text, but do a better job of making the lines that are supposed to sound dirty be appropriately so.
In terms of making a script dirty, it needs either a modified model file (as downloaded from HuggingFace). Better training data for JAV will help that, but there's also "logit biasing" that may make the translation more willing to output dirty language. That is very advanced stuff though.
Is it possible to do model adaptation? · openai whisper · Discussion #66
Is it possible to add a corpus of specific words, names of places etc, technical jargon to improve accuracy?
github.com
And due to Whisper primarily being done in Python, you can turn that spreadsheet into a simple replacement dictionary that saves all of the text in a raw file, and then goes through with the filter and saves out the subtitles with the common replacements. Whoever designed the Collab space could likely easily do that if their intent was to make something JAV friendly.
Last edited:
I am getting close to the point where I could make a Whisper thread that discusses how to best use it. I want to see if I can get one of the JP focused models working though.
"--conditon_on_previous_text False" will prevent some of the repeated lines, but lead to worse translations everywhere else. Random actor names and the such. Conditioning on previous text is how Whisper learns the context of the dialogue, but it can overly rely on the previous lines I guess.
Temperature > 0 is probably a better way to escape the repeated line problems.
"--conditon_on_previous_text False" will prevent some of the repeated lines, but lead to worse translations everywhere else. Random actor names and the such. Conditioning on previous text is how Whisper learns the context of the dialogue, but it can overly rely on the previous lines I guess.
Temperature > 0 is probably a better way to escape the repeated line problems.
Sounds interesting. Do you know how the command should look like for command line users like me?
Haven''t tested it but you can edit the code on those colab and the vad one already has a list of words it replaces so nothing would stop anyone from adding their own list of words to get replaced there.
If you're just using Whisper for the transcribing into Japanese and avoiding the translation, you can drop the .srt into the free Subtitle Edit program and easily auto-translate it. I believe it uses Google to translate languages. I have been doing this for years with the Chinese subtitle files I could find and translating them to English. It was my go-to method before Whisper came around.
DVDMS-913 A Busty Wife Who Turned Into A Sow Semen Tank In Just 3 Days Yuria Yoshine
I used Whisper to produce this subtitle file for DVDMS-913. A little different story line than I prefer but nice boobs. As always however, I still had to clean it up a bit and re-interpreted some of the meaningless dialog. Again, I don't understand Japanese or Chinese so my re-interpretations might not be totally accurate but I try to match what is happening in the scene. Anyway, enjoy and let me know what you think.
How do you turn off the translation in Whisper? Does Subtitle Edit also have a limited "Lewd" vocabulary like Whisper?
you change the "task" from "Translate" to "Transcribe"
try digging into stackoverflow and experiment with using For loops in the commandline: https://stackoverflow.com/questions/60310563/how-to-execute-ffmpeg-from-with-batch-for-loop
