Agreed, there are a lot of duplicates, but I think @theydonotwantto analysis of the last sub pack (15,500+ subtitles?) Shows only 7,700 unique
files, so this bundle still has more than double the number.
I look forward to the tool you are working on, it will make it easier to find a subtitle...