Yes, you are correct, many of them are in fact mp4's, but there are also a lot of gifs too. If its an mp4 there is a circle with a play arrow in the middle, if its a gif it says so on the lower left corner.
I should have mentioned that I use Opera for a browser, I tried what you said but that...