Since you are talking about stand alone dvd players, it depends. Anything listed as DivX certified should be able to.
Others will actually say MP4 on the front or tray like it says DVD/Audio CD/DivX/MP4/MP3/ect
Do not assume that all players will play it because they will not. Look for the specs.