Offline, on-page MP4 player

I need to deliver a web page that has two videos on it. Videos and web pages will be downloaded locally, and assume the connection ends after downloading. I want people to be able to view these videos, within the web page. I don't want the videos to open in a Windows video player and a new screen. I want the videos to play within the page so the viewer does not leave the page or their place within the page. Videos are MP4. System is always a Windows 7 PC.