When your video is playing you can just hover over it, and a control bar at the bottom will appear. On the right side of that bar, you should see a white rectangular icon that you can select to transform your video into full-screen mode.

To exit full-screen mode you can click the same button again or just tap the escape button on your keyboard.