There's been a surge in adoption of video conferencing applications for both personal and business use cases. However, there are millions of people around the world who are unable to truly enjoy these technologies due to bandwidth limitations despite having appropriate hardware. Deep learning offers a solution for enhancing low bitrate videos but most models today are either hard to incorporate with modern compression standards or require specialized hardware to run such as GPUs making these models impractical. To address these issues, we introduce the Realtime Face Video Enhancement (RTFVE) model that can easily be incorporated with any video decoder and can run in realtime on ordinary CPUs. Experiments show that our model improves perceptual quality over the compressed video baseline at multiple low bitrate settings.