Video Magnification
Many seemingly static scenes contain subtle changes that are invisible to the naked human eye. However, it is possible to pull out these small changes from videos through the use of algorithms we have developed. We give a way to visualize these small changes by amplifying them and we present algorithms to pull out interesting signals from these videos, such as the human pulse, sound from vibrating objects and the motion of hot air.
http://people.csail.mit.edu/mrub/vidmag/
Eulerian Video Magnification for Revealing Subtle Changes in the World
Abstract
Our goal is to reveal temporal variations in videos that are difficult or impossible to see with the naked eye and display them in an indicative manner. Our method, which we call Eulerian Video Magnification, takes a standard video sequence as input, and applies spatial decomposition, followed by temporal filtering to the frames. The resulting signal is then amplified to reveal hidden information. Using our method, we are able to visualize the flow of blood as it fills the face and also to amplify and reveal small motions. Our technique can run in real time to show phenomena occurring at temporal frequencies selected by the user.
Eulerian Video Magnification code
Matlab code and executables implementing Eulerian video processing for amplifying color and motion changes.
Phase Based Video Motion Processing code
Matlab code implementing the new and improved phase-based motion magnification pipeline.
Learning-based Video Motion Magnification code
Tensorflow implementation of the learning-based motion magnification pipeline.
Videoscope
Web interface for motion and color magnification. Upload your videos and have them magnified!
Eulerian Video Magnification for Revealing Subtle Changes in the World
Abstract
Our goal is to reveal temporal variations in videos that are difficult or impossible to see with the naked eye and display them in an indicative manner. Our method, which we call Eulerian Video Magnification, takes a standard video sequence as input, and applies spatial decomposition, followed by temporal filtering to the frames. The resulting signal is then amplified to reveal hidden information. Using our method, we are able to visualize the flow of blood as it fills the face and also to amplify and reveal small motions. Our technique can run in real time to show phenomena occurring at temporal frequencies selected by the user.
Eulerian Video Magnification code
Matlab code and executables implementing Eulerian video processing for amplifying color and motion changes.
Phase Based Video Motion Processing code
Matlab code implementing the new and improved phase-based motion magnification pipeline.
Learning-based Video Motion Magnification code
Tensorflow implementation of the learning-based motion magnification pipeline.
Videoscope
Web interface for motion and color magnification. Upload your videos and have them magnified!