Compression project >> Video Area Home

Algorithm, ideas: Dr. Dmitriy Vatolin
Algorithm, implementation: Sergey Grishin,
Kostya Strelnikov, Maxim Makhinya, Sergey Putilin

Interest in advanced interactivity with multimedia data significantly increased last years. This cause an advent of new standards proposing the functionality for manipulation with multimedia data (an example of such a standard is MPEG4). That is why segmentation algorithms find its application in wide range of areas including content-based representation of multimedia data, improvement of coding efficiency in video compression standards, sophisticated query and retrieval of video and other content-based functionalities for multimedia applications.

Our developed algorithm performs detection and tracking of foreground (FG) objects in video. This is done by calculation of global motion with further estimation of local motion. Detection of a FG object position is then performed based on the information about global and local motion. The principal advantage of the method is its ability to detect a FG object even in case of ultra slow motion which is not common for algorithms of this type. Another important advantages include:

• adjustable speed/quality trade-off
• several segmentation precision levels
• does not require manual segmentation

Examples

This section contains segmentation results of developed algorithm and its comparison with algorithm developed at University of Florida.

The first example (pic. 1, 2) demonstrates result obtained using 'dancer' test video sequence:

Pic.1 Original frame

Pic.2 Segmentation result

The second example (pic. 3, 4) shows result obtained using 'table tennis' test video sequence:

Pic.3 Original frame

Pic.4 Segmentation result

The next example (pic. 5, 6) shows segmentation result of 'bus' test video sequence:

Pic.5 Original frame

Pic.6 Segmentation result

Download

For commercial license of this filter please contact us via

Another resources

Video resources:

Public MSU video filters Here are available VirtualDub and AviSynth filters. Commonly we develop a whole family of some kind of a filter. Generally there are also versions optimized for PC and hardware implementations (ASIC/FPGA/DSP). These optimized versions can be licensed to companies. Please contact us for details via video(at)graphics.cs.msu_ru. MSU Cartoon Restore (New!) MSU Noise Estimation MSU Frame Rate Conversion MSU Image Restoration MSU Denoising (Top!) (New!) MSU Old Cinema MSU Deblocking (Top!) MSU Smart Brightness and Contrast (Top!) MSU Smart Sharpen (Top!) MSU Noise generation MSU Noise estimation MSU Motion Estimation Information MSU Subtitles removal MSU Logo removal (Top!) MSU Deflicker (Top!) MSU Field Shift Fixer AviSynth plug-in MSU StegoVideo MSU Cartoonizer (Top!) MSU SmartDeblocking (Top!) MSU Color Enhancement MSU Old Color Restoration MSU filters FAQ (Read me!) MSU filters statistics	MSU filters for companies We are working with Intel, Samsung, RealNetworks and other companies on adapting our filters other video processing algorithms for specific video streams, applications and hardware like TV-sets, graphics cards, etc. Some of such projects are non-exclusive. Also we have internal researches. Please let us know via video(at)graphics.cs.msu_ru if you are interested in acquiring a license for such filters or making a custom R&D project on video processing, compression, computer vision. Automatic Objects Segmentation Semiautomatic Objects Segmentation New Frame Rate Conversion New Deinterlacer MSU-Samsung Deinterlacing Project Digital TV Signal Enhancement Old Film Recovery Tuner TV Restore Panorama Video2Photo SuperResolution SuperPrecision MSU-Samsung image and video resampling MSU-Samsung Frame Rate Conversion Motion Phase filter Deshaker (video stabilization) Film Grain/Degrain filter Deblurring filter Video Content Search
Codecs comparisons Objective and subjective quality evaluation tests for video and image codecs Options Analysis of Codec x264 (New!) 4-th MPEG4-AVC/H.264 Comparison (Top!) Lossless Video Codecs Comparison 2007 3-rd MPEG4-AVC/H.264 Comparison HD Photo and JPEG 2000 Comparison MPEG-2 Decoders Crash Test (Top!) Subjective Compar. of 4 Modern Codecs (Top!) 2-nd MPEG-4 AVC/H.264 Comparison (Top!) FAQ of 2-nd H.264 Comparison 1-st MPEG-4 AVC/H.264 Codecs Comparison FAQ of 1-st H.264 Comparison JPEG 2000 Image Codecs Comparison (Top!) Lossless Video Codecs Comparison 2004 MPEG-4 SP/ASP Codecs Comparison (Top!) Video codecs comparison (old) Ext. link: x264 parameters efficiency comparison	Video quality metrics Programs with different objective and subjective video quality metrics implementation MSU Video Quality Metric - objective metrics for codecs and filters comparison (Top!) Implemented metrics short info: PSNR, Delta, MSAD, MSE, SSIM, VQM, MSU Blurring, MSU Blocking MSU Brightness Flicking Metric MSU Brightness Independent PSNR MSU Drop Frame Metric MSU Noise Estimation Metric MSU VQM Metric Tool FAQ MSU Human Perceptual Quality Metric - several metrics for exact visual tests (Top!) Implemented metrics short info: ITU-R BT.500-11: DSIS, DSCQS I & II, SCACJ; EBU: SAMVIQ; MSUCQE MSU PVQ Metric Tool FAQ
Video codecs projects Different research and development projects on video codecs MSU Lossless Video Codec (Top!) MSU Screen Capture Lossless Codec (Top!) MSU MPEG-2 Video Codec x264 Codec Improvement	Other Other information Crazy gallery (filters screams :) License for commercial usage of MSU VideoGroup Public Software (please be careful: some soft like metrics has another license!)

Bookmark this page:   Add to Del.icio.us     Digg It     reddit
 

Last updated: 12-October-2007

---

Search (Russian): Server size: 7629 files, 938Mb (Server statistics)

Project updated by
Server Team and MSU Video Group

Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab