Immersive videoconferences have added a new dimension to remote collaboration by bringing participants together in a common virtual space. To achieve this, the conferencing system must extract in real-time the foreground from each incoming video stream and translate it into the shared virtual space. The method presented in this paper differentiates itself in the sense that no prior training or assumptions on the video content are used during foreground extraction. A temporally coherent mask is created based on motion cues obtained from the video stream and is used to provide a set of hard constraints. Based on these constraints, a graph cut algorithm is employed to produce the pixelaccurate foreground segmentation. The obtained results are evaluated using a state-of-the-art perceptual metric to provide an objective assessment of the method accuracy and reliability. Furthermore, the presented approach makes use of parallel execution in order to achieve real-time processing capabilities.
Foreground extraction, videoconference, optical flow, graph cut, motion segmentation, real-time video processing.
Mihai FĂGĂDAR-COSMA, Marwen NOURI, Vladimir-Ioan CREŢU, Mihai Victor MICEA, "A Combined Optical Flow and Graph Cut Approach for Foreground Extraction in Videoconference Applications", Studies in Informatics and Control, ISSN 1220-1766, vol. 21(4), pp. 413-422, 2012. https://doi.org/10.24846/v21i4y201207
All articles published by Studies in Informatics and Control (SIC) are published in accordance with the terms and conditions of the Creative Commons Attribution License (CC BY-NC-SA 4.0).