Jingteng Xue
Davis Hall 308A, University at Buffalo
Amherst, NY 12660
TEL: (716) 645-4768
jingteng-at-buffalo-dot-edu Resume
Educational Background
-
Ph.D., Computer Science and Engineering, the State University of New York at Buffalo, Buffalo NY, 2014 (expected)
- M.S. and B.S., School of Information Science and Engineering, Southeast University, Nanjing China, 2009, 2005
Research Interest
Jingteng's work is mainly in the field of QoE (Quality of Experience) analysis and enhancement for popular and trending video applications. His study involves mobile video viewing, video watermarking, HTTP adaptive streaming and stereo 3D video, etc. He is broadly interested in the areas of multimedia technology, including digital image/video coding and and processing, computer vision, and video streaming, etc.
Projects
Different from television and monitor watching, the viewing of mobile displays is significantly influenced by the surrounding environment of the wireless device.
It is our interest to quantize and utilize such viewing contexts.
First, the viewing factors (display device size, ambient luminance, motion of viewer) are enumerated. Their influence on video viewing is measured by subjective test and modeled. Based on the result, a quality metric (MJND) is derived to estimate visual quality of a video content under a certain environment. The validation result shows the proposed model accurately predicts MOS (subjective quality) with busy context (PCC > 0.9). In addition, a video transcoding approach is proposed to dynamically tailor video bitstream to optimize the viewing quality according to the viewing environment. We implemented a transcoder for H.264. Based on the preliminary results, the transcoding can save up to 30% bitrate for users in a busy context. We also propose to apply such transcoder in multi user resource allocation.
Video watermarking is a powerful and important tool in content protection systems. The invisible yet robust watermark protects video content from illegal distribution. However the injection of watermark may cause visual artifacts or complex computation that removes such artifacts. We propose a novel watermarking scheme based on a topology sort of the proposed coding prediction dependency graph. In this way, the embedding process of watermark can minimize error propagation compensation and therefore cost very light computation. In addition, the proposed approach optimizes viewing quality since the visibility of prediction error is minimized. Besides watermarking, the dependency graph and the topology sort based macro block selection is useful in many applications.
Depth-image-based rendering (DIBR) is a popular 3D video viewing approach. In color-plus-depth format, the depth information can be either measured by IR sensors or derived from stereo-pair images by computer vision algorithms but the depth acquisition/estimation and coding process is error-prone. The displacement distortion of depth, especially the misalignment around the object edges, may cause ghosting and flickering during 3D playback. In order to improve perception quality, we propose to estimate the depth map quality and detect the potential problematic depth information by matching co-located feature points in texture and depth image. The misaligned depth is reported for correction and further processing.
Publications
- Jingteng Xue, Jun Tian, Heather Yu, and Chang Wen Chen, " A Fast H.264 Compressed Domain Watermarking Scheme with Minimized Propagation Error Based on Macro-block Dependency Analysis, " IEEE International Conference on Image Processing, Orlando, 2012.
- Jingteng Xue and Chang Wen Chen, " A Study on Perception of Mobile Video with Surrounding Contextual Influences, " IEEE International Workshop on Quality of Multimedia Experience, Yarra Valley, Australia, 2012.
- Jingteng Xue and Chang Wen Chen, " Mobile JND: Environment Adapted Perceptual Model and Mobile Video Quality Enhancement, " ACM Multimedia Systems in Chapel Hill, NC, 2012.
- Jingteng Xue and Chang Wen Chen, " Towards Viewing Quality Optimized Video Adaptation, " IEEE International Conference on Multimedia and Expo in Barcelona, Spain, 2011.
- Jingteng Xue and Chang Wen Chen, " A New Perceptual Quality Metric for Video Transrating for Mobile Devices, " ACM Multimedia Workshop on Mobile Cloud Media Computing in Firenze, Italy, 2010.
- Jingteng Xue and Chang Wen Chen, " Assessing Quality of Experience for Adaptive HTTP Video Streaming, " ICME Workshop on Emerging Multimedia Systems and Applications, 2014
Courses