Recently, there has been an increasing demand of the ultra-high-definition (UHD) video services. The UHD video, which provides a realistic viewing experience with high volume of data, is revolutionizing the video ecosystem and driving the upgrade of the information industry. In this context, the contradiction between the exponential growth of ultra-high-definition video big data and limited storage space as well as transmission bandwidth has become increasingly prominent. In view of these challenges, the joint video experts team from ITU-T and MPEG has launched the project of next generation video coding standard-versatile video coding (VVC). In VVC, new coding structures and a set of coding tools are adopted, which significantly boost the coding performance compared to the previous HEVC standard. Along with the standardization process, it is urgent and important to study the encoder optimization algorithms, which not only facilitate the implementation and deployment of the VVC standard in the future, but also provide useful information and guidance for the standardization process. In this project, we will systematically study the VVC encoder optimization from the perspectives of high efficiency rate control and low complexity encoding by leveraging the artificial intelligence technologies. In particular, we first study the rate-distortion characteristics of UHD videos in VVC to regularize the coding bit rate. More specifically, the rate-quantization and distortion-quantization relationships are investigated with the new coding structure that incorporates both quadtree-binary tree as well as triple tree partitioning, and the intelligent rate control is achieved based on the recent development of reinforcement learning. As such, the number of coding bits for each frame and CTU is optimized to achieve high efficiency rate control. Furthermore, we extend the rate-distortion modeling to the joint rate-distortion-complexity (RDC) optimization of VVC codec, aiming to achieve a good trade-off between rate-distortion performance and encoding complexity for low complexity encoding. In particular, by modelling the relationship between them with the advanced machine learning techniques, the encoder structure can be determined in the complexity constrained scenario.
Academic Discipline of the Research Project
Video Coding, Machine Learning
Academic Discipline (specifically) in Chinese
0810 信息與通信工程
Is this an inter-disciplinary project ?
No
Discipline 1)
---
Academic Discipline (specifically) in Chinese
---
Discipline 2)
---
Academic Discipline (specifically) in Chinese
---
Special Requirement for the Postdoctoral Fellow Candidates(if any)
Nil
Academic Qualifications
PhD.
Professional Accomplishments, Honors, Awards and Patents
IEEE Fellow
Are you a member of the Society of Hong Kong Scholars?
Yes
Research direction and research fund
Major Research Interests
Video Coding
Number of Current PhD Students
7
Number of PhD Trained
around 15
Number of Postdoctoral Fellows Supervised
1
Active Research Grants in the Capacity of PI
9610429
A Big Video Data Analytics
APRC
01/02/2019 - 31/01/2021
$300,000.00
9680191
Advanced Video Coding Techniques for HEVC
MFPRC
01/01/2017 - 31/12/2020
$135,690.00
9678145
Future Developments For Video Coding
MF_EXT
01/09/2017 - 31/08/2020
$222,067.00
9042816
Intelligent Ultra High Definition Video Encoder Optimization for Future Versatile Video Coding
GRF
01/01/2020 - 31/12/2022
$404,082.00
9042489
Learning-based Complexity Control for High Efficiency Video Coding and Beyond
GRF
01/01/2018 - 30/06/2020
$350,000.00
9042322
Multiclass Classification for Effective Mode Decision in High Efficiency Video Coding and Beyond
GRF
01/01/2017 - 30/06/2020
$709,429.00