Title: Neural Network Design for Multimedia: Bio-inspired and Hardware-friendly
Presenter: Shuicheng YAN, Yitu Tech
Date: 13 October 2020, 13:00 - 14:00 (UTC)
Abstract: Neural network architecture design is playing the most important role in recent fast development of multimedia technology. In this talk, I mainly introduce the research and development efforts in designing neural networks from two orthogonal lines: 1) how these neural network models are bio-inspired, e.g. the 1x1 convolution simulates the function of cell-body of a neuron, and 2) how these models are more hardware-friendly or motivating the next-generation of AI chips, e.g. the selective convolution is expecting new design of hardware. These two lines of efforts are collaboratively enhancing the overall efficiency of multimedia systems.
Bio: Dr. Yan Shuicheng is currently CTO of YITU Tech, and was previously faculty member at National University of Singapore. He is Fellow of Academy of Engineering, Singapore, IEEE Fellow, and IAPR Fellow. His research areas include multimedia analysis, computer vision, and machine learning. He has published over 600 papers with H-index 108, and is among the “Highly-cited Researcher” list in 2014, 2015, 2016, 2018 and 2019. Dr. Yan’s team has received winner or honorable-mention prizes for 10 times in two core computer vision competitions, Pascal VOC and ImageNet (ILSVRC), and particularly among the winners of the last-runs of both. Also his team won over 10 best paper/demo or best student paper prizes, and particularly ACM MM Best Paper Award twice, Best Student Paper Award twice and Best Demo Award once.
Title: 360-Video Navigation for 360-Multimedia Delivery Systems: Research Challenges and Opportunities
Presenter: Klara Nahrstedt, University of Illinois at Urbana-Champaign
Date: 15 October 2020, 13:00 - 14:00 (UTC)
Abstract: With the emergence of new 360-degree cameras, ambisonic microphones, and VR/AR display devices, more diverse multi- modal content has become available, and with it the demand for the capability of streaming 360-degree videos to enhance users’ 360-multimedia experience on mobile devices such as mobile phones and head-mounted displays. The big issue for the mobile 360-multimedia delivery systems is the huge resource demand on the underlying networks and devices to deliver 360-multimedia content with high quality of experience.
In this talk, we will discuss the research challenges of 360-degree video delivery systems such as the large bandwidth, low latency, users’ disorientation, and cyber-sickness, and opportunities to solve these challenges including rate adaptation algorithms of tiles videos, view prediction algorithms, content navigation, enhancement of DASH streaming for 360-videos, and control of Quality of Experience (QoE).
We will briefly dive into more details of the concept of navigation graphs for 360-degree videos and present the opportunity of navigation graphs to organize 360-video content that can help in viewing navigation, caching and improvements of QoE. We will show how navigation graphs are serving as models for viewing behaviors in the temporal and spatial domains, and can assist with view predictions, bandwidth, and latency control. Our experimental results are encouraging and support the intuition that if we can encapsulate viewing patterns of 360-degree videos into navigation graphs at multiple levels of contextual details, we will be able to stream “need-to-see” 360-content to wireless HMD devices in timely manner within bandwidth-constrained environments, and enhance viewing quality experience of 360- degree videos in augmented reality applications.
Bio: Klara Nahrstedt is the Ralph and Catherine Fisher Professor in the Department of Computer Science Department, and Direct of Coordinated Science Laboratory in the Grainger College of Engineering at the University of Illinois at Urbana- Champaign. Her research interests are directed towards tele-immersive systems, mixed reality video 360 systems, Internet-of-Things systems, and real-time security and privacy in cyber-physical systems such as power-grid. She is the co-author of multimedia books “Multimedia Computing, Communications and Applications”, published by Prentice Hall, and “Multimedia Systems”, published by Springer Verlag. She is the recipient of the IEEE Communication Society Leonard Abraham Award for Research Achievements, Humboldt Research Award, IEEE Computer Society Technical Achievement Award, ACM SIGMM Technical Achievement Award, TU Darmstadt Piloty Prize, and the Grainger College of Engineering Drucker Award. She served as the chair of the ACM SIGMM between 2007-2013, and co-chaired many conferences including ACM International Conference on Multimedia, IEEE Percom, ACM/IEEE IOTDI, IEEE SmartGridComm, and others. Klara Nahrstedt received her Diploma in Mathematics from Humboldt University zu Berlin in 1985, and PhD in Computer and Information Science from University of Pennsylvania in 1995. She is Fellow of ACM, IEEE and AAAS, and member of the German National Academy of Sciences (Leopoldina Society).