Users’ consumption of multimedia content grows exponentially in the Internet, smart devices, social media, and other contexts. Multimedia Systems addresses technological issues for enabling and improving consumption, such as content delivery, adaptation, accessibility and personalisation, and others. See some aspects of my multimedia research below.

Multimedia Systems

Multimedia systems deal with the delivery of multimedia data in digital networks. A multimedia system infrastructure requires components such as protocols, services, middleware, and mechanisms to handle a well-defined quality of service (QoS).

Some of my contributions in the field are in TV middleware:

• 📄 Advances in Ginga middleware for TV 2.5 (pt-br)
• 📄 Interactive 360-degree Videos in Ginga-NCL Using Head-Mounted-Displays as Second Screen Devices
• 📄 Extending multimedia languages to support multimodal user interactions

For me, some important researchers in this field are: 🎓 Klara Nahrstedt 🎓 Christian Timmerer

Immersive Media

Immersive media research aims to make multimedia systems more natural and with higher QoE, especially by imitating the physical world through digital simulation. I particularly researched it through VR/360 video and multisensorial aspects.

Some of my contributions in the field are in 360 videos:

• 📄 Subjective Evaluation of 360-degree Sensory Experiences
• 📄 An Authoring Model for Interactive 360 Videos

For me, some important researchers in this field are: 🎓 Pablo Cesar, CWI, 🎓 Jesús Gutiérrez 🎓 Cornelius Hellge

Video Understanding

Video Understanding deals with how computers can gain high-level understanding from digital images or videos. Unlike Multimedia Systems’ aspects of delivery and feasibility, it aims to analyse multimedia data automatically. Usage scenarios are video retrieval and browsing, anomaly detection, and others.

Some of my contributions in the field are unsupervised video analysis:

• 📄 A Clustering-Based Method for Automatic Educational Video Recommendation Using Deep Face-Features of Lecturers
• 📄 Unsupervised method for video action segmentation through spatiotemporal and positional-encoded embeddings

For me, some important researchers in this field are: 🎓 Richard Szeliski 🎓 Shaogang Gong

Social Impact

I truly believe technology can be a vehicle for social impact, especially in multimedia. Today, multimedia/web/video data are spread and are useful for accessibility, governance transparency, minority inclusion, social justice/activism, etc.