Users’ consumption of multimedia content grows exponentially in Internet, smart devices, social media, and other contexts. Multimedia Systems addresses technological issues for enabling and improving consumption, such as content delivery, adaptation, accessibility and personalization, multimedia for local networks, and others.

My research interests lie in the intersection of Machine Learning (ML) and Multimedia Systems (MMSys). I currently contribute to conferences and journals supported by the ACM SIG Multimedia by acting as chair, co-chair, and reviewer. I have published 50+ articles (160+ citations and h-index 7 at Google Scholar). I have built a strong background in the broadcast industry, where I have made impactful contributions to standardization committees (ITU-T SG16 and Brazilian TV Forum). Nowadays, my research focuses on using methods to improve MMSys. I have working methods to classify and segment videos and, more recently, to predict user behaviour in 360-degree videos to improve their streaming.

Multimedia Systems

Multimedia systems deals with the delivery of multimedia data in digital networks. A multimedia system infrastructure requires components such as protocols, services, middleware, and mechanisms to handle a well-defined quality of service (QoS).

Some of my contributions in the field are in TV middleware:

• 📄 Advances in Ginga middleware for TV 2.5 (pt-br)
• 📄 Interactive 360-degree Videos in Ginga-NCL Using Head-Mounted-Displays as Second Screen Devices
• 📄 Extending multimedia languages to support multimodal user interactions

For me, some important researchers in this field are: 🎓 Klara Nahrstedt 🎓 Christian Timmerer

Immersive Media

Immersive media research aims to make multimedia systems more natural and with higher QoE, especially by imitating the physical world through digital simulation. I particularly researched it through VR/360 video and multisensorial aspects.

Some of my contributions in the field are in 360 videos:

• 📄 Subjective Evaluation of 360-degree Sensory Experiences
• 📄 An Authoring Model for Interactive 360 Videos

For me, some important researchers in this field are: 🎓 Pablo Cesar, CWI, 🎓 Jesús Gutiérrez 🎓 Cornelius Hellge

Video Understanding

Video Understanding deals with how computers can gain high-level understanding from digital images or videos. Unlike Multimedia Systems’ aspects of delivery and feasibility, it aims to analyze multimedia data automatically. Usage scenarios are video retrieval and browsing, anomaly detection, and others.

Some of my contributions in the field are unsupervised video analysis:

• 📄 A Clustering-Based Method for Automatic Educational Video Recommendation Using Deep Face-Features of Lecturers
• 📄 Unsupervised method for video action segmentation through spatio-temporal and positional-encoded embeddings

For me, some important researchers in this field are: 🎓 Richard Szeliski 🎓 Shaogang Gong

Social Impact

I truly believe technology can be a vehicle for social impact, especially in multimedia. Today, multimedia/web/video data are spread and are useful for accessibility, governance transparency, minority inclusion, social justice/activism, etc.