Trisha Mittal

I am a Senior Computer Vision Research Engineer at Dolby Laboratories.

I finished my PhD in Computer Science from University of Maryland, College Park. I was a member of the GAMMA Lab and was advised by Prof. Dinesh Manocha. My PhD dissertation studied studied Affective Computing and is titled Towards Multimodal and Context-Aware Emotion Perception.

Prior to this, I graduated with a Bachelor of Technology (B.Tech) and a Master of Technology (M.Tech) in Information Technology from International Institute of Information Technology, Bangalore (IIIT-B), India. This was a five-year dual-degree undergraduate program (August 2013 - July 2018).

More recently, I have started writing articles for Skynet Today and Last Week in AI . Following are some of my recent articles.


Latest News

Scholarships and Awards

2022 Finalist for UMD Innovation of the Year Award, 2022 by Innovate UMD for our
work on DeepFake Detection.
2022 Selected for the Outstanding Research Assistant Award for AY 2021-22 by The
Graduate School.
2022 Awarded the Adobe Research Fellowship Award for 2022.
2021 Selected and Invited to participate in the Rising Stars 2021 EECS Workshop. An
Academic Career Workshop for Women, hosted virtually at MIT (October’21).
2021 Selected for attending CRA Grad Cohort for Women (held virtually).
2021 Selected and Funded by Iribe Initiative for Diversity and Inclusion in Computing for
attending Grace Hopper Celebration in Orlando, Florida, USA (held virtually).
2021 Finalist for UMD Innovation of the Year Award, 2021 by Innovate UMD for our
work on Multimodal and Context-Aware Emotion Perception.
2020 Selected and Funded by Iribe Initiative for Diversity and Inclusion in Computing for
attending Grace Hopper Celebration in Orlando, Florida, USA (held virtually).
2019 Selected and Funded by Iribe Initiative for Diversity and Inclusion in Computing for
attending Grace Hopper Celebration in Orlando, Florida, USA.
2017 Selected for The Cornell, Maryland, Max Planck Pre-doctoral Research School
(CMMRS) 2017.
2014 Named in Director’s Merit List for semester Fall 2013 and Spring 2018 in International
Institute of information Technology, Bangalore.
2009 National Talent Search Examination (NTSE) Scholarship awarded by National
Council of Education Research and Training (NCERT), India.

Publications

2024

S2MGen: A Synthetic Skin Mask Generator for Improving Segmentation

Dolby Laboratories, Inc.

Subhadra Gopalakrishnan, Trisha Mittal, Jaclyn Pytlarz, Yuheng Zhao

Synthetic Data for Computer Vision Workshop@ CVPR 2024

Towards Determining Perceived Human Intent for Multimodal Social Media Posts using The Theory of Reasoned Action

University of Maryland, College Park, USA

Trisha Mittal, Sanjoy Chowdhury, Pooja Guhan, Snikhita Chelluri, Dinesh Manocha

Nature Scientific Reports 2024.

2023

Naturalistic Head Motion Generation from Speech

Apple AIML, Cupertino, USA (Summer'22 Intern Work)

Trisha Mittal*, Zakaria Aldeneh*, Masha Fedzechkina*, Anurag Ranjan, Barry-John Theobald

ICASSP 2023

Video Manipulations Beyond Faces: A Dataset with Human-Machine Analysis

Adobe Research, San Jose, USA and University of Maryland, College Park, USA

Trisha Mittal, Ritwik Sinha, Viswanathan Swaminathan, John Collomosse, Dinesh Manocha

WACV-W 2023 (Oral), In Workshop on Manipulation, Adversarial, and Presentation Attacks in Biometrics (MAPA).

2022

3MASSIV: Multilingual, Multimodal and Multi-Aspect dataset of Social Media Short Videos

Sharechat, India and University of Maryland, College Park, USA

Vikram Gupta*, Trisha Mittal*, Puneet Mathur, Vaibhav Mishra, Mayank Maheshwari, Aniket Bera, Debdoot Mukherjee, Dinesh Manocha

CVPR 2022 (Poster)

2021

BOhance: Bayesian Optimization for Content Enhancement

Adobe Research, San Jose and University of Maryland, College Park, USA

Trisha Mittal, Vishy Swaminathan, Somdeb Sarkhel, Ritwik Sinha, David Arbour, Saayan Mitra, Dinesh Manocha

ISM 2021 (Oral)

Multimodal and Context-Aware Emotion Perception Model with Multiplicative Fusion

University of Maryland, College Park, USA

Trisha Mittal, Aniket Bera, Dinesh Manocha

IEEE Multimedia 2021

Affect2MM: Affective Analysis of Multimedia Content Using Emotion Causality

University of Maryland, College Park, USA

Trisha Mittal, Puneet Mathur, Aniket Bera, Dinesh Manocha

CVPR 2021 (Poster)

2020

Emotion's Don't Lie: A DeepFake Detection Method using Audio-Visual Affective Cues

University of Maryland, College Park, USA

Trisha Mittal, Uttaran Bhattacharya, Rohan Chandra, Aniket Bera, Dinesh Manocha

ACM MM 2020 (Poster)

EmotiCon: Context-Aware Multimodal Emotion Recognition using Frege's Principle

University of Maryland, College Park, USA

Trisha Mittal, Pooja Guhan, Uttaran Bhattacharya, Rohan Chandra, Aniket Bera, Dinesh Manocha

CVPR 2020 (Poster)

M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues

University of Maryland, College Park, USA

Trisha Mittal, Uttaran Bhattacharya, Rohan Chandra, Aniket Bera, Dinesh Manocha

AAAI 2020 (Oral)

Take an Emotion Walk: Perceiving Emotions from Gaits Using Hierarchical Attention Pooling and Affective Mapping

University of Maryland, College Park, USA

Uttaran Bhattacharya, Christian Roncal, Trisha Mittal, Rohan Chandra, Kyra Kapsaskis, Kurt Gray, Aniket Bera, Dinesh Manocha

ECCV 2020 (Poster)

STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits

University of Maryland, College Park, USA

Uttaran Bhattacharya, Trisha Mittal, Rohan Chandra, Tanmay Randhavane, Aniket Bera, Dinesh Manocha

ECCV 2020 (Poster)

CMetric: A Driving Behavior Measure using Centrality Functions

University of Maryland, College Park, USA

Rohan Chandra, Uttaran Bhattacharya, Trisha Mittal, Aniket Bera, Dinesh Manocha

IROS 2020 (Oral)

Generating Emotive Gaits for Virtual Agents Using Affect-Based Autoregression

University of Maryland, College Park, USA

Uttaran Bhattacharya, Nicholas Rewkowski, Pooja Guhan, Nial L. Williams, Trisha Mittal, Aniket Bera, Dinesh Manocha

ISMAR 2020

GraphRQI: Classifying Driver Behaviors Using Graph Spectrums

University of Maryland, College Park, USA

Rohan Chandra, Uttaran Bhattacharya, Trisha Mittal, Aniket Bera, Dinesh Manocha

ICRA 2020

Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMs

University of Maryland, College Park, USA

Rohan Chandra, Tianrui Guan, Srujan Panuganti, Uttaran Bhattacharya, Trisha Mittal, Aniket Bera, Dinesh Manocha

IROS/RAL 2020

2018

Assisted Inverse Reinforcement Learning

MPI, Saarbrucken, Germany

P. Kamalaruban, R. Devidze, T. Yeo, T. Mittal, V. Cevher, A. Singla

NeurIPS'18, 2018 In Learning by Instruction Workshop

Pictionary-style Word Guessing on Hand-drawn Object Sketches: Dataset, Analysis and Deep Network Models

IISc Bangalore, India

Ravi Kiran Sarvadevbatla, Shiv Surya, Trisha Mittal, Venkatesh Babu Radhakrishnan

AAAI18 (Poster)
In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018

2016

A Logo-Based Approach for Recognising Multiple Products on a Shelf

IIIT Bangalore, India

Trisha Mittal, B. Laasya, and J. Dinesh Babu

SAI Intellisys 2016 (Oral)

Internships

Machine Learning Research Intern at Apple AI/ML, Cupertino.

Multimedia Systems Research Intern at Adobe Research, San Jose (Converted to a Remote Internship).

Data Science Research Intern at Adobe Research, San Jose (Converted to a Remote Internship).

Extended part-time through Fall 2020 and Spring 2021.

Visiting Research Fellow at Max-Planck Institute for Software Systems, Saarbrucken, Germany

Interned under Prof. Adish Singla and worked on problems at the intersection of Inverse Reinforcement Learning and Machine Teaching.

Intern at Video Analytics Lab, Indian Institute of Science, Bangalore, India.

Guided by Prof. Venkatesh Babu in an attempt to train a RL agent to be able to draw sketches.

Intern at Video Analytics Lab, Indian Institute of Science, Bangalore, India.

Guided by Prof. Venkatesh Babu and worked with Ravikiran Sarvadevbatla and Shiv Surya to develop computational models for Pictionary-style word guessing.

Selected Coursework

Graduate Coursework
(University of Maryland, College Park, USA)		 Undergraduate Coursework
(IIIT Bangalore, India)
Fall 2018 Fall 2019 August 2013 - May 2018
CMSC 828D: Interactive Data Analytics
(Prof. Leilani Battle)		 CMSC 726: Machine Learning
(Prof. Soheil Feizi)		 CS/DS 704 Multi-Agent Systems
(Prof. Srinath Srinivasa)
CMSC 723: Computational Linguistics I
(Prof. Jordan Boyd-Graber)		 CMSC 828I: Visual Recognition and Learning
(Prof. Abhinav Shrivastava)		 CS 551 Introduction to Automata Theory & Computability
(Prof. Shrisha Rao)
CMSC 798: Independent Research Project
(Prof. Dinesh Manocha)		 CS/DS 812 Foundations of Big Data Algorithms
(Prof. G Srinivasaraghavan)
Spring 2019 Spring 2020 CS/DS 864 Machine Learning
(Prof. G Srinivasaraghavan)
CMSC 818N: Robotics
(Prof. Dinesh Manocha)		 CMSC 838J: Interactive Technologies in HCI
(Prof. Huaishu Peng)		 DS/NC 866 Advanced Machine Perception
(Prof. Dinesh Babu Jayagopi)
CMSC 764: Advanced Numerical Optimization
(Prof. Tom Goldstein)		 Fall 2020 CS 606 Computer Graphics
(Prof. Jaya Nair and Prof. T K Srikanth)
CMSC 798: Independent Research Project
(Prof. Dinesh Manocha)		 CMSC 828W: Foundations of DL
(Prof. Soheil Feizi)		 DS/NC 821 Automatic Speech Recognition
Prof. V Ramasubramanian

Professional Services

ACM MM 2021, ACM MM 2022, AAAI 2023, CVPR 2021, CVPR 2022, CVPR 2023, ECCV 2022, ICASSP 2023, ICCV 2021, WACV 2023, ICRA 2021

EURASIP 2021, PeerJ Computer Science 2021, PeerJ Computer Science 2023, IEEE Transactions on Affective Computing 2021, RA-L 2020, IEEE MM-CS 2021

GHC 2019, AAAI 2020, GHC 2022

Teaching

Project Co-lead at AI4ALL UMD Camp

Led a 2 week long project on 'Sentiment Analysis of Twitter Data' for 5-6 high school students. Introduced them to various aspects of Machine Learning and Artificial Intelligence.

University of Maryland, College Park

Supervision: Prof. Dinesh Manocha

Girls Who Code, UMD Chapter

Volunteered as a Python TA for the semester for the UMD Chapter of Girls Who Code.

University of Maryland, College Park

CMSC 250

Led a Discussion session of 30 students twice a week covering concepts and discussing questions. Also, hold office hours 4 hrs every week.

University of Maryland, College Park

Course Instructor: Prof. Clyde Kruskal

CMSC 250

Led a Discussion session of 40 students twice a week covering concepts and discussing questions. Also, held office hours 4 hrs every week.

University of Maryland, College Park

Course Instructor: Jason Filippou

Random