Multimodality

Given a Sarcastic post (image and text), we aim at converting it into the intended meaning of the user by producing a textual description explaining the sarcasm in the given sarcastic post

We are working to generate text summary of conference paper presentation videos using visual, acoustic and textual modalities

Given an Internet Meme, we aim to understand the emotion and sentiment expressed by it, using the meme text and corresponding image