mWhisper-Flamingo for Multilingual Audio-Visual Noise-Robust Speech Recognition
- Andrew Rouditchenko
- Samuel Thomas
- et al.
- 2025
- IEEE SPL
Paper
Publications
12 results for James Glass
What When and Where? Self-Supervised Spatio Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions
- Brian Chen
- Nina Shvetsova
- et al.
- 2024
- CVPR 2024
Conference paperAudio-Visual Neural Syntax Acquisition
- Cheng-I Jeff Lai
- Freda Shi
- et al.
- 2023
- ASRU 2023
Conference paperComparison of Multilingual Self-Supervised and Weakly-Supervised Speech Pre-Training for Adaptation to Unseen Languages
- Andrew Rouditchenko
- Sameer Khurana
- et al.
- 2023
- INTERSPEECH 2023
Conference paperWhisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggers
- Yuan Gong
- Sameer Khurana
- et al.
- 2023
- INTERSPEECH 2023
Conference paperC2KD: Cross-Lingual Cross-Modal Knowledge Distillation for Multilingual Text-Video Retrieval
- Andrew Rouditchenko
- Yung-Sung Chuang
- et al.
- 2023
- ICASSP 2023
Conference paperDiffCSE: Difference-based Contrastive Learning for Sentence Embeddings
- Yung-Sung Chuang
- Rumen Dangovski
- et al.
- 2022
- NAACL 2022
Conference paperEverything at Once - Multi-modal Fusion Transformer for Video Retrieval
- Nina Shvetsova
- Brian Chen
- et al.
- 2022
- CVPR 2022
Conference paperPARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition
- Cheng-I Jeff Lai
- Yang Zhang
- et al.
- 2021
- NeurIPS 2021
Conference paperAVLnet: Learning audio-visual language representations from instructional videos
- Andrew Rouditchenko
- Angie Boggust
- et al.
- 2021
- INTERSPEECH 2021
Conference paper