studyfang AT gmail.com Redmond, Washington
Yuwei Fang
I am a Senior Research Scientist in the Creative Vision Team at Snap Inc. Previously, I was a Senior Applied Scientist from Knowledge and Language Team at Microsoft. My research interests are in Multimodal Learning and NLP. I am particularly interested in how to build a unified system that can ground and reason on diversified external world knowledge, to realize multilingual human machine communication. My recent work has focused on
- Multi-modal Learning ( Fang et al., arxiv 2023; Yang et al., arxiv 2023; Tang et al., CVPR 2023; Yang et al., AAAI 2023)
- Knowledge-based Language Learning (Fang et al., ACL 2022; Yu et al., ACL 2022; Wang et al., ACL 2022; Yu et al., ACL 2022;
[Google Scholar] [LinkedIn] [Github] [Twitter]
Publications
-
Unifying Vision, Text, and Layout for Universal Document Processing
Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal
In The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2023.
[PDF] [Code] -
MACSum: Controllable Summarization with Mixed Attributes
Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang
In Transactions of the Association for Computational Linguistics (TACL) , 2023.
[PDF] [Code] -
i-Code: An Integrative and Composable Multimodal Learning Framework
Ziyi Yang*, Yuwei Fang*, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao,
Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Yuan Lu, Takuya Yoshioka, Michael Zeng, Xuedong Huang
In Proc. American Association of Artificial Intelligence (AAAI) , 2023.
[PDF] -
Retrieval Augmentation for Commonsense Reasoning: A Unified Approach
Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang
In Conf. on Empirical Methods in Natural Language Processing (EMNLP) , 2022.
[PDF] [Code] [Leaderboard] -
Task Compass: Scaling Multi-task Pre-training with Task Prefix
Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng
In Findings of Conf. on Empirical Methods in Natural Language Processing (EMNLP) , 2022.
[PDF] -
Leveraging Knowledge in Multilingual Commonsense Reasoning
Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng
In Findings of Association for Computational Linguistics (Findings of ACL) , 2022.
[PDF] [Leaderboard] -
Training data is more valuable than you think: A simple and effective method by retrieving from training data
Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng
In Association for Computational Linguistics (ACL) , 2022.
[PDF] [Code] -
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng
In Association for Computational Linguistics (ACL) , 2022.
[PDF] -
Dict-BERT: Enhancing Language Model Pre-training with Dictionary
Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang
In Findings of Association for Computational Linguistics (Findings of ACL) , 2022.
[PDF] [Code] -
RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling
Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
In Proc. American Association of Artificial Intelligence (AAAI) , 2022.
[PDF] [Code] -
FILTER: An enhanced fusion method for cross-lingual language understanding
Yuwei Fang*, Shuohang Wang*, Zhe Gan, Siqi Sun, Jingjing Liu
In Proc. American Association of Artificial Intelligence (AAAI) , 2021.
[PDF] [Code] [Leaderboard] -
LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval
Siqi Sun, Yen-Chun Chen, Linjie Li, Shuohang Wang, Yuwei Fang, Jingjing Liu
In Conf. on North American Chapter of the Association for Computational Linguistics (NAACL) , 2021.
[PDF] [Code] -
Cluster-former: Clustering-based sparse transformer for long-range dependency encoding
Shuohang Wang, Luowei Zhou, Zhe Gan, Yen-Chun Chen, Yuwei Fang, Siqi Sun, Yu Cheng, Jingjing Liu
In Findings of Association for Computational Linguistics (Findings of ACL) , 2021.
[PDF] [Leaderboard] -
Hierarchical graph network for multi-hop question answering
Yuwei Fang, Siqi Sun, Zhe Gan, Rohit Pillai, Shuohang Wang, Jingjing Liu
In Conf. on Empirical Methods in Natural Language Processing (EMNLP) , 2020.
[PDF] [Code] [Leaderboard] -
Cross-Thought for Sentence Encoder Pre-training
Shuohang Wang, Yuwei Fang, Siqi Sun, Zhe Gan, Yu Cheng, Jing Jiang, Jingjing Liu
In Conf. on Empirical Methods in Natural Language Processing (EMNLP) , 2020.
[PDF] [Code] -
Contrastive Distillation on Intermediate Representations for Language Model Compression
Siqi Sun, Zhe Gan, Yu Cheng, Yuwei Fang, Shuohang Wang, Jingjing Liu
In Conf. on Empirical Methods in Natural Language Processing (EMNLP) , 2020.
[PDF] [Code]
Miscellany
- In my free time, I like staying with my family and outside activities.