Fandong Meng (孟凡东)

Personal Information

He is a principal researcher and team leader at WeChat, Tencent Inc, China.

He got his Ph.D. degree at Institute of Computing Technology, Chinese Academy of Sciences.

His research interests include machine translation, natural language processing and large language modeling.

E-mail: fandongmeng [at] tencent [dot] com

News

Publications

Recent Preprints

• Meiqi Chen, Fandong Meng, Yingxue Zhang, Yan Zhang and Jie Zhou. CRAT: A Multi-Agent Framework for Causality-Enhanced Reflective and Retrieval-Augmented Translation with Large Language Models. [arxiv]
• Yuxian Gu, Hao Zhou, Fandong Meng, Jie Zhou and Minlie Huang. MiniPLM: Knowledge Distillation for Pre-Training Language Models. [arxiv]
• Xiangyu Hong, Che Jiang, Biqing Qi, Fandong Meng, Mo Yu, Bowen Zhou and Jie Zhou. On the token distance modeling ability of higher RoPE attention dimension. [arxiv]
• Chao Hu, Yitian Chai, Hao Zhou, Fandong Meng, Jie Zhou and Xiaodong Gu. How Effectively Do Code Language Models Understand Poor-Readability Code?. [paper]
• Yutong Wang, Jiali Zeng, Xuebo Liu, Derek F. Wong, Fandong Meng, Jie Zhou and Min Zhang. DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory. [arxiv]
• Zhibin Lan, Liqiang Niu, Fandong Meng, Wenbo Li, Jie Zhou and Jinsong Su. AVG-LLaVA: A Large Multimodal Model with Adaptive Visual Granularity. [arxiv]
• Wenchao Chen, Liqiang Niu, Ziyao Lu, Fandong Meng and Jie Zhou. MaskMamba: A Hybrid Mamba-Transformer Model for Masked Image Generation. [arxiv]
• Chenze Shao, Fandong Meng and Jie Zhou. Patch-Level Training for Large Language Models. [arxiv]
• Xue Zhang, Yunlong Liang, Fandong Meng, Songming Zhang, Yufeng Chen, Jinan Xu and Jie Zhou. Multilingual Knowledge Editing with Language-Agnostic Factual Neurons. [arxiv]
• Zhen Yang, Yingxue Zhang, Fandong Meng and Jie Zhou. TEAL: Tokenize and Embed ALL for Multi-modal Large Language Models. [arxiv]
• Yun Luo, Zhen Yang, Fandong Meng, Yafu Li, Jie Zhou and Yue Zhang. An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning. [arxiv]
• Yi Liu, Lianzhe Huang, Shicheng Li, Sishuo Chen, Hao Zhou, Fandong Meng, Jie Zhou and Xu Sun. RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledge. [arxiv]
• Yijie Chen, Yijin Liu, Fandong Meng, Yufeng Chen, Jinan Xu and Jie Zhou. Improving Translation Faithfulness of Large Language Models via Augmenting Instructions. [arxiv]

Recent Publications

• Yucheng Ding, Yangwenjian Tan, Xiangyu Liu, Chaoyue Niu, Fandong Meng, Jie Zhou, Ning Liu, Fan Wu and Guihai Chen. Personalized Language Model Learning on Text Data Without User Identifiers. To appear in Proceedings of KDD 2025.
• Kunting Li, Yong Hu, Liang He, Fandong Meng and Jie Zhou. C-LLM: Learn to Check Chinese Spelling Errors Character by Character. In Proceedings of EMNLP 2024. [arxiv]
• Liang Zhang, Zhen Yang, Biao Fu, Ziyao Lu, Liangying Shao, Shiyu Liu, Fandong Meng, Jie Zhou, Xiaoli Wang and Jinsong Su. Multi-Level Cross-Modal Alignment for Speech Relation Extraction. In Proceedings of EMNLP 2024.
• Chenze Shao, Fandong Meng, Yijin Liu and Jie Zhou. Language Generation with Strictly Proper Scoring Rules. In Proceedings of ICML 2024. [arxiv]
• Chujie Zheng, Fan Yin, Hao Zhou, Fandong Meng, Jie Zhou, Kai-Wei Chang, Minlie Huang and Nanyun Peng. On Prompt-Driven Safeguarding for Large Language Models. In Proceedings of ICML 2024.
• Chenze Shao, Fandong Meng, Jiali Zeng and Jie Zhou. Understanding and Addressing the Under-Translation Problem from the Perspective of Decoding Objective. In Proceedings of ACL 2024. [arxiv]
• Yunlong Liang, Fandong Meng, Jiaan Wang, Jinan Xu, Yufeng Chen and Jie Zhou. Continual Learning with Semi-supervised Contrastive Distillation for Incremental Neural Machine Translation. In Proceedings of ACL 2024.
• Yong Hu, Fandong Meng and Jie Zhou. CSCD-NS: a Chinese Spelling Check Dataset for Native Speakers. In Proceedings of ACL 2024.
• Yutong Wang, Jiali Zeng, Xuebo Liu, Fandong Meng, Jie Zhou and Min Zhang. TasTe: Teaching Large Language Models to Translate through Self-Reflection. In Proceedings of ACL 2024.
• Jiaan Wang, Yunlong Liang, Zengkui Sun, Yuxuan Cao, Jiarong Xu and Fandong Meng. Cross-Lingual Knowledge Editing in Large Language Models. In Proceedings of ACL 2024.
• Shicheng Xu, Liang Pang, Mo Yu, Fandong Meng, Huawei Shen, Xueqi Cheng and Jie Zhou. Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation. In Proceedings of ACL 2024.
• Bin Sun, Jianfeng Li, Hao Zhou, Fandong Meng, Kan Li, Jie Zhou. Exploring Conditional Variational Mechanism to Pinyin Input Method for Addressing One-to-Many Mappings in Low-Resource Scenarios. In Proceedings of ACL 2024 (short).
• Yun Luo, Zhen Yang, Fandong Meng, Yingjie Li, Fang Guo, Qinglin Qi, Jie Zhou and Yue Zhang. XAL: EXplainable Active Learning Makes Classifiers Better Low-resource Learners. In Proceedings of NAACL 2024. [arxiv]
• Che Jiang, Biqing Qi, Xiangyu Hong, Dayuan Fu, Yang Cheng, Fandong Meng, Mo Yu, Bowen Zhou and Jie Zhou. On Large Language Models' Hallucination with Regard to Known Facts. In Proceedings of NAACL 2024. [arxiv]
• Liqiang Niu, Fandong Meng and Jie Zhou. UMTIT: Unifying Recognition, Translation, and Generation for Multimodal Text Image Translation. In Proceedings of LREC-COLING 2024. [paper]
• Jianhao Yan, Jin Xu, Fandong Meng, Jie Zhou and Yue Zhang. DC-MBR: Distributional Cooling for Minimum Bayesian Risk Decoding. In Proceedings of LREC-COLING 2024. [paper]
• Chujie Zheng, Hao Zhou, Fandong Meng, Jie Zhou and Minlie Huang. Large Language Models Are Not Robust Multiple Choice Selectors. In Proceedings of ICLR 2024. [arxiv]
• Lean Wang, Wenkai Yang, Deli Chen, Hao Zhou, Yankai Lin, Fandong Meng, Jie Zhou and Xu Sun. Towards Codable Watermarking for Injecting Multi-Bits Information to LLMs. In Proceedings of ICLR 2024. [arxiv]
• Jiali Zeng, Fandong Meng, Yongjing Yin and Jie Zhou. Teaching Large Language Models to Translate with Comparison. In Proceedings of AAAI 2024.
• Kun Zhang, Jiali Zeng, Fandong Meng, Yuanzhuo Wang, Shiqi Sun, Long Bai, Huawei Shen and Jie Zhou. Tree-of-Reasoning Question Decomposition for Complex Question Answering with Large Language Models. In Proceedings of AAAI 2024.
• Xinwei Long, Jiali Zeng, Fandong Meng, Zhiyuan Ma, Kaiyan Zhang, Bowen Zhou and Jie Zhou. Generative Multi-Modal Knowledge Retrieval with Large Language Models. In Proceedings of AAAI 2024. [arxiv]

Professional Services

• Action Editor: ACL Rolling Review (2024)
• Standing Reviewer: TACL (2021-)
• Meta-Reviewer: NeurIPS 2024 (Area Chair); AAAI 2022 (Senior PC Member)
• PC Member & Reviewer: NeurIPS (2023); ACL (2014, 2017-2022); EMNLP (2018, 2020-2022); NAACL (2016, 2018, 2021); AAAI (2020, 2021); IJCAI (2019); COLING (2018)

Honours

• Best Long Paper Awards of ACL 2019 and EMNLP 2023.
• Champion of ICDAR 2023 Competition on Robust Layout Segmentation in Corporate Documents.
• Champion of WMT22 Chat Translation Task on English->German and German->English.
• Champion of WMT22 Biomedical Translation Task on Chinese->English.
• Champion of WMT21 news translation task on English->Chinese, English->Japanese, Japanese->English, and English->German (among constrained systems).
• Champion of WMT20 news translation task on Chinese->English.
• National Scholarship for Graduate Excellence of UCAS in 2015.
• UCAS Outstanding Student Awards in 2013 and 2014.
• Outstanding Winner (world 1/14) of COMAP's Mathematical Contest in Modeling (MCM/ICM) in 2010.
• First Prize Winner of National Mathematic Contest In Modeling in 2009.