Lei Shu

Selected Papers

Full list at Google Scholar.

2026
  • 3DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code
    Yipeng Gao, Lei Shu, Genzhi Ye, Xi Xiong, Ameesh Makadia, Meiqi Guo, Laurent Itti, Jindong Chen
    arXiv 2026 [paper][project]
  • Ego2Web: A Web Agent Benchmark Grounded in Egocentric Videos
    Shoubin Yu, Lei Shu, Antoine Yang, Yao Fu, Srinivas Sunkara, Maria Wang, Jindong Chen, Mohit Bansal, Boqing Gong
    CVPR 2026 [paper][project]
2025
  • Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
    Gemini Team, Google DeepMind (incl. Lei Shu)
    arXiv:2507.06261 [paper]
  • Project Astra
    Project Astra Team, Google DeepMind (incl. Lei Shu)
    Google DeepMind, 2025 [project]
  • UISim: An Interactive Image-Based UI Simulator for Dynamic Mobile Environments
    Jiannan Xiang, Yun Zhu, Lei Shu, Maria Wang, Lijun Yu, Gabriel Barcik, James Lyon, Srinivas Sunkara
    arXiv:2509.21733 [paper]
  • Accelerating Inference of Retrieval-Augmented Generation via Sparse Context Selection
    Yun Zhu, Jia-Chen Gu, Caitlin Sikora, Ho Ko, Yinxiao Liu, Chu-Cheng Lin, Lei Shu, Liangchen Luo, Lei Meng, Bang Liu, Jindong Chen
    ICLR 2025 [paper]
  • Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewriting
    Yufei Li, Jay Nham, Ganesh Jawahar, Lei Shu, David Uthus, Yun-Hsuan Sung, Chengrun Yang, Itai Rolnick
    arXiv:2503.06781 [paper]
2024
  • RewriteLM: An Instruction-Tuned Large Language Model for Text Rewriting
    Lei Shu, Liangchen Luo, Jayakumar Hoskere, Yun Zhu, Canoee Liu, Simon Tong, Jindong Chen, Lei Meng
    AAAI 2024 [paper]
  • Fusion-Eval: Integrating Assistant Evaluators with LLMs
    Lei Shu, Nevan Wichers, Liangchen Luo, Yun Zhu, Yinxiao Liu, Jindong Chen, Lei Meng
    EMNLP 2024 Industry [ACL]
  • Enhancing Reinforcement Learning with Dense Rewards from Language Model Critic
    Meng Cao, Lei Shu, Lei Yu, Yun Zhu, Nevan Wichers, Yinxiao Liu, Lei Meng
    EMNLP 2024 Main [ACL]
  • Improve Mathematical Reasoning in Language Models by Automated Process Supervision
    Liangchen Luo, Yinxiao Liu, Rosanne Liu, Samrat Phatale, Harsh Lara, Yunxuan Li, Lei Shu, Yun Zhu, Lei Meng, Jiao Sun, Abhinav Rastogi
    arXiv:2406.06592 [arXiv]
  • Towards an On-device Agent for Text Rewriting
    Yun Zhu, Yinxiao Liu, Felix Stahlberg, Shankar Kumar, Yu-Hui Chen, Liangchen Luo, Lei Shu, Renjie Liu, Jindong Chen, Lei Meng
    NAACL 2024 Findings [paper]
2023
  • Critique Ability of Large Language Models
    Liangchen Luo, Zi Lin, Yinxiao Liu, Lei Shu, Yun Zhu, Jingbo Shang, Lei Meng
    arXiv:2310.04815 [preprint]
  • SiRA: Sparse Mixture of Low Rank Adaptation
    Yun Zhu, Nevan Wichers, Chu-Cheng Lin, Xinyi Wang, Tianlong Chen, Lei Shu, Han Lu, Canoee Liu, Liangchen Luo, Jindong Chen, Lei Meng
    arXiv:2311.09179 [preprint]
  • An Efficient Conversational Smart Compose System
    Yun Zhu, Xiayu Chen, Lei Shu, Bowen Tan, Xinying Song, Lijuan Liu, Maria Wang, Jindong Chen, Ning Ruan
    ACL 2023 Demo [paper]
2022
  • Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System
    Yixuan Su, Lei Shu, Elman Mansimov, Arshit Gupta, Deng Cai, Yi-An Lai, Yi Zhang
    ACL 2022 [preprint][code]
  • TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning
    Yixuan Su, Fangyu Liu, Zaiqiao Meng, Tian Lan, Lei Shu, Ehsan Shareghi, Nigel Collier
    NAACL 2022 [preprint][code]
  • Zero-Shot Out-of-Distribution Detection Based on the Pretrained Model CLIP
    Sepideh Esmaeilpour, Bing Liu, Eric Robertson, Lei Shu
    AAAI 2022 [paper]
  • Measuring and Reducing Model Update Regression in Structured Prediction for NLP
    Deng Cai, Elman Mansimov, Yi-An Lai, Yixuan Su, Lei Shu, Yi Zhang
    NeurIPS 2022 [preprint]
  • Continual Training of Language Models for Few-Shot Learning
    Zixuan Ke, Haowei Lin, Yijia Shao, Hu Xu, Lei Shu, Bing Liu
    EMNLP 2022 [preprint][code]
  • Adapting a Language Model While Preserving its General Knowledge
    Zixuan Ke, Yijia Shao, Haowei Lin, Hu Xu, Lei Shu, Bing Liu
    EMNLP 2022 [preprint][code]
  • Zero-Shot Aspect-Based Sentiment Analysis
    Lei Shu, Hu Xu, Bing Liu, Jiahua Chen
    arXiv:2202.01924 [preprint]
2021
  • ODIST: Open World Classification via Distributionally Shifted Instances
    Lei Shu, Yassine Benajiba, Saab Mansour, Yi Zhang
    EMNLP Findings 2021 [paper][video]
  • CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks
    Zixuan Ke, Bing Liu, Hu Xu, Lei Shu
    EMNLP 2021 [code]
  • Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning
    Zixuan Ke, Bing Liu, Nianzu Ma, Hu Xu, Lei Shu
    NeurIPS 2021 [code]
2020
  • Understanding Pre-trained BERT for Aspect-based Sentiment Analysis
    Hu Xu, Lei Shu, Philip S. Yu, Bing Liu
    COLING 2020 [preprint]
  • Controllable Text Generation with Focused Variation
    Lei Shu, Alexandros Papangelis, Yi-Chia Wang, Gokhan Tur, Hu Xu, Zhaleh Feizollahi, Bing Liu, Piero Molino
    EMNLP Findings 2020 [preprint]
  • DomBERT: Domain-oriented Language Model for Aspect-based Sentiment Analysis
    Hu Xu, Bing Liu, Lei Shu, Philip S. Yu
    EMNLP Findings 2020 [preprint]
  • Learning a Sequence of Sentiment Classification Tasks
    Zixuan Ke, Bing Liu, Hao Wang, Lei Shu
    ECML-PKDD 2020 [preprint][code]
2019
  • Modeling Multi-Action Policy for Task-Oriented Dialogues
    Lei Shu, Hu Xu, Bing Liu, Piero Molino
    EMNLP 2019 [preprint][code][poster]
  • Flexibly-Structured Model for Task-Oriented Dialogues
    Lei Shu, Piero Molino, Mahdi Namazifar, Hu Xu, Bing Liu, Huaixiu Zheng, Gokhan Tur
    SIGDIAL 2019 [preprint][slides][code]
  • BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis
    Hu Xu, Bing Liu, Lei Shu, Philip S. Yu
    NAACL 2019 [preprint][code]
  • Open-world Learning and Application to Product Classification
    Hu Xu, Bing Liu, Lei Shu, Philip S. Yu
    WWW 2019 [preprint][code]
2018
  • Incorporating the Structure of the Belief State in End-to-End Task-Oriented Dialogue Systems
    Lei Shu, Piero Molino, Mahdi Namazifar, Bing Liu, Hu Xu, Huaixiu Zheng, Gokhan Tur
    NeurIPS 2018 Conversational AI Workshop [paper]
  • Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction (Yelp Dataset Challenge Round 12 Grand Prize)
    Hu Xu, Bing Liu, Lei Shu, Philip S. Yu
    ACL 2018 [paper][code]
  • Lifelong Domain Word Embedding via Meta-Learning
    Hu Xu, Bing Liu, Lei Shu, Philip S. Yu
    IJCAI 2018 [paper][code]
  • Dual Attention Network for Product Compatibility and Function Satisfiability Analysis
    Hu Xu, Sihong Xie, Lei Shu, Philip S. Yu
    AAAI 2018 [paper]
  • Unseen Class Discovery in Open-world Classification
    Lei Shu, Hu Xu, Bing Liu
    arXiv 2018 [preprint]
2017 and before
  • DOC: Deep Open Classification of Text Documents
    Lei Shu, Hu Xu, Bing Liu
    EMNLP 2017 [paper][video][code]
  • Lifelong Learning CRF for Supervised Aspect Extraction
    Lei Shu, Hu Xu, Bing Liu
    ACL 2017 [paper][video]
  • Lifelong-RL: Lifelong Relaxation Labeling for Separating Entities and Aspects in Opinion Targets
    Lei Shu, Bing Liu, Hu Xu, Annice Kim
    EMNLP 2016 [paper][video]