Junyi Li (李军毅)

I am a Ph.D. student jointly supervised by Prof. Jian-Yun Nie from DIRO, Universite de Montreal and Prof. Xin Zhao from GSAI, Renmin University of China. I have a broad interest in natural language processing, with an emphasis on natural language generation (NLG), especially based on pretrained language models (PLMs).

Email: junyi.li at umontreal dot ca / lijunyi at ruc dot edu dot cn

CV  /  Google Scholar  /  GitHub  /  Zhihu


Zhihu Posts
Publications

Preprint

A Survey of Pretrained Language Models Based Text Generation
Junyi Li†, Tianyi Tang†, Wayne Xin Zhao*, Jian-Yun Nie, Ji-Rong Wen
pdf

WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Training
Yuqi Huo, Manli Zhang, Guangzhen Liu, Haoyu Lu, Yizhao Gao, Guoxing Yang, Jingyuan Wen, Heng Zhang, Baogui Xu, Weihao Zheng, Zongzheng Xi, Yueqian Yang, Anwen Hu, Jinming Zhao, Ruichen Li, Yida Zhao, Liang Zhang, Yuqing Song, Xin Hong, Wanqing Cui, Danyang Hou, Yingyan Li, Junyi Li, Peiyu Liu, Zheng Gong, Chuhao Jin, Yuchong Sun, Shizhe Chen, Zhiwu Lu*, Zhicheng Dou, Qin Jin, Yanyan Lan, Wayne Xin Zhao, Ruihua Song*, Ji-Rong Wen*
pdf / code

2022

A Survey of Vision-Language Pre-Trained Models
Yifan Du†, Zikang Liu†, Junyi Li, Wayne Xin Zhao*
The 31th International Joint Conference on Artificial Intelligence (IJCAI), 2022, Survey Track
pdf

ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models
Junyi Li, Tianyi Tang, Zheng Gong, Lixin Yang, Zhuohao Yu, Zhipeng Chen, Jingyuan Wang, Wayne Xin Zhao*, Ji-Rong Wen
The North American Chapter of the Association for Computational Linguistics (NAACL), 2022
pdf / code

Learning to Transfer Prompts for Text Generation
Junyi Li, Tianyi Tang, Jian-Yun Nie, Ji-Rong Wen, Wayne Xin Zhao*
The North American Chapter of the Association for Computational Linguistics (NAACL), 2022
pdf / code

2021

Generating Long and Coherent Text with Multi-Level Generative Adversarial Networks
Tianyi Tang, Junyi Li, Wayne Xin Zhao*, Ji-Rong Wen
The 5th APWeb-WAIM International Joint Conference on Web and Big Data (APWeb-WAIM), 2021
pdf / code

TextBox: A Unified, Modularized, and Extensible Framework for Text Generation
Junyi Li†, Tianyi Tang†, Gaole He, Jinhao Jiang, Xiaoxuan Hu, Puzhao Xie, Zhipeng Chen, Zhuohao Yu, Wayne Xin Zhao*, Ji-Rong Wen
The 59th Annual Meeting of the Association for Computational Linguistics (ACL), 2021, System Demonstration
pdf / code

Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Models
Junyi Li, Tianyi Tang, Wayne Xin Zhao*, Ji-Rong Wen
Findings of The 59th Annual Meeting of the Association for Computational Linguistics (ACL), 2021
pdf / code

Pretrained Language Model for Text Generation: A Survey
Junyi Li†, Tianyi Tang†, Wayne Xin Zhao*, Ji-Rong Wen
The 30th International Joint Conference on Artificial Intelligence (IJCAI), 2021, Survey Track
pdf

Knowledge-based Review Generation by Coherence Enhanced Text Planning
Junyi Li, Wayne Xin Zhao*, Zhicheng Wei, Nicholas Jing Yuan, Ji-Rong Wen
The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021
pdf / code

2020

Knowledge-Enhanced Personalized Review Generation with Capsule Graph Neural Network
Junyi Li, Siqing Li, Wayne Xin Zhao*, Gaole He, Zhicheng Wei, Nicholas Jing Yuan, Ji-Rong Wen
The 29th ACM International Conference on Information and Knowledge Management (CIKM), 2020
pdf / code

Mining Implicit Entity Preference from User-Item Interaction Data for Knowledge Graph Completion via Adversarial Learning
Gaole He, Junyi Li, Wayne Xin Zhao*, Peiju Liu, Ji-Rong Wen
International World Wide Web Conference (WWW), 2020
pdf / code

2019

Generating Long and Informative Reviews with Aspect-Aware Coarse-to-Fine Decoding
Junyi Li, Wayne Xin Zhao*, Ji-Rong Wen, Yang Song
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL), 2019
pdf / code

* Corresponding author
† Equal contribution
Open Source Projects

(Most of my research work are open-source. Here are some my preferable projects!)
  • TextBox
    A unified, comprehensive and efficient framework for reproducing and developing text generation algorithms, covering more than 20 base models and nearly 10 benchmarks.
Professional Services

  • Reviewer
    • Journal: TALLIP
    • Conference: AAAI 2021-22, IJCAI 2021-22, KDD 2021, EMNLP 2022, COLING 2022
  • Chair
    • CSSNLP 2020 (Co-Chair)
Selected Awards and Honors

  • National Scholarship for Graduate Student (top 2% students), Ministry of Education of P.R.China, 2021
  • SIGIR Student Travel Grant (CIKM 2020)
  • National Scholarship for Graduate Student (top 2% students), Ministry of Education of P.R.China, 2019
  • China Undergraduate Mathematical Contest in Modeling, Second Prize in Beijing Contest District, 2016
Education

  • Ph.D. student of Artificial Intelligence, Renmin University of China & Universite de Montreal, 2020-present
  • M.Sc. of Computer Application, Renmin University of China, 2018-2020
  • B.Sc. of Computer Science, Renmin University of China, 2014-2018
Miscellaneous

Jinhang Jiang    Kun Zhou    Gaole He