I am a Ph.D. student in Human-Computer-Communication Laboratory in the Chinese University of Hong Kong, supervised by Prof. Helen Meng, started from Aug, 2019. I was an intern in the Speech and Language Processing group in Huawei Noah’s Ark Lab, supervised by Dr. Fei Mi and Dr. Yitong Li, collaborating with COAI group from Tsinghua University on safety issues in dialogue systems. Prior to this, I was an intern in the NLP group in JingDong AI Research Institute working on task-oriented dialogue systems.

Research Interest

My research mainly focuses on buidling reliable dialogue systems in terms of safety concerns (biased and offensive languages, moral considerations, etc.) and knowledge grounding. I am also interested in general ethical issues in NLP applications, e.g., fairness of large language models. You are more than welcome to me for research discussions!

News

Mar 2024: Our work on machine ethics: Rethinking Machine Ethics – Can LLMs Perform Moral Reasoning through the Lens of Moral Theories? accepted by NAACL 2024.

Feb 2024: Delighted to give talk in City University of Hong Kong on Generative AI, the Future of Work, and Talent Cultivation.

Dec 2023: Excited and Hornored to serve as the organizing chair of 2023 International Docotoral Forum!

Dec 2022: Attending off-line EMNLP 2022 @ Abu Dhabi, presenting our work on Chinese Offensive Language Detection.

Oct 2022: Two papers accepted by EMNLP 2022, COLD: A Benchmark for Chinese Offensive Language Detection and Towards Identifying Social Bias in Dialogue Systems.

Selected Publications

AI Ethics and Dialogue Safety

• Purple-teaming LLMs with Adversarial Defender Training

  Jingyan Zhou, Kun Li, Junan Li, Jiawen Kang, Minda Hu, Xixin Wu, Helen Meng

• Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluation

  Xiaoying Zhang, Baolin Peng, Ye Tian, Jingyan Zhou, Lifeng Jin, Linfeng Song, Haitao Mi, Helen Meng

• Rethinking Machine Ethics – Can LLMs Perform Moral Reasoning through the Lens of Moral Theories?

  Jingyan Zhou, Minda Hu, Junan Li, Xiaoying Zhang, Xixin Wu, Irwin King, Helen Meng

• Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarks

  Jingyan Zhou*, Jiawen Deng*, Fei Mi, Yitong Li, Yasheng Wang, Minlie Huang, Xin Jiang, Qun Liu, Helen Meng [data]

• COLD: A Benchmark for Chinese Offensive Language Detection

  Jiawen Deng*, Jingyan Zhou*, Hao Sun, Chujie Zheng, Fei Mi, Helen Meng and Minlie Huang [data]

• PanGu-BOT: Efficient Generative Dialogue Pre-training from Pre-trained Language Model

  Fei Mi, Yitong Li, Yulong Zeng, Jingyan Zhou, Yasheng Wang, Chuanfei Xu, Lifeng Shang, Xin Jiang, Shiqi Zhao, Qun Liu [Blog]

• Overview of NLPCC 2022 Shared Task 7: Fine-Grained Dialogue Social Bias Measurement

  Jingyan Zhou, Fei Mi, Helen Meng, Jiawen Deng [webpage]

Task-oriented Dialogue Systems:

• Sgp-tod: Building task bots effortlessly via schema-guided llm prompting

  Xiaoying Zhang, Baolin Peng, Kun Li, Jingyan Zhou, Helen Meng

• Unstructured Knowledge Access in Task-oriented Dialog Modeling using Language Inference, Knowledge Retrieval and Knowledge-Integrative Response Generation

  (All equal contribution) Mudit Chaudhary, Borislav Dzodzo, Sida Huang, Chun Hei Lo, Mingzhi Lyu, Lun Yiu Nie, Jinbo Xing, Tianhua Zhang, Xiaoying Zhang, Jingyan Zhou, Hong Cheng, Wai Lam, Helen Meng [code]

• Automatic Extraction of Semantic Patterns in Dialogs using Convex Polytopic Model

  Jingyan Zhou, Xiaoying Zhang, Xiaohan Feng, King Keung Wu, Helen Meng

• Convex Polytope Modelling for Unsupervised Derivation of Semantic Structure for Data-efficient Natural Language Understanding

  Jingyan Zhou, Xiaohan Feng, King Keung Wu, Helen Meng

• The JDDC Corpus: A Large-Scale Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Service

  Meng Chen, Ruixue Liu, Lei Shen, Shaozu Yuan, Jingyan Zhou, Youzheng Wu, Xiaodong He, Bowen Zhou

Teaching & Talk & Community Service

2024, Mar.: giving talk in the Chinese University of Hong Kong of Recent Advances in AI Ethics and Generative AI

2024, Feb.: giving talk in City University of Hong Kong of Generative AI, the Future of Work, and Talent Cultivation

2023, Dec.: serving as the organizing chair of 2023 International Docotoral Forum

2022-2023, Term 1: co-teaching SEEM5630: Conversational AI systems with Prof. Meng, Prof. Wu and other nice colleagues in HCCL

2022, Sept.: orgainzing the NLPCC 2022 shared task 7 Fine-Grain Dialogue Social Bias Measurement; overview

Every term 2 during 2019-2023: teaching assistant in ENGG1130: Multi-variable Calculus