Danyang Liu

About Me

I am a Ph.D. student at the UKRI CDT in NLP at University of Edinburgh, advised by Prof. Frank Keller and Prof. Mirella Lapata. I am also a member of the Edinburgh NLP of School of Informatics.

My research interests lie at the intersection of language and vision. I am particularly passionate about controllable and explainable text generation that leverage visual input. By extending LLMs to process visual signals, I aim to bridge the gap between vision and language, contributing to the advancement of intelligent systems capable of seamlessly integrating text and imagery.

Updates

• [Mar. 2024] Our TrustScore paper is accepted to SeT-LLM workshop @ ICLR 2024!
• [Oct. 2023] Our blueprint-based VIST paper is accepted to EMNLP 2023 (Findings)!
• [Nov. 2022] Our paper about VIST-character dataset is accepted to AAAI 2023.
• [Mar. 2022] Our strapline detection paper is accepted to NLP Power workshop of ACL 2022.

Publications

• TrustScore: Reference-Free Evaluation of LLM Response Trustworthiness
  Danna Zheng, Danyang Liu, Mirella Lapata, Jeff Z. Pan
  Secure and Trustworthy Large Language Models Workshop (SeT-LLM @ ICLR), 2024.
  
• Visual Storytelling with Question-Answer Plans
  Danyang Liu, Mirella Lapata, Frank Keller
  Empirical Methods in Natural Language Processing (EMNLP Findings), 2023.
  
• Detecting and Grounding Important Characters in Visual Stories
  Danyang Liu and Frank Keller
  AAAI Conference on Artificial Intelligence (AAAI), 2023.
  
• Automatically Discarding Straplines to Improve Data Quality for Abstractive News Summarization
  Amr Keleg*, Matthias Lindemann*, Danyang Liu*, Wanqiu Long*, Bonnie L. Webber
  (*=Equal contribution)
  NLP Power! The First Workshop on Efficient Benchmarking (ACL Workshop), 2022.
  
• A Character-Centric Neural Model for Automated Story Generation
  Danyang Liu, Juntao Li, Meng-Hsuan Yu, Dongyan Zhao, Rui Yan
  AAAI Conference on Artificial Intelligence (AAAI), 2020.
  
• Draft and Edit: Automatic Storytelling Through Multi-Pass Hierarchical Conditional Variational Autoencoder
  Meng-Hsuan Yu, Juntao Li, Danyang Liu, Dongyan Zhao, Rui Yan
  AAAI Conference on Artificial Intelligence (AAAI), 2020.
  
• A Transformer-Based Variational Auto Encoder for Sentence Generation
  Danyang Liu and Gongshen Liu
  International Joint Conference on Neural Networks (IJCNN), 2019.

Background

• PhD, University of Edinburgh, Edinburgh, U.K. 2024 (expected)
  
• Master, Shanghai Jiao Tong University, Shanghai, China. 2020
  
• Bachelor, Southeast University, Nanjing, China. 2017

Last updated in Oct, 2023.