Rahmani, HA;
Wang, X;
Feng, Y;
Zhang, Q;
Yilmaz, E;
Lipani, A;
(2023)
A Survey on Asking Clarification Questions Datasets in Conversational Systems.
In:
Proceedings of the Annual Meeting of the Association for Computational Linguistics.
(pp. pp. 2698-2716).
Association for Computational Linguistics: Toronto, ON, Canada.
Preview |
Text
2023.acl-long.152.pdf - Published Version Download (876kB) | Preview |
Abstract
The ability to understand a user's underlying needs is critical for conversational systems, especially with limited input from users in a conversation. Thus, in such a domain, Asking Clarification Questions (ACQs) to reveal users' true intent from their queries or utterances arise as an essential task. However, it is noticeable that a key limitation of the existing ACQs studies is their incomparability, from inconsistent use of data, distinct experimental setups and evaluation strategies. Therefore, in this paper, to assist the development of ACQs techniques, we comprehensively analyse the current ACQs research status, which offers a detailed comparison of publicly available datasets, and discusses the applied evaluation metrics, joined with benchmarks for multiple ACQs-related tasks. In particular, given a thorough analysis of the ACQs task, we discuss a number of corresponding research directions for the investigation of ACQs as well as the development of conversational systems.
| Type: | Proceedings paper |
|---|---|
| Title: | A Survey on Asking Clarification Questions Datasets in Conversational Systems |
| Event: | 61st Annual Meeting of the Association for Computational Linguistics |
| ISBN-13: | 9781959429722 |
| Open access status: | An open access version is available from UCL Discovery |
| Publisher version: | http://dx.doi.org/10.18653/v1/2023.acl-long.152 |
| Language: | English |
| Additional information: | ACL materials are Copyright © 1963–2023 ACL; other materials are copyrighted by their respective copyright holders. Materials prior to 2016 here are licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 International License. Permission is granted to make copies for the purposes of teaching and research. Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Civil, Environ and Geomatic Eng |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10180976 |
Archive Staff Only
 |
View Item |
