Dissertation/ Thesis

Constructing Task-Oriented Dialogue Systems with Limited Resources

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: Constructing Task-Oriented Dialogue Systems with Limited Resources
Συγγραφείς: Qian, Kun
Έτος έκδοσης: 2024
Συλλογή: Columbia University: Academic Commons
Θεματικοί όροι: Computer science, Artificial intelligence, Dialogue--Computer simulation, Discourse analysis--Data processing, Customer services--Technological innovations, Chatbots, Wal-Mart (Firm)
Περιγραφή: Task-oriented dialogue systems have increasingly become integral to our daily lives. However, collecting dialogue data is notably expensive due to the necessity of human interaction. These systems are used in various applications, such as customer service chatbots, virtual assistants, and automated scheduling tools. Given the critical role of these systems, it is essential to develop methods that can leverage limited resources efficiently, especially in data-driven models like neural networks, which have demonstrated superior performance and widespread adoption. This dissertation proposes systematic approaches to address the limited-data problem in both modeling and data aspects, aiming to enhance the effectiveness and efficiency of task-oriented dialogue systems even when data is scarce. This dissertation is divided into three main parts. The first part introduces three modeling techniques to tackle limited-data challenges. As the base dialogue model evolves from traditional recurrent neural networks to advanced large language models, we explore meta-learning methods, meta-in-context learning, and pre-training sequentially. Besides modeling considerations, the second part of our discussion emphasizes evaluation benchmarks. We start by discussing our work on correcting MultiWOZ, one of the most popular task-oriented dialogue datasets, which enhances training and provides more accurate evaluations. We also investigate biases within this dataset and propose methods to mitigate them. Additionally, we aim to improve the dataset by extending it to a multilingual dataset, facilitating the development of task-oriented dialogue systems for a global audience. The last part examines how to adapt our methods to real-world applications. We address the issue of database-search-result ambiguity in Meta’s virtual assistants by constructing disambiguation dialogue turns in the training data. Furthermore, we aim to enhance Walmart’s shopping companion by synthesizing high-quality knowledge-based question-answer pairs and ...
Τύπος εγγράφου: thesis
Γλώσσα: English
DOI: 10.7916/xkrv-9t81
Διαθεσιμότητα: https://doi.org/10.7916/xkrv-9t81
Αριθμός Καταχώρησης: edsbas.A15DC1D9
Βάση Δεδομένων: BASE