Bibliographic Details
| Title: |
Exploring cross-domain Bangla text summarization using large language models |
| Authors: |
Kotha, Eshika Ebnat, Chowdhury, Abtahi Bin Jahangir, Anan, Rafiyad Khan, Showkat, Subha Naj, Afridi, Sayed |
| Contributors: |
Sadeque, Farig Yousuf, Siddiqui, Md. Saiful Bari, Department of Computer Science and Engineering |
| Publisher Information: |
BRAC University |
| Publication Year: |
2026 |
| Collection: |
BRAC University, Bangladesh: Institutional Repository |
| Subject Terms: |
Zero-shot learning, Large language models, LLMS, Text summarization, Automatic text summarization, Low-resource languages, Bangla text, Bengali language, Error taxonomy, Semantic evaluation, Automatic abstracting, Natural language processing (Computer science), Text processing (Computer science), Bengali language--Data processing, Computational linguistics |
| Description: |
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2026. ; Cataloged from PDF version of thesis. ; Includes bibliographical references (pages 62-63). ; Automatic text summarization is a critical tool for managing the growing volume of digital content, yet effective summarization remains challenging for low-resource languages such as Bangla. This thesis investigates the capability of large language models (LLMs) to perform cross-domain Bangla text summarization under a strictly zero-shot setting. Rather than proposing a new summarization model, the study focuses on a systematic and reliable evaluation of existing models across heterogeneous domains. Summarization outputs are generated from two distinct datasets: a real-world Bangla news corpus (Prothom Alo) and the benchmark XL-Sum (Bangla) dataset. A diverse set of encoder–decoder and decoder-only LLMs is evaluated using a multi-layered assessment framework that combines traditional automatic metrics, blind LLM-as-a-Judge evaluation, SBERT-based semantic similarity analysis, and an automated error taxonomy. We assume that we need a more robust comparison beyond surface level lexical matching, which is found ineffective for Bangla abstractive summarization. However, our experimental results show that those lexical metrics (such as ROUGE and BLEU) are generally insufficient to reflect semantic quality for Bangla summary since near zero scores (‘0’scores) appear in the case of coherent summarization. In contrast, the semantic analysis shows that Banglaspecific encoder-decoder models including BanglaT5 and mT5 significantly better perform than both the multilingual and decoder-only in domains. Decoder-only models are observed to behave erratically and incline towards either ungrammatical extraction or hallucination, as is systematically verified using semantic similarity patterns and error taxonomy analysis. The findings show that fine summarization in Bangla is insensitive ... |
| Document Type: |
thesis |
| File Description: |
74 pages; application/pdf |
| Language: |
English |
| Relation: |
ID 21201318; ID 21201426; ID 21201094; ID 21201398; ID 21201772; https://hdl.handle.net/10361/28837 |
| Availability: |
https://hdl.handle.net/10361/28837 |
| Rights: |
Attribution-NonCommercial-NoDerivatives 4.0 International ; BRAC University theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. ; http://creativecommons.org/licenses/by-nc-nd/4.0/ |
| Accession Number: |
edsbas.DB9D9DE0 |
| Database: |
BASE |