Other/Unknown Material
Discovery driven analysis on semi-structured text data
| Τίτλος: | Discovery driven analysis on semi-structured text data |
|---|---|
| Συγγραφείς: | Hauguel, Samson A. |
| Συνεισφορές: | Zhai, ChengXiang |
| Έτος έκδοσης: | 2010 |
| Συλλογή: | University of Illinois at Urbana-Champaign: IDEALS (Illinois Digital Environment for Access to Learning and Scholarship) |
| Θεματικοί όροι: | computer science, Information Science, Data Mining, Text Mining, Online analytical processing (OLAP), discovery driven analysis, Probabilistic latent semantic analysis (PLSA) |
| Περιγραφή: | Made available in DSpace on 2010-05-19T18:39:57Z (GMT). No. of bitstreams: 4 Hauguel_Samson.pdf: 949045 bytes, checksum: c81da5764eec7003739651851a0439a5 (MD5) 1_Hauguel_Samson.pdf: 949482 bytes, checksum: 64fae416e30bc67f9ab29dac3c487ebd (MD5) 2_Hauguel_Samson.pdf: 949045 bytes, checksum: c81da5764eec7003739651851a0439a5 (MD5) license.txt: 4064 bytes, checksum: 585cd0f4476dc2842cbbd947ebbe3b60 (MD5) ; Discovery Driven Analysis (DDA) is a common feature of OLAP technology to analyze structured data. In essence, DDA helps analysts to discover anomalous data by highlighting 'unexpected' values in the OLAP cube. By giving indications to the analyst on what dimensions to explore, DDA speeds up the process of discovering anomalies and their causes. However, Discovery Driven Analysis (and OLAP in general) is only applicable on structured data, such as records in databases. We propose a system to extend DDA technology to semi-structured text documents, that is, text documents with a few structured data. Our system pipeline consists of two stages: first, the text part of each document is structured around user specified dimensions, using semi-PLSA algorithm; then, we adapt DDA to these fully structured documents, thus enabling DDA on text documents. We present some applications of this system in OLAP analysis and show how scalability issues are solved. Results show that our system can handle reasonable datasets of documents, in real time, without any need for pre-computation. ; Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2010-04-25T16:53:24Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 Hauguel_Samson.pdf: 949482 bytes, checksum: 64fae416e30bc67f9ab29dac3c487ebd (MD5) |
| Τύπος εγγράφου: | other/unknown material |
| Γλώσσα: | English |
| Relation: | https://hdl.handle.net/2142/16180; http://hdl.handle.net/2142/16180 |
| Διαθεσιμότητα: | https://hdl.handle.net/2142/16180 http://hdl.handle.net/2142/16180 |
| Rights: | Copyright 2010 Samson A. Hauguel |
| Αριθμός Καταχώρησης: | edsbas.2C5C075F |
| Βάση Δεδομένων: | BASE |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://hdl.handle.net/2142/16180# Name: EDS - BASE (ns324271) Category: fullText Text: View record from BASE |
|---|---|
| Header | DbId: edsbas DbLabel: BASE An: edsbas.2C5C075F RelevancyScore: 693 AccessLevel: 3 PubType: Other/Unknown Material PubTypeId: unknown PreciseRelevancyScore: 693.324279785156 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Discovery driven analysis on semi-structured text data – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Hauguel%2C+Samson+A%2E%22">Hauguel, Samson A.</searchLink> – Name: Author Label: Contributors Group: Au Data: Zhai, ChengXiang – Name: DatePubCY Label: Publication Year Group: Date Data: 2010 – Name: Subset Label: Collection Group: HoldingsInfo Data: University of Illinois at Urbana-Champaign: IDEALS (Illinois Digital Environment for Access to Learning and Scholarship) – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22computer+science%22">computer science</searchLink><br /><searchLink fieldCode="DE" term="%22Information+Science%22">Information Science</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Mining%22">Data Mining</searchLink><br /><searchLink fieldCode="DE" term="%22Text+Mining%22">Text Mining</searchLink><br /><searchLink fieldCode="DE" term="%22Online+analytical+processing+%28OLAP%29%22">Online analytical processing (OLAP)</searchLink><br /><searchLink fieldCode="DE" term="%22discovery+driven+analysis%22">discovery driven analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Probabilistic+latent+semantic+analysis+%28PLSA%29%22">Probabilistic latent semantic analysis (PLSA)</searchLink> – Name: Abstract Label: Description Group: Ab Data: Made available in DSpace on 2010-05-19T18:39:57Z (GMT). No. of bitstreams: 4 Hauguel_Samson.pdf: 949045 bytes, checksum: c81da5764eec7003739651851a0439a5 (MD5) 1_Hauguel_Samson.pdf: 949482 bytes, checksum: 64fae416e30bc67f9ab29dac3c487ebd (MD5) 2_Hauguel_Samson.pdf: 949045 bytes, checksum: c81da5764eec7003739651851a0439a5 (MD5) license.txt: 4064 bytes, checksum: 585cd0f4476dc2842cbbd947ebbe3b60 (MD5) ; Discovery Driven Analysis (DDA) is a common feature of OLAP technology to analyze structured data. In essence, DDA helps analysts to discover anomalous data by highlighting 'unexpected' values in the OLAP cube. By giving indications to the analyst on what dimensions to explore, DDA speeds up the process of discovering anomalies and their causes. However, Discovery Driven Analysis (and OLAP in general) is only applicable on structured data, such as records in databases. We propose a system to extend DDA technology to semi-structured text documents, that is, text documents with a few structured data. Our system pipeline consists of two stages: first, the text part of each document is structured around user specified dimensions, using semi-PLSA algorithm; then, we adapt DDA to these fully structured documents, thus enabling DDA on text documents. We present some applications of this system in OLAP analysis and show how scalability issues are solved. Results show that our system can handle reasonable datasets of documents, in real time, without any need for pre-computation. ; Item withdrawn by Mark Zulauf (zulauf@illinois.edu) on 2010-04-25T16:53:24Z Item was in collections: University of Illinois Theses & Dissertations (ID: 1) No. of bitstreams: 1 Hauguel_Samson.pdf: 949482 bytes, checksum: 64fae416e30bc67f9ab29dac3c487ebd (MD5) – Name: TypeDocument Label: Document Type Group: TypDoc Data: other/unknown material – Name: Language Label: Language Group: Lang Data: English – Name: NoteTitleSource Label: Relation Group: SrcInfo Data: https://hdl.handle.net/2142/16180; http://hdl.handle.net/2142/16180 – Name: URL Label: Availability Group: URL Data: https://hdl.handle.net/2142/16180<br />http://hdl.handle.net/2142/16180 – Name: Copyright Label: Rights Group: Cpyrght Data: Copyright 2010 Samson A. Hauguel – Name: AN Label: Accession Number Group: ID Data: edsbas.2C5C075F |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.2C5C075F |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English Subjects: – SubjectFull: computer science Type: general – SubjectFull: Information Science Type: general – SubjectFull: Data Mining Type: general – SubjectFull: Text Mining Type: general – SubjectFull: Online analytical processing (OLAP) Type: general – SubjectFull: discovery driven analysis Type: general – SubjectFull: Probabilistic latent semantic analysis (PLSA) Type: general Titles: – TitleFull: Discovery driven analysis on semi-structured text data Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Hauguel, Samson A. – PersonEntity: Name: NameFull: Zhai, ChengXiang IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2010 Identifiers: – Type: issn-locals Value: edsbas |
| ResultId | 1 |