Academic Journal
MapReduce Parallel Programming Model: A State-of-the-Art Survey.
| Τίτλος: | MapReduce Parallel Programming Model: A State-of-the-Art Survey. |
|---|---|
| Συγγραφείς: | Li, Ren1 renli@cqjtu.edu.cn, Hu, Haibo2 hbhu@cqu.edu.cn, Li, Heng2 liheng@cqu.edu.cn, Wu, Yunsong3 yswu@cqu.edu.cn, Yang, Jianxi1 yjx@cquc.edu.cn |
| Πηγή: | International Journal of Parallel Programming. Aug2016, Vol. 44 Issue 4, p832-866. 35p. |
| Θεματικοί όροι: | *Big data, *Open source software, *Scalability, Parallel programs (Computer programs), Cloud computing |
| Περίληψη: | With the development of information technologies, we have entered the era of Big Data. Google's MapReduce programming model and its open-source implementation in Apache Hadoop have become the dominant model for data-intensive processing because of its simplicity, scalability, and fault tolerance. However, several inherent limitations, such as lack of efficient scheduling and iteration computing mechanisms, seriously affect the efficiency and flexibility of MapReduce. To date, various approaches have been proposed to extend MapReduce model and improve runtime efficiency for different scenarios. In this review, we assess MapReduce to help researchers better understand these novel optimizations that have been taken to address its limitations. We first present the basic idea underlying MapReduce paradigm and describe several widely used open-source runtime systems. And then we discuss the main shortcomings of original MapReduce. We also review these MapReduce optimization approaches that have recently been put forward, and categorize them according to the characteristics and capabilities. Finally, we conclude the paper and suggest several research works that should be carried out in the future. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Parallel Programming is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Βάση Δεδομένων: | Business Source Index |
| FullText | Links: – Type: other Text: Availability: 0 CustomLinks: – Url: https://dx.doi.org/doi:10.1007/s10766-015-0395-0 Name: EDS - Springer Nature Journals (s7799221) Category: fullText Text: View record at Springer |
|---|---|
| Header | DbId: bsx DbLabel: Business Source Index An: 115900577 RelevancyScore: 1182 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 1182.00793457031 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: MapReduce Parallel Programming Model: A State-of-the-Art Survey. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Li%2C+Ren%22">Li, Ren</searchLink><relatesTo>1</relatesTo><i> renli@cqjtu.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Hu%2C+Haibo%22">Hu, Haibo</searchLink><relatesTo>2</relatesTo><i> hbhu@cqu.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Li%2C+Heng%22">Li, Heng</searchLink><relatesTo>2</relatesTo><i> liheng@cqu.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Wu%2C+Yunsong%22">Wu, Yunsong</searchLink><relatesTo>3</relatesTo><i> yswu@cqu.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Yang%2C+Jianxi%22">Yang, Jianxi</searchLink><relatesTo>1</relatesTo><i> yjx@cquc.edu.cn</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Parallel+Programming%22">International Journal of Parallel Programming</searchLink>. Aug2016, Vol. 44 Issue 4, p832-866. 35p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Big+data%22">Big data</searchLink><br />*<searchLink fieldCode="DE" term="%22Open+source+software%22">Open source software</searchLink><br />*<searchLink fieldCode="DE" term="%22Scalability%22">Scalability</searchLink><br /><searchLink fieldCode="DE" term="%22Parallel+programs+%28Computer+programs%29%22">Parallel programs (Computer programs)</searchLink><br /><searchLink fieldCode="DE" term="%22Cloud+computing%22">Cloud computing</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: With the development of information technologies, we have entered the era of Big Data. Google's MapReduce programming model and its open-source implementation in Apache Hadoop have become the dominant model for data-intensive processing because of its simplicity, scalability, and fault tolerance. However, several inherent limitations, such as lack of efficient scheduling and iteration computing mechanisms, seriously affect the efficiency and flexibility of MapReduce. To date, various approaches have been proposed to extend MapReduce model and improve runtime efficiency for different scenarios. In this review, we assess MapReduce to help researchers better understand these novel optimizations that have been taken to address its limitations. We first present the basic idea underlying MapReduce paradigm and describe several widely used open-source runtime systems. And then we discuss the main shortcomings of original MapReduce. We also review these MapReduce optimization approaches that have recently been put forward, and categorize them according to the characteristics and capabilities. Finally, we conclude the paper and suggest several research works that should be carried out in the future. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Journal of Parallel Programming is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=bsx&AN=115900577 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s10766-015-0395-0 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 35 StartPage: 832 Subjects: – SubjectFull: Big data Type: general – SubjectFull: Open source software Type: general – SubjectFull: Scalability Type: general – SubjectFull: Parallel programs (Computer programs) Type: general – SubjectFull: Cloud computing Type: general Titles: – TitleFull: MapReduce Parallel Programming Model: A State-of-the-Art Survey. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Li, Ren – PersonEntity: Name: NameFull: Hu, Haibo – PersonEntity: Name: NameFull: Li, Heng – PersonEntity: Name: NameFull: Wu, Yunsong – PersonEntity: Name: NameFull: Yang, Jianxi IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 08 Text: Aug2016 Type: published Y: 2016 Identifiers: – Type: issn-print Value: 08857458 Numbering: – Type: volume Value: 44 – Type: issue Value: 4 Titles: – TitleFull: International Journal of Parallel Programming Type: main |
| ResultId | 1 |