Conference
OmpSs-2@Cluster: Distributed memory execution of nested OpenMP-style tasks
| Title: | OmpSs-2@Cluster: Distributed memory execution of nested OpenMP-style tasks |
|---|---|
| Authors: | Aguilar Mena, Jimmy, Ali, Omar Shaaban Ibrahim, Beltran Querol, Vicenç, Carpenter, Paul Matthew, Ayguadé Parra, Eduard, Labarta Mancho, Jesús José |
| Contributors: | Universitat Politècnica de Catalunya. Doctorat en Arquitectura de Computadors, Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors, Barcelona Supercomputing Center, Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions |
| Publisher Information: | Springer Nature |
| Publication Year: | 2022 |
| Collection: | Universitat Politècnica de Catalunya, BarcelonaTech: UPCommons - Global access to UPC knowledge |
| Subject Terms: | Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors, Memory management (Computer science), Application program interfaces (Computer software), Data flow analysis, Memory architecture, Open systems, Program translators, Gestió de memòria (Informàtica), Interfícies de programació d'aplicacions (Programari) |
| Description: | State-of-the-art programming approaches generally have a strict division between intra-node shared memory parallelism and inter-node MPI communication. Tasking with dependencies offers a clean, dependable abstraction for a wide range of hardware and situations within a node, but research on task offloading between nodes is still relatively immature. This paper presents a flexible task offloading extension of the OmpSs-2 programming model, which inherits task ordering from a sequential version of the code and uses a common address space to avoid address translation and simplify the use of data structures with pointers. It uses weak dependencies to enable work to be created concurrently. The program is executed in distributed dataflow fashion, and the runtime system overlaps the construction of the distributed dependency graph, enforces dependencies, transfers data, and schedules tasks for execution. Asynchronous task parallelism avoids synchronization that is often required in MPI+OpenMP tasks. Task scheduling is flexible, and data location is tracked through the dependencies. We wish to enable future work in resiliency, scalability, load balancing and malleability, and therefore release all source code and examples open source. ; This research has received funding from the European Union’s Horizon 2020/EuroHPC research and innovation programme under grant agreement No 955606 (DEEP-SEA) and 754337 (EuroEXA). It is supported by the Spanish State Research Agency - Ministry of Science and Innovation (contract PID2019-107255GB and Ramon y Cajal fellowship RYC2018-025628-I) and by the Generalitat de Catalunya (2017-SGR-1414). ; Peer Reviewed ; Postprint (author's final draft) |
| Document Type: | conference object |
| File Description: | 16 p.; application/pdf |
| Language: | English |
| Relation: | https://link.springer.com/chapter/10.1007/978-3-031-12597-3_20; info:eu-repo/grantAgreement/EC/H2020/754337/EU/Co-designed Innovation and System for Resilient Exascale Computing in Europe: From Applications to Silicon/EuroEXA; info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020/PID2019-107255GB-C22/ES/UPC-COMPUTACION DE ALTAS PRESTACIONES VIII/; https://hdl.handle.net/2117/377512 |
| DOI: | 10.1007/978-3-031-12597-3_20 |
| Availability: | https://hdl.handle.net/2117/377512 https://doi.org/10.1007/978-3-031-12597-3_20 |
| Rights: | Open Access |
| Accession Number: | edsbas.AFF8761 |
| Database: | BASE |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://hdl.handle.net/2117/377512# Name: EDS - BASE (ns324271) Category: fullText Text: View record from BASE |
|---|---|
| Header | DbId: edsbas DbLabel: BASE An: edsbas.AFF8761 RelevancyScore: 935 AccessLevel: 3 PubType: Conference PubTypeId: conference PreciseRelevancyScore: 935.2763671875 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: OmpSs-2@Cluster: Distributed memory execution of nested OpenMP-style tasks – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Aguilar+Mena%2C+Jimmy%22">Aguilar Mena, Jimmy</searchLink><br /><searchLink fieldCode="AR" term="%22Ali%2C+Omar+Shaaban+Ibrahim%22">Ali, Omar Shaaban Ibrahim</searchLink><br /><searchLink fieldCode="AR" term="%22Beltran+Querol%2C+Vicenç%22">Beltran Querol, Vicenç</searchLink><br /><searchLink fieldCode="AR" term="%22Carpenter%2C+Paul+Matthew%22">Carpenter, Paul Matthew</searchLink><br /><searchLink fieldCode="AR" term="%22Ayguadé+Parra%2C+Eduard%22">Ayguadé Parra, Eduard</searchLink><br /><searchLink fieldCode="AR" term="%22Labarta+Mancho%2C+Jesús+José%22">Labarta Mancho, Jesús José</searchLink> – Name: Author Label: Contributors Group: Au Data: Universitat Politècnica de Catalunya. Doctorat en Arquitectura de Computadors<br />Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors<br />Barcelona Supercomputing Center<br />Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions – Name: Publisher Label: Publisher Information Group: PubInfo Data: Springer Nature – Name: DatePubCY Label: Publication Year Group: Date Data: 2022 – Name: Subset Label: Collection Group: HoldingsInfo Data: Universitat Politècnica de Catalunya, BarcelonaTech: UPCommons - Global access to UPC knowledge – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Àrees+temàtiques+de+la+UPC%3A%3AInformàtica%3A%3AArquitectura+de+computadors%22">Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors</searchLink><br /><searchLink fieldCode="DE" term="%22Memory+management+%28Computer+science%29%22">Memory management (Computer science)</searchLink><br /><searchLink fieldCode="DE" term="%22Application+program+interfaces+%28Computer+software%29%22">Application program interfaces (Computer software)</searchLink><br /><searchLink fieldCode="DE" term="%22Data+flow+analysis%22">Data flow analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Memory+architecture%22">Memory architecture</searchLink><br /><searchLink fieldCode="DE" term="%22Open+systems%22">Open systems</searchLink><br /><searchLink fieldCode="DE" term="%22Program+translators%22">Program translators</searchLink><br /><searchLink fieldCode="DE" term="%22Gestió+de+memòria+%28Informàtica%29%22">Gestió de memòria (Informàtica)</searchLink><br /><searchLink fieldCode="DE" term="%22Interfícies+de+programació+d'aplicacions+%28Programari%29%22">Interfícies de programació d'aplicacions (Programari)</searchLink> – Name: Abstract Label: Description Group: Ab Data: State-of-the-art programming approaches generally have a strict division between intra-node shared memory parallelism and inter-node MPI communication. Tasking with dependencies offers a clean, dependable abstraction for a wide range of hardware and situations within a node, but research on task offloading between nodes is still relatively immature. This paper presents a flexible task offloading extension of the OmpSs-2 programming model, which inherits task ordering from a sequential version of the code and uses a common address space to avoid address translation and simplify the use of data structures with pointers. It uses weak dependencies to enable work to be created concurrently. The program is executed in distributed dataflow fashion, and the runtime system overlaps the construction of the distributed dependency graph, enforces dependencies, transfers data, and schedules tasks for execution. Asynchronous task parallelism avoids synchronization that is often required in MPI+OpenMP tasks. Task scheduling is flexible, and data location is tracked through the dependencies. We wish to enable future work in resiliency, scalability, load balancing and malleability, and therefore release all source code and examples open source. ; This research has received funding from the European Union’s Horizon 2020/EuroHPC research and innovation programme under grant agreement No 955606 (DEEP-SEA) and 754337 (EuroEXA). It is supported by the Spanish State Research Agency - Ministry of Science and Innovation (contract PID2019-107255GB and Ramon y Cajal fellowship RYC2018-025628-I) and by the Generalitat de Catalunya (2017-SGR-1414). ; Peer Reviewed ; Postprint (author's final draft) – Name: TypeDocument Label: Document Type Group: TypDoc Data: conference object – Name: Format Label: File Description Group: SrcInfo Data: 16 p.; application/pdf – Name: Language Label: Language Group: Lang Data: English – Name: NoteTitleSource Label: Relation Group: SrcInfo Data: https://link.springer.com/chapter/10.1007/978-3-031-12597-3_20; info:eu-repo/grantAgreement/EC/H2020/754337/EU/Co-designed Innovation and System for Resilient Exascale Computing in Europe: From Applications to Silicon/EuroEXA; info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020/PID2019-107255GB-C22/ES/UPC-COMPUTACION DE ALTAS PRESTACIONES VIII/; https://hdl.handle.net/2117/377512 – Name: DOI Label: DOI Group: ID Data: 10.1007/978-3-031-12597-3_20 – Name: URL Label: Availability Group: URL Data: https://hdl.handle.net/2117/377512<br />https://doi.org/10.1007/978-3-031-12597-3_20 – Name: Copyright Label: Rights Group: Cpyrght Data: Open Access – Name: AN Label: Accession Number Group: ID Data: edsbas.AFF8761 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.AFF8761 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/978-3-031-12597-3_20 Languages: – Text: English Subjects: – SubjectFull: Àrees temàtiques de la UPC::Informàtica::Arquitectura de computadors Type: general – SubjectFull: Memory management (Computer science) Type: general – SubjectFull: Application program interfaces (Computer software) Type: general – SubjectFull: Data flow analysis Type: general – SubjectFull: Memory architecture Type: general – SubjectFull: Open systems Type: general – SubjectFull: Program translators Type: general – SubjectFull: Gestió de memòria (Informàtica) Type: general – SubjectFull: Interfícies de programació d'aplicacions (Programari) Type: general Titles: – TitleFull: OmpSs-2@Cluster: Distributed memory execution of nested OpenMP-style tasks Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Aguilar Mena, Jimmy – PersonEntity: Name: NameFull: Ali, Omar Shaaban Ibrahim – PersonEntity: Name: NameFull: Beltran Querol, Vicenç – PersonEntity: Name: NameFull: Carpenter, Paul Matthew – PersonEntity: Name: NameFull: Ayguadé Parra, Eduard – PersonEntity: Name: NameFull: Labarta Mancho, Jesús José – PersonEntity: Name: NameFull: Universitat Politècnica de Catalunya. Doctorat en Arquitectura de Computadors – PersonEntity: Name: NameFull: Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors – PersonEntity: Name: NameFull: Barcelona Supercomputing Center – PersonEntity: Name: NameFull: Universitat Politècnica de Catalunya. CAP - Grup de Computació d'Altes Prestacions IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2022 Identifiers: – Type: issn-locals Value: edsbas – Type: issn-locals Value: edsbas.oa |
| ResultId | 1 |