Distributed-Memory Sparse Kernels for Machine Learning

Authors: Bharadwaj, Vivek, Buluc, Aydin, Demmel, James

Source: 2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS) IPDPS Parallel and Distributed Processing Symposium (IPDPS), 2022 IEEE International. :47-58 May, 2022

Relation: 2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS)

Reducing Communication in Graph Neural Network Training

Authors: Tripathy, Alok, Yelick, Katherine, Buluc, Aydin

Source: SC20: International Conference for High Performance Computing, Networking, Storage and Analysis SC High Performance Computing, Networking, Storage and Analysis, SC20: International Conference for. :1-14 Nov, 2020

Relation: SC20: International Conference for High Performance Computing, Networking, Storage and Analysis

Communication Avoiding Block Low-Rank Parallel Multifrontal Triangular Solve with Many Right-Hand Sides: Communication avoiding block low-rank parallel multifrontal triangular solve with many right-hand sides

Authors: Amestoy, Patrick, Boiteau, Olivier, Buttari, Alfredo, Gerest, Matthieu, Jézéquel, Fabienne, L’excellent, Jean-Yves, Mary, Theo

Contributors: Mary, Theo, Mumps Technologies Lyon, EDF R&D (EDF R&D), EDF (EDF), Algorithmes Parallèles et Optimisation (IRIT-APO), Institut de recherche en informatique de Toulouse (IRIT), Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Centre National de la Recherche Scientifique (CNRS)-Institut National Polytechnique (Toulouse) (Toulouse INP), Université de Toulouse (UT)-Toulouse Mind & Brain Institut (TMBI), Université Toulouse - Jean Jaurès (UT2J), Université de Toulouse (UT)-Université Toulouse III - Paul Sabatier (UT3), Université de Toulouse (UT)-Université Toulouse Capitole (UT Capitole), Université de Toulouse (UT), Performance et Qualité des Algorithmes Numériques (PEQUAN), LIP6, Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS)-Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), Université Paris-Panthéon-Assas

Source: SIAM Journal on Matrix Analysis and Applications. 45:148-166

Subject Terms: block low-rank matrices, linear systems, Numerical methods for low-rank matrix approximation, matrix compression, [MATH] Mathematics [math], Parallel numerical computation, [INFO] Computer Science [cs], Direct numerical methods for linear systems and matrix inversion, communication avoiding algorithms, Computational methods for sparse matrices, LU factorization, low-rank approximations, numerical linear algebra, data sparse matrices, [INFO]Computer Science [cs], triangular solve, [MATH]Mathematics [math]

File Description: application/xml; application/pdf

Access URL: https://zbmath.org/7791523
https://doi.org/10.1137/23m1568600
https://hal.science/hal-04082415v1/document
https://doi.org/10.1137/23m1568600
https://hal.science/hal-04082415v1

Parallel Algorithms for Intersection Computation

Authors: Sasidharan, Aparna

Source: Proceedings of the Platform for Advanced Scientific Computing Conference. :1-11

Availability: http://dl.acm.org/doi/10.1145/3659914.3659929

Recent Developments in Iterative Methods for Reducing Synchronization

Authors: Zou, Qinmeng, Magoules, Frederic

Source: 2019 18th International Symposium on Distributed Computing and Applications for Business Engineering and Science (DCABES) DCABES Distributed Computing and Applications for Business Engineering and Science (DCABES), 2019 18th International Symposium on. :163-166 Nov, 2019

Relation: 2019 18th International Symposium on Distributed Computing and Applications for Business Engineering and Science (DCABES)

Event-Triggered Communication in Parallel Computing

Authors: Ghosh, Soumyadip, Saha, Kamal K., Gupta, Vijay, Tryggvason, Gretar

Source: 2018 IEEE/ACM 9th Workshop on Latest Advances in Scalable Algorithms for Large-Scale Systems (scalA) SCALA Latest Advances in Scalable Algorithms for Large-Scale Systems (scalA), 2018 IEEE/ACM 9th Workshop on. :1-8 Nov, 2018

Relation: 2018 IEEE/ACM 9th Workshop on Latest Advances in Scalable Algorithms for Large-Scale Systems (scalA)

Communication-Avoiding Optimizations for Large-Scale Unstructured-Mesh Applications with OP2

Authors: Ekanayake, Suneth Dasantha, Reguly, István Zoltán, Luporini, Fabio, Mudalige, Gihan Ravideva

Source: Proceedings of the 52nd International Conference on Parallel Processing. :380-391

Availability: http://dl.acm.org/doi/10.1145/3605573.3605604

I/O-Optimal Algorithms for Symmetric Linear Algebra Kernels

Authors: Beaumont, Olivier, Eyraud-Dubois, Lionel, Vérité, Mathieu, Langou, Julien

Contributors: Eyraud-Dubois, Lionel

Source: Proceedings of the 34th ACM Symposium on Parallelism in Algorithms and Architectures. :423-433

Subject Terms: syrk, FOS: Computer and information sciences, linear algebra, Computer Science - Distributed, Parallel, and Cluster Computing, communication-avoiding algorithms, [INFO.INFO-DC] Computer Science [cs]/Distributed, Parallel, and Cluster Computing [cs.DC], 0202 electrical engineering, electronic engineering, information engineering, symmetric kernels, Distributed, Parallel, and Cluster Computing (cs.DC), 02 engineering and technology, 0101 mathematics, 01 natural sciences, cholesky

File Description: application/pdf

Access URL: http://arxiv.org/abs/2202.10217
https://inria.hal.science/hal-03580531v1
https://inria.hal.science/hal-03580531v1/document

Network Topologies and Inevitable Contention

Authors: Ballard, Grey, Demmel, James, Gearhart, Andrew, Lipshitz, Benjamin, Oltchik, Yishai, Schwartz, Oded, Toledo, Sivan

Source: 2016 First International Workshop on Communication Optimizations in HPC (COMHPC) COMHPC Communication Optimizations in HPC (COMHPC), International Workshop on. :39-52 Nov, 2016

Relation: 2016 First International Workshop on Communication Optimizations in HPC (COMHPC)

Write-Avoiding Algorithms

Authors: Carson, Erin, Demmel, James, Grigori, Laura, Knight, Nicholas, Koanantakool, Penporn, Schwartz, Oded, Simhadri, Harsha Vardhan

Source: 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS) Parallel and Distributed Processing Symposium, 2016 IEEE International. :648-658 May, 2016

Relation: 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS)

Communication-Avoiding Parallel Sparse-Dense Matrix-Matrix Multiplication

Authors: Koanantakool, Penporn, Azad, Ariful, Buluc, Aydin, Morozov, Dmitriy, Oh, Sang-Yun, Oliker, Leonid, Yelick, Katherine

Source: 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS) Parallel and Distributed Processing Symposium, 2016 IEEE International. :842-853 May, 2016

Relation: 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS)

A Computation- and Communication-Optimal Parallel Direct 3-Body Algorithm

Authors: Koanantakool, Penporn, Yelick, Katherine

Source: SC14: International Conference for High Performance Computing, Networking, Storage and Analysis High Performance Computing, Networking, Storage and Analysis, SC14: International Conference for. :363-374 Nov, 2014

Relation: SC14: International Conference for High Performance Computing, Networking, Storage and Analysis

A 3D Parallel Algorithm for QR Decomposition

Authors: Ballard, Grey, Demmel, James, Grigori, Laura, Jacquelin, Mathias, Knight, Nicholas

Source: SPAA'18: PROCEEDINGS OF THE 30TH ACM SYMPOSIUM ON PARALLELISM IN ALGORITHMS AND ARCHITECTURES. abs/1805.05278

Subject Terms: Communications Engineering, Engineering, communication-avoiding algorithms, bandwidth-latency tradeoffs, communication-memory tradeoffs, cs.DC

File Description: application/pdf

Access URL: https://escholarship.org/uc/item/6qz3r1gf
https://escholarship.org/content/qt6qz3r1gf/qt6qz3r1gf.pdf

Tera-scale 1D FFT with low-communication algorithm and Intel® Xeon Phi™ coprocessors

Authors: Jongsoo Park, Bikshandi, Ganesh, Vaidyanathan, Karthikeyan, Tang, Ping Tak Peter, Dubey, Pradeep, Daehyun Kim

Source: 2013 SC - International Conference for High Performance Computing, Networking, Storage and Analysis (SC) High Performance Computing, Networking, Storage and Analysis (SC), 2013 International Conference for. :1-12 Nov, 2013

Relation: 2013 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Minimizing Communication in All-Pairs Shortest Paths

Authors: Solomonik, Edgar, Buluc, Aydin, Demmel, James

Source: 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Parallel & Distributed Processing (IPDPS), 2013 IEEE 27th International Symposium on. :548-559 May, 2013

Relation: 2013 IEEE International Symposium on Parallel & Distributed Processing (IPDPS)

Perfect Strong Scaling Using No Additional Energy

Authors: Demmel, James, Gearhart, Andrew, Lipshitz, Benjamin, Schwartz, Oded

Source: 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Parallel & Distributed Processing (IPDPS), 2013 IEEE 27th International Symposium on. :649-660 May, 2013

Relation: 2013 IEEE International Symposium on Parallel & Distributed Processing (IPDPS)

Cyclops Tensor Framework: Reducing Communication and Eliminating Load Imbalance in Massively Parallel Contractions

Authors: Solomonik, Edgar, Matthews, Devin, Hammond, Jeff, Demmel, James

Source: 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Parallel & Distributed Processing (IPDPS), 2013 IEEE 27th International Symposium on. :813-824 May, 2013

Relation: 2013 IEEE International Symposium on Parallel & Distributed Processing (IPDPS)

A Communication-Optimal N-Body Algorithm for Direct Interactions

Authors: Driscoll, Michael, Georganas, Evangelos, Koanantakool, Penporn, Solomonik, Edgar, Yelick, Katherine

Source: 2013 IEEE 27th International Symposium on Parallel and Distributed Processing Parallel & Distributed Processing (IPDPS), 2013 IEEE 27th International Symposium on. :1075-1084 May, 2013

Relation: 2013 IEEE International Symposium on Parallel & Distributed Processing (IPDPS)

An Analytical Study of Loop Tiling for a Large-Scale Unstructured Mesh Application

Authors: Giles, M.B., Mudalige, G.R., Bertolli, C., Kelly, P.H.J., Laszlo, E., Reguly, I.

Source: 2012 SC Companion: High Performance Computing, Networking Storage and Analysis High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion:. :477-482 Nov, 2012

Relation: 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC)

Adapting communication-avoiding LU and QR factorizations to multicore architectures

Authors: Donfack, Simplice, Grigori, Laura, Gupta, Alok Kumar

Source: 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS) Parallel & Distributed Processing (IPDPS), 2010 IEEE International Symposium on. :1-10 Apr, 2010

Relation: 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS)