The Library

Predictive analysis of a hydrodynamics application on large-scale CMP clusters

Tools

Davis, J. A., Mudalige, Gihan R., Hammond, Simon D., Herdman, J. A., Miller, I. and Jarvis, Stephen A.. (2011) Predictive analysis of a hydrodynamics application on large-scale CMP clusters. Computer Science - Research and Development, Volume 26 (Number 3-4). pp. 175-185. ISSN 1865-2034

Preview

PDF
WRAP_Herdman_Hydra.pdf - Accepted Version - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (577Kb) | Preview

Official URL: http://dx.doi.org/10.1007/s00450-011-0164-2

Abstract

We present the development of a predictive performance model for the high-performance computing code Hydra, a hydrodynamics benchmark developed and maintained by the United Kingdom Atomic Weapons Establishment (AWE). The developed model elucidates the parallel computation of Hydra, with which it is possible to predict its runtime and scaling performance on varying large-scale chip multiprocessor (CMP) clusters. A key feature of the model is its granularity; with the model we are able to separate the contributing costs, including computation, point-to-point communications, collectives, message buffering and message synchronisation. The predictions are validated on two contrasting large-scale HPC systems, an AMD Opteron/ InfiniBand cluster and an IBM BlueGene/P, both of which are located at the Lawrence Livermore National Laboratory (LLNL) in the US. We validate the model on up to 2,048 cores, where it achieves a > 85% accuracy in weak-scaling studies. We also demonstrate use of the model in exposing the increasing costs of collectives for this application, and also the influence of node density on network accesses, therefore highlighting the impact of machine choice when running this hydrodynamics application at scale.

Item Type:

Journal Article

Subjects:

Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software

Divisions:

Faculty of Science > Computer Science

Library of Congress Subject Headings (LCSH):

High performance computing, Hydrodynamics -- Computer programs

Journal or Publication Title:

Computer Science - Research and Development

Publisher:

Springer

Place of Publication:

Hamburg, Germany

ISSN:

1865-2034

Official Date:

June 2011

Dates:

Date	Event
June 2011	UNSPECIFIED

Volume:

Volume 26

Number:

Number 3-4

Number of Pages:

Page Range:

pp. 175-185

Identification Number:

10.1007/s00450-011-0164-2

Status:

Peer Reviewed

Publication Status:

Published

Access rights to Published version:

Restricted or Subscription Access

Funder:

Atomic Weapons Establishment (Great Britain) (AWE), University of Warwick. Centre for Scientific Computing, Science Research Investment Fund (SRIF)

Grant number:

CDK0660 (AWE), CDK0724 (AWE)

Conference Paper Type:

Paper

Title of Event:

Proceedings of the International Supercomputing Conference (ISC'11)

Type of Event:

Conference

Location of Event:

Hamburg, Germany

Date(s) of Event:

19-23rd June 2011

References:

K.J. Barker, K. Davis, and D.J. Kerbyson. Performance Modeling in
Action: Performance Prediction of a Cray XT4 System During Upgrade.
In IEEE International on Parallel and Distributed Processing
Symposium (IPDPS 2009), May 2009.
G. Benson, C.W. Chu, Q. Huang, and S. Caglar. A comparison of
MPICH allgather algorithms on switched networks. Recent Advances
in Parallel Virtual Machine and Message Passing Interface,
pages 335–343, 2003.
S.D. Hammond, G.R. Mudalige, J.A. Smith, S.A. Jarvis, J.A. Herdman,
and A. Vadgama. WARPP - A Toolkit for Simulating High-
Performance Parallel Scientific Codes. In Proc. 2nd International
Conference on Simulation Tools and Techniques, March 2009.
A. Hoisie, H. Lubeck, and H.J. Wasserman. Performance and Scalability
Analysis of Teraflop-Scale Parellel Architectures using Multidimentional
Wavefront Applications. Int. J of High Performance
Computing Applications, 14(4):330–346, Winter 2000.
A. Hoisie, G. Johnson, D.J. Kerbyson, M. Lang, and S. Pakin. A
Performance Comparison Through Benchmarking and Modeling of
Three Leading Supercomputers: Blue Gene/L, Red Storm, and Purple.
In Proceedings of the 2006 ACM/IEEE conference on Supercomputing
(SC 2006), pages 74–84, 2006.
G. Johnson, D. J. Kerbyson, and M. Lang. Optimization of Infiniband
for Scientific Applications. In IEEE International Parallel and Distributed
Processing Symposium (IPDPS 2008), April 2008.
D.J. Kerbyson, H.J. Alme, A. Hoisie, F. Petrini, H.J. Wasserman, and
M. Gittings. Predictive Performance and Scalability Modelling of
a Large-Scale Application. In Proceedings of the 2001 ACM/IEEE
conference on Supercomputing(SC 2001), 2001.
D.J. Kerbyson, A. Hoisie, and H.J. Wasserman. Use of Predictive Performance
Modeling During Large-Scale Systems Installation. In
1st Int. Workshop on Hardware/Software Support for Parallel and
Distributed Scientific and Engineering Computing, 2002.
D.J. Kerbyson, M. Lang, and G. Johnson. Infiniband Routing Table
Optimizations for Scientific Applications. Parallel Processing Letters,
18(4):589–608, 2008.
M.M. Mathis and D.J. Kerbyson. Performance Modeling of Unstructured
Mesh Particle Transport Computations. In Proceedings of International
Parallel and Distributed Processing Symposium (IPDPS
2004), Santa Fe, NM, April 2004.
M.M. Mathis, N.M. Amato, and M.L. Adams. A General Performance
Model for Parallel Sweeps on Orthogonal Grids for Particle Transport
Calculations. Technical report, Texas A&M University, 2000.
G.R. Mudalige, M.K. Vernon, and S.A. Jarvis. A Plug-and-Play Model
for Evaluating Wavefront Computations on Parallel Architectures.
In IEEE International Parallel and Distributed Processing Symposium
(IPDPS 2008), April 2008.
F. Petrini, D.J. Kerbyson, and S. Pakin. The Case of the Missing Supercomputer
Performance: Achieving Optimal Performance on the 8,
192 Processors of ASCI Q. In Proceedings of the 2003 ACM/IEEE
conference on Supercomputing (SC 2003), pages 55–62, 2003.
R. Reussner, P. Sanders, and M. Muller. SKaMPI: A Detailed, Accurate
MPI Benchmark. Recent advances in Parallel Virtual Machine and
Message Passing Interface, pages 52–59, 1998.
D. Sundaram-Stukel and M.K. Vernon. Predictive Analysis of a Wavefront
Application Using LogGP. In Proceedings of Principles and
Practice of Parallel Programming, pages 141–150, 1999.