The Library
Enabling portable I/O analysis of commercially sensitive HPC applications through workload replication
Tools
Dickson, James, Wright, Steven A., Maheswaran, Satheesh, Herdman, J. A., Harris, Duncan, Miller, Mark C. and Jarvis, Stephen A. (2017) Enabling portable I/O analysis of commercially sensitive HPC applications through workload replication. In: Cray User Group 2017, Redmond, California, USA, 7-12 May 2017. Published in: Cray User Group 2017 Proceedings (CUG2017 Proceedings) pp. 1-14.
|
PDF
WRAP-enabling-portable I-O-analysis-commercially-Dickson-2017.pdf - Published Version - Requires a PDF viewer. Download (604Kb) | Preview |
Official URL: https://cug.org/proceedings/cug2017_proceedings/by...
Abstract
Benchmarking and analyzing I/O performance across high performance computing (HPC) platforms is necessary to identify performance bottlenecks and guide effective use of new and existing storage systems. Doing this with large production applications, which can often be commercially sensitive and lack portability, is not a straightforward task and the availability of a representative proxy for I/O workloads can help to provide a solution. We use Darshan I/O characterization and the MACSio proxy application to replicate five production workloads, showing how these can be used effectively to investigate I/O performance when migrating between HPC systems ranging from small local clusters to leadership scale machines. Preliminary results indicate that it is possible to generate datasets that match the target application with a good degree of accuracy. This enables a predictive performance analysis study of a representative workload to be conducted on five different systems. The results of this analysis are used to identify how workloads exhibit different I/O footprints on a file system and what effect file system configuration can have on performance.
Item Type: | Conference Item (Paper) | ||||||
---|---|---|---|---|---|---|---|
Subjects: | Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software | ||||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | ||||||
Library of Congress Subject Headings (LCSH): | High performance computing -- Research | ||||||
Journal or Publication Title: | Cray User Group 2017 Proceedings (CUG2017 Proceedings) | ||||||
Publisher: | Cray User Group | ||||||
Official Date: | May 2017 | ||||||
Dates: |
|
||||||
Page Range: | pp. 1-14 | ||||||
Status: | Peer Reviewed | ||||||
Publication Status: | Published | ||||||
Access rights to Published version: | Open Access (Creative Commons) | ||||||
Date of first compliant deposit: | 2 May 2017 | ||||||
Date of first compliant Open Access: | 31 July 2017 | ||||||
Funder: | Atomic Weapons Establishment (Great Britain) (AWE) | ||||||
Grant number: | Grant CDK0724 (AWE Technical Outreach Programme) | ||||||
Conference Paper Type: | Paper | ||||||
Title of Event: | Cray User Group 2017 | ||||||
Type of Event: | Conference | ||||||
Location of Event: | Redmond, California, USA | ||||||
Date(s) of Event: | 7-12 May 2017 | ||||||
Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year