The Library
Replicating HPC I/O workloads with proxy applications
Tools
Tools
Tools
Dickson, James, Wright, Steven A., Maheswaran, Satheesh, Herdman, J. A., Miller, Mark C. and Jarvis, Stephen A. (2016) Replicating HPC I/O workloads with proxy applications. In: 1st Joint International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems (PDSW-DISCS'16), Salt Lake City, Utah, USA, 14 Nov 2016. Published in: 2016 1st Joint International Workshop on Parallel Data Storage and data Intensive Scalable Computing Systems (PDSW-DISCS) ISBN 9781509052165.
|
PDF
WRAP-Replicating-HPC-IO-workloads-Dickson-2016.pdf - Accepted Version - Requires a PDF viewer. Download (440Kb) | Preview |
Official URL: http://doi.org/10.1109/PDSW-DISCS.2016.007
Abstract
Large scale simulation performance is dependent on a number of components, however the task of investigation and optimization has long favored computational and communication elements above I/O. Manually extracting the pattern of I/O behavior from a parent application is a useful way of working to address performance issues on a per-application basis, but developing workflows with some degree of automation and flexibility provides a more powerful approach to tackling current and future I/O challenges. In this paper we describe a workload replication workflow that extracts the I/O pattern of an application and recreates its behavior with a flexible proxy application. We demonstrate how simple lightweight characterization can be translated to provide an effective representation of a physics application, and show how a proxy replication can be used as a tool for investigating I/O library paradigms.
| Item Type: | Conference Item (Paper) | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Subjects: | Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software | |||||||||
| Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | |||||||||
| Library of Congress Subject Headings (LCSH): | Mathematical optimization -- Computer programs, Input-output analysis, Subroutines (Computer programs), High performance computing | |||||||||
| Journal or Publication Title: | 2016 1st Joint International Workshop on Parallel Data Storage and data Intensive Scalable Computing Systems (PDSW-DISCS) | |||||||||
| ISBN: | 9781509052165 | |||||||||
| Official Date: | 2 February 2016 | |||||||||
| Dates: |
|
|||||||||
| Status: | Peer Reviewed | |||||||||
| Publication Status: | Published | |||||||||
| Date of first compliant deposit: | 7 October 2016 | |||||||||
| Date of first compliant Open Access: | 11 October 2016 | |||||||||
| RIOXX Funder/Project Grant: |
|
|||||||||
| Conference Paper Type: | Paper | |||||||||
| Title of Event: | 1st Joint International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems (PDSW-DISCS'16) | |||||||||
| Type of Event: | Workshop | |||||||||
| Location of Event: | Salt Lake City, Utah, USA | |||||||||
| Date(s) of Event: | 14 Nov 2016 | |||||||||
| Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
