The Library
Light-weight parallel I/O analysis at scale
Tools
Wright, Steven A., Hammond, Simon D., Pennycook, Simon J. and Jarvis, Stephen A. (2011) Light-weight parallel I/O analysis at scale. In: 8th European Performance Workshop (EPEW11), Borrowdale, United Kingdom, 12-13th October, 2011. Published in: Lecture Notes in Computer Science, 6977 pp. 235-249. doi:10.1007/978-3-642-24749-1 ISSN 0302-9743.
|
PDF
WRAP-light-weight-parallel-analysis-scale-Wright-2018.pdf - Accepted Version - Requires a PDF viewer. Download (770Kb) | Preview |
Official URL: http://dx.doi.org/10.1007/978-3-642-24749-1
Abstract
Input/output (I/O) operations can represent a significant proportion of the run-time when large scientific applications are run in parallel. Although there have been advances in the form of file-format libraries, file system design and I/O hardware, a growing divergence exists between the performance of parallel file systems and compute processing rates. In this paper we utilise RIOT, an input/output tracing toolkit being developed at the University of Warwick, to assess the performance of three standard industry I/O benchmarks and mini-applications. We present a case study demonstrating the tracing and analysis capabilities of RIOT at scale, using MPI-IO, Parallel HDF-5 and MPI-IO augmented with the Parallel Log-structured File System (PLFS) middle-ware being developed by the Los Alamos National Laboratory.
Item Type: | Conference Item (Paper) | ||||
---|---|---|---|---|---|
Subjects: | Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software | ||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | ||||
Journal or Publication Title: | Lecture Notes in Computer Science | ||||
Publisher: | Springer | ||||
ISSN: | 0302-9743 | ||||
Official Date: | 27 January 2011 | ||||
Dates: |
|
||||
Volume: | 6977 | ||||
Page Range: | pp. 235-249 | ||||
DOI: | 10.1007/978-3-642-24749-1 | ||||
Status: | Peer Reviewed | ||||
Publication Status: | Published | ||||
Access rights to Published version: | Restricted or Subscription Access | ||||
Description: | Computer Performance Engineering |
||||
Date of first compliant deposit: | 1 August 2016 | ||||
Date of first compliant Open Access: | 5 September 2018 | ||||
Conference Paper Type: | Paper | ||||
Title of Event: | 8th European Performance Workshop (EPEW11) | ||||
Type of Event: | Workshop | ||||
Location of Event: | Borrowdale, United Kingdom | ||||
Date(s) of Event: | 12-13th October, 2011 |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year