RIOT - a parallel input/output tracer
Wright, Steven A., Pennycook, Simon J., Hammond, Simon D. and Jarvis, Stephen A. (2011) RIOT - a parallel input/output tracer. In: Proceedings of the UK Performance Engineering Workshop (UKPEW'11), Bradford, United Kingdom, 7-8 July, 2011Full text not available from this repository.
Official URL: http://www.inf.brad.ac.uk/ukpew11/
Input/output (I/O) operations can represent a significant proportion of the run-time when large scientific applications are run in parallel. Although there have been advances in the form of file-format libraries, file-system design and I/O hardware, a growing divergence exists between the performance of parallel file-systems and compute processing rates. The effect is often a bottleneck when any form of file-system interaction is required. In this paper we present RIOT – an input/output tracing toolkit being developed at the University of Warwick for dynamic attachment to parallel applications. The two-stage tracing process includes a lightweight library to record I/O events and an in-depth post-execution analysis tool to extract performance metrics such as MPI-IO bandwidth, effective POSIX/file-system bandwidth, duration of individual or aggregated time spent in obtaining or releasing file locks and temporal information relating to parallel file activity. We present a case study on the use of RIOT for three standard industry I/O benchmarks: the BT-IO micro-application from NASA’s Parallel Benchmark suite, FLASH-IO, a benchmark which replicates the check-pointing operations of the FLASH thermonuclear star modelling code and IOR, an industry standard I/O benchmark using HDF-5 and MPI-IO. Furthermore, we utilise RIOT to assess these codes when running with the Parallel Log-structured File System (PLFS) middleware developed by the Los Alamos National Laboratory.
|Item Type:||Conference Item (Paper)|
|Subjects:||Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software|
|Divisions:||Faculty of Science > Computer Science|
|Date:||7 July 2011|
|Conference Paper Type:||Paper|
|Title of Event:||Proceedings of the UK Performance Engineering Workshop (UKPEW'11)|
|Type of Event:||Workshop|
|Location of Event:||Bradford, United Kingdom|
|Date(s) of Event:||7-8 July, 2011|
Actions (login required)