The Library
MINIO : an I/O benchmark for investigating high level parallel libraries
Tools
Tools
Tools
Dickson, James, Maheswaran, Satheesh, Wright, Steven A., Herdman, J. A. and Jarvis, Stephen A. (2015) MINIO : an I/O benchmark for investigating high level parallel libraries. In: 27th ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC’15), Austin, Texas, USA, 15-20 Nov 2015
|
PDF
WRAP_ExtendedAbstract + Conference poster.pdf - Accepted Version - Requires a PDF viewer. Download (691Kb) | Preview |
Official URL: http://sc15.supercomputing.org/schedule/event_deta...
Abstract
Input/output (I/O) operations are one of the biggest challenges facing scientific computing as it transitions to exascale. The traditional software stack – com- prising of parallel file systems, middlewares and high level libraries – has evolved to enable applications to better cope with the demands of enormous datasets. This software stack makes high performance parallel I/O easily accessible to application engineers, however it is important to ensure best performance is not compromised through attempts to enrich these libraries. We present MINIO, a benchmark for the investigation of I/O behaviour focusing on understanding overheads and inefficiencies in high level library usage. MINIO uses HDF5 and TyphonIO to explore I/O at scale using different application behavioural pat- terns. A case study is performed using MINIO to identify performance limiting characteristics present in the TyphonIO library as an example of performance discrepancies in the I/O stack.
| Item Type: | Conference Item (Poster) | ||||
|---|---|---|---|---|---|
| Subjects: | Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software | ||||
| Divisions: | Faculty of Science > Computer Science | ||||
| Library of Congress Subject Headings (LCSH): | Computer input-output equipment | ||||
| Official Date: | 16 September 2015 | ||||
| Dates: |
|
||||
| Date of first compliant deposit: | 5 January 2016 | ||||
| Status: | Peer Reviewed | ||||
| Publication Status: | Published | ||||
| Conference Paper Type: | Poster | ||||
| Title of Event: | 27th ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC’15) | ||||
| Type of Event: | Conference | ||||
| Location of Event: | Austin, Texas, USA | ||||
| Date(s) of Event: | 15-20 Nov 2015 | ||||
| Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
