The Library
The effect of an application performance modelling tool
Tools
Smith, J. A., Hammond, Simon D. and Jarvis, Stephen A. (2011) The effect of an application performance modelling tool. In: UK Performance Engineering Workshop (UKPEW'11), Bradford, United Kingdom, 7-8 July, 2011 (Unpublished)
|
PDF
WRAP_Jarvis_ukpew2011_submission_25.pdf - Published Version - Requires a PDF viewer. Download (419Kb) | Preview |
Official URL: http://www.inf.brad.ac.uk/ukpew11/
Abstract
One of the most important metrics of machine efficiency in HPC is job turnaround time, which is the time taken for a user to submit a job and recieve their results. This time consists of two primary components; run-time, which depends on the resources allocated to the job, and queue wait time, which is dependent on the resources requested and the present level of machine usage. This paper investigates the effect of applying application performance modelling techniques to producing run-time estimates for jobs to be scheduled on parallel High Performance Computing systems. Our aim through the development of such tools is to improve turnaround time for jobs across the system. This investigation is performed from the perspective of a community of HPC users who would make use of a tool to assist in job submission. We implement and validate a higher performance implementation of the scheduling algorithm used by the Maui scheduler and demonstrate that it matches the behaviour of an existing Maui configuration. We formulate a method for generating potential performance model results and use it to to modify three workloads from production supercomputers to include generated performance model wall-time estimates. We then apply the scheduling simulator to the workloads in order to simulate the effect of using of such a tool for the three real workloads. Examining the results from the simulation, we show a randomly selected sample set of tool users obtaining and improvement of upto 23% in average queuing time, and conclude that a tool that uses performance models to generate improved wall-time estimates would be beneficial to users of HPC systems.
Item Type: | Conference Item (Paper) | ||||
---|---|---|---|---|---|
Subjects: | Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software | ||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | ||||
Library of Congress Subject Headings (LCSH): | High performance computing, Computer scheduling | ||||
Official Date: | 8 July 2011 | ||||
Dates: |
|
||||
Status: | Not Peer Reviewed | ||||
Publication Status: | Unpublished | ||||
Date of first compliant deposit: | 28 July 2016 | ||||
Date of first compliant Open Access: | 28 July 2016 | ||||
Conference Paper Type: | Paper | ||||
Title of Event: | UK Performance Engineering Workshop (UKPEW'11) | ||||
Type of Event: | Workshop | ||||
Location of Event: | Bradford, United Kingdom | ||||
Date(s) of Event: | 7-8 July, 2011 |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year