TR-2020-12
Cross Architecture Performance Prediction
Yuliana Zamora; Bethany Lusch; Venkat Vishwanath; Ian Foster; Henry Hoffmann. 20 December, 2020.
Communicated by Henry Hoffmann.
Superseded By: TR-2021-04 (updated 03/09/21)
Obsolete: Yes (updated 03/09/21)
Abstract
With the rate at which hardware evolves, predicting application performance on new architectures is extremely valuable. Prior work building frameworks to predict application performance on new architectures has required expert input,considered only a subset of applications, or required source code changes. Our goal is to create a general framework that can automatically predict application performance on a target hardware, given performance metrics from a different hardware architecture, without expert input. In this thesis, we propose such a framework and use it to compare classical machine learning approaches to advanced Deep Neural Networks generated through Neural Architecture Search (NAS). We implement a NAS workflow on the Theta supercomputer at Argonne National Laboratory, and use it create over 1 million deep learning models that predict performance on a target hardware architecture. When comparing these final models, we see little difference when employing a massively scaled neural architecture search compared to a random forest model. The results suggest that general application cross architecture prediction requires significantly more training data than used in this study data and/or additional feature engineering.Original Document
Please visit the new version: TR-2021-04
The obsoleted document is available in PDF (uploaded 20 December, 2020 by Henry Hoffmann).
Additional Document Formats
The document is also available in PDF (uploaded 9 March, 2021 by Henry Hoffmann).
NOTE: The author warrants that these additional documents are identical with the originial to the extent permitted by the translation between the various formats. However, the webmaster has made no effort to verify this claim. If the authenticity of the document is an issue, please always refer to the "Original document." If you find significant alterations, please report to webmaster@cs.uchicago.edu.
Comments
Comments are available on this technical report.