Computing Just What You Need: Online Data Analysis and Reduction at Extreme Scales


Foster I., Ainsworth M., Allen B., Bessac J., Cappello F., Choi J. Y., ...Daha Fazla

23rd International Conference on Parallel and Distributed Computing (Euro-Par), Santiago de Compostela, İspanya, 28 Ağustos - 01 Eylül 2017, cilt.10417, ss.3-19, (Tam Metin Bildiri) identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 10417
  • Doi Numarası: 10.1007/978-3-319-64203-1_1
  • Basıldığı Şehir: Santiago de Compostela
  • Basıldığı Ülke: İspanya
  • Sayfa Sayıları: ss.3-19
  • Orta Doğu Teknik Üniversitesi Adresli: Hayır

Özet

A growing disparity between supercomputer computation speeds and I/O rates makes it increasingly infeasible for applications to save all results for offline analysis. Instead, applications must analyze and reduce data online so as to output only those results needed to answer target scientific question(s). This change in focus complicates application and experiment design and introduces algorithmic, implementation, and programming model challenges that are unfamiliar to many scientists and that have major implications for the design of various elements of supercomputer systems. We review these challenges and describe methods and tools that we are developing to enable experimental exploration of algorithmic, software, and system design alternatives.