HDNN: a cross-platform MLIR dialect for deep neural networks

Antonio Martinez P., Bernabe G., Manuel Garcia J.

JOURNAL OF SUPERCOMPUTING, cilt.78, sa.11, ss.13814-13830, 2022 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 78 Sayı: 11
  • Basım Tarihi: 2022
  • Doi Numarası: 10.1007/s11227-022-04417-3
  • Dergi Adı: JOURNAL OF SUPERCOMPUTING
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Applied Science & Technology Source, Compendex, Computer & Applied Sciences, INSPEC, zbMATH
  • Sayfa Sayıları: ss.13814-13830
  • Anahtar Kelimeler: High-performance computing, LLVM, MLIR, Heterogeneous computing, Domain-specific languages, Deep neural networks
  • Orta Doğu Teknik Üniversitesi Adresli: Hayır

Özet

This paper presents HDNN, a proof-of-concept MLIR dialect for cross-platform computing specialized in deep neural networks. As target devices, HDNN supports CPUs, GPUs and TPUs. In this paper, we provide a comprehensive description of the HDNN dialect, outlining how this novel approach aims to solve the P-3 problem of parallel programming (portability, productivity, and performance). An HDNN program is device-agnostic, i.e., only the device specifier has to be changed to run a given workload in one device or another. Moreover, HDNN has been designed to be a domain-specific language, which ultimately helps programming productivity. Finally, HDNN relies on optimized libraries for heavy, performance-critical work-loads. HDNN has been evaluated against other state-of-the-art machine learning frameworks on all the hardware platforms achieving excellent performance. We conclude that the ideas and concepts used in HDNN can be crucial for designing future generation compilers and programming languages to overcome the challenges of the forthcoming heterogeneous computing era.