Improving Hadoop Hive Query Response Times Through Efficient Virtual Resource Allocation

Dokeroglu T., Cinar M. S., SERT S. A., COŞAR A., YAZICI A.

11th International Conference on Flexible Query Answering Systems (FQAS), Cracow, Polonya, 26 - 28 Ekim 2015, cilt.400, ss.215-225 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 400
  • Doi Numarası: 10.1007/978-3-319-26154-6_17
  • Basıldığı Şehir: Cracow
  • Basıldığı Ülke: Polonya
  • Sayfa Sayıları: ss.215-225
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

The performance of the MapReduce-based Cloud data warehouses mainly depends on the virtual hardware resources allocated. Most of the time, the resources are values selected/given by the Cloud service providers. However, setting the right virtual resources in accordance with the workload demands of a query, such as the number of CPUs, the size of RAM, and the network bandwidth, will improve the response time when querying large data on an optimized system. In this study, we carried out a set of experiments with a well-known Mapreduce SQL-translator, Hadoop Hive, on benchmark decision support the TPC benchmark (TPC-H) database in order to analyze the performance sensitivity of the queries under different virtual resource settings. Our results provide valuable hints for the decision makers who design efficient MapReduce-based data warehouses on the Cloud.