A Job Dispatch Optimization Method on Cluster and Cloud for Large-Scale High-Throughput Computing Service
- Authors
- Choi J.; Kim S.; Adufu T.; Hwang S.; Kim Y.
- Issue Date
- Oct-2015
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- cloud computing; distribution ratio; high-throughput computing; job scheduling optimization
- Citation
- Proceedings - 2015 International Conference on Cloud and Autonomic Computing, ICCAC 2015, pp 283 - 290
- Pages
- 8
- Journal Title
- Proceedings - 2015 International Conference on Cloud and Autonomic Computing, ICCAC 2015
- Start Page
- 283
- End Page
- 290
- URI
- https://scholarworks.sookmyung.ac.kr/handle/2020.sw.sookmyung/10213
- DOI
- 10.1109/ICCAC.2015.42
- ISSN
- 0000-0000
- Abstract
- Cloud technologies, clusters and grids have actively supported large-scale scientific computing over the years. Whereas these technologies provide unlimited computing resources, combining them with the existing infrastructures to effectively support demanding scientific applications is more and more laborious. In this paper, we design a service architecture and propose an algorithm to optimize job distribution on a cluster and a cloud using HTCaaS. HTCaaS is a pilot job-based multilevel scheduling system for large-scale scientific computing in Korea. In addition, we present a newly added cloud module on HTCaaS which is based on OpenStack. We implement and validate the algorithm in HTCaaS. A preliminary experiment is also conducted to find an optimal distribution ratio for CPU-intensive jobs and I/O-intensive jobs in our cloud and cluster environments. We compare our method to a baseline approach which distributes tasks in proportions of the number of cores each resource has in order to validate the proposed job dispatch optimization method. Experimental results show that the proposed method can improve throughput and match tasks to appropriate resources using adaptive job distribution ratio in cloud and cluster environments. © 2015 IEEE.
- Files in This Item
-
Go to Link
- Appears in
Collections - 공과대학 > 소프트웨어학부 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.