Login Register Cart 0
Generic placeholder image

Recent Advances in Computer Science and Communications

Editor-in-Chief

ISSN (Print): 2666-2558
ISSN (Online): 2666-2566

Back
Journal Home About Journal Editorial Board Current Issue Volumes/Issues
Subscribe
Research Article

Data Placement Oriented Scheduling Algorithm for Scheduling Scientific Workflow in Cloud: A Budget-Aware Approach

Author(s): Avinash Kaur*, Pooja Gupta, Parminder Singh and Manpreet Singh

Volume 13, Issue 5, 2020

Page: [871 - 883] Pages: 13

DOI: 10.2174/2666255813666190925141324

Price: $65

Abstract

Background: A large number of communities and enterprises deploy numerous scientific workflow applications on cloud service.

Aims: The main aim of the cloud service provider is to execute the workflows with a minimal budget and makespan. Most of the existing techniques for budget and makespan are employed for the traditional platform of computing and are not applicable to cloud computing platforms with unique resource management methods and pricing strategies based on service.

Methods: In this paper, we studied the joint optimization of cost and makespan of scheduling workflows in IaaS clouds, and proposed a novel workflow scheduling scheme. Also, data placement is included in the proposed algorithm.

Results: In this scheme, DPO-HEFT (Data Placement Oriented HEFT) algorithm is developed which closely integrates the data placement mechanism with the list scheduling heuristic HEFT. Extensive experiments using the real-world and synthetic workflow demonstrate the efficacy of our scheme.

Conclusion: Our scheme can achieve significantly better cost and makespan trade-off fronts with remarkably higher hypervolume and can run up to hundreds times faster than the state-of-the-art algorithms.

Keywords: Cloud computing, workflow scheduling, data placement, HEFT, budget-aware, IaaS.

Graphical Abstract

[1]
T. Wu, H. Gu, J. Zhou, T. Wei, X. Liu, and M. Chen, "Soft error-aware energy-efficient task scheduling for workflow applications in DVFS-enabled cloud", J. Systems Archit., vol. 84, pp. 12-27, 2018.
[http://dx.doi.org/10.1016/j.sysarc.2018.03.001]
[2]
X. Zhang, "Energy-aware virtual machine allocation for cloud with resource reservation", J. Syst. Softw., vol. 147, pp. 147-161, 2019.
[http://dx.doi.org/10.1016/j.jss.2018.09.084]
[3]
Z. Zhu, G. Zhang, M. Li, and X. Liu, "Evolutionary multi-objective workflow scheduling in cloud", IEEE Trans. Parallel Distrib. Syst., vol. 27, no. 5, pp. 1344-1357, 2016.
[http://dx.doi.org/10.1109/TPDS.2015.2446459]
[4]
E.N. Alkhanak, S.P. Lee, and S.U.R. Khan, "Cost-aware challenges for workflow scheduling approaches in cloud computing environments: Taxonomy and opportunities", Future Gener. Comput. Syst., vol. 50, pp. 3-21, 2015.
[http://dx.doi.org/10.1016/j.future.2015.01.007]
[5]
H. Topcuoglu, S. Hariri, and M. Wu, "Performance-effective and low-complexity task scheduling for heterogeneous computing", IEEE Trans. Parallel Distrib. Syst., vol. 13, no. 3, pp. 260-274, 2002.
[http://dx.doi.org/10.1109/71.993206]
[6]
Z. Tang, X. Zhang, K. Li, and K. Li, "An intermediate data placement algorithm for load balancing in spark computing environment", Future Gener. Comput. Syst., vol. 78, pp. 287-301, 2018.
[http://dx.doi.org/10.1016/j.future.2016.06.027]
[7]
L. Xu, K. Wang, Z. Ouyang, and X. Qi, "An improved binary PSO-based task scheduling algorithm in green cloud computing", In: 9th International Conference on Communications and Networking in China, pp. 126-131. 2014
[http://dx.doi.org/10.1109/CHINACOM.2014.7054272 ]
[8]
S. Mullainathan, and J. Spiess, "Machine learning: An applied econometric approach", J. Econ. Perspect., vol. 31, no. 2, pp. 87-106, 2017.
[http://dx.doi.org/10.1257/jep.31.2.87]
[9]
K. Li, "Energy and time constrained task scheduling on multiprocessor computers with discrete speed levels", J. Parallel Distrib. Comput., vol. 95, pp. 15-28, 2016.
[http://dx.doi.org/10.1016/j.jpdc.2016.02.006]
[10]
H. Arabnejad, and J.G. Barbosa, "List scheduling algorithm for heterogeneous systems by an optimistic cost table", IEEE Trans. Parallel Distrib. Syst., vol. 25, no. 3, pp. 682-694, 2014.
[http://dx.doi.org/10.1109/TPDS.2013.57]
[11]
V. Kumar, C.P. Katti, and P.C. Saxena, "A novel task scheduling algorithm for heterogeneous computing", Int. J. Comput. Appl., vol. 85, no. 18, 2014.
[12]
M.F. Akbar, E.U. Munir, M.M. Rafique, Z. Malik, S.U. Khan, and L.T. Yang, "List-based task scheduling for cloud computing,", In: IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), pp. 652-659. 2016
[http://dx.doi.org/10.1109/iThings-GreenCom-CPSCom- SmartData.2016.143]
[13]
L. Zeng, B. Veeravalli, and X. Li, "SABA: A security-aware and budget-aware workflow scheduling strategy in clouds", J. Parallel Distrib. Comput., vol. 75, pp. 141-151, 2015.
[http://dx.doi.org/10.1016/j.jpdc.2014.09.002]
[14]
H.M. Fard, R. Prodan, and T. Fahringer, "A truthful dynamic workflow scheduling mechanism for commercial multicloud environments", IEEE Trans. Parallel Distrib. Syst., vol. 24, no. 6, pp. 1203-1212, 2013.
[http://dx.doi.org/10.1109/TPDS.2012.257]
[15]
R.N. Calheiros, and R. Buyya, "Meeting deadlines of scientific workflows in public clouds with tasks replication", IEEE Trans. Parallel Distrib. Syst., vol. 25, no. 7, pp. 1787-1796, 2014.
[http://dx.doi.org/10.1109/TPDS.2013.238]
[16]
M. Malawski, G. Juve, E. Deelman, and J. Nabrzyski, "Algorithms for cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds", Future Gener. Comput. Syst., vol. 48, pp. 1-18, 2015.
[http://dx.doi.org/10.1016/j.future.2015.01.004]
[17]
C.Q. Wu, X. Lin, D. Yu, W. Xu, and L. Li, "End-to-end delay minimization for scientific workflows in clouds under budget constraint", IEEE Trans. Cloud Comput., vol. 3, no. 2, pp. 169-181, 2015.
[http://dx.doi.org/10.1109/TCC.2014.2358220]
[18]
D.M. Abdelkader, and F. Omara, "Dynamic task scheduling algorithm with load balancing for heterogeneous computing system, Egypt", Informatics J., vol. 13, no. 2, pp. 135-145, 2012.
[19]
Avinash. Kaur, "Hybrid balanced task clustering algorithm for scientific workflows in cloud computing. Scalable computing", Practice and Experience, vol. 20, no. 2, pp. 237-258, 2019.
[http://dx.doi.org/10.12694/scpe.v20i2.1515]
[20]
K. Avinash, and G. Pooja, "A data placement strategy based on crow search algorithm in cloud computing", Recent Pat. Comput. Sci., vol. 12, no. 1, 2019.
[21]
K. Chong, S. Mandyam, and K. Vedati, "Workflow code generator, Symbol Technologies LLC, U. S. Patent, 7,152,229, December 19,", 2006
[22]
M. Wang, K. Ramamohanarao, and J. Chen, "Trust-based robust scheduling and runtime adaptation of scientific workflow", Concurr. Comput. Pract. Exp., vol. 21, no. 16, pp. 1982-1998, 2009.
[http://dx.doi.org/10.1002/cpe.1456]
[23]
Y. Caniou, E. Caron, A.K.W. Chang, and Y. Robert, "Budget-aware scheduling algorithms for scientific workflows with stochastic task weights on heterogeneous IaaS cloud platforms", In: IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), pp. 15-26. 2018
[http://dx.doi.org/10.1109/IPDPSW.2018.00014]

Rights & Permissions Print Cite
Article Metrics
4
© 2024 Bentham Science Publishers | Privacy Policy