Scheduling in an unstructured peer‐to‐peer‐based high performance computing system

Fei Luo (School of Information and Engineering, Eastern China University of Science and Technology, Shanghai, China)
Hai Jin (Services Computing Technology and System Lab, Cluster and Grid Computing Lab, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China)
Xiaofei Liao (Services Computing Technology and System Lab, Cluster and Grid Computing Lab, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China)
Qin Zhang (Services Computing Technology and System Lab, Cluster and Grid Computing Lab, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China)

Kybernetes

ISSN: 0368-492X

Publication date: 12 October 2012

Abstract

Purpose

Peer‐to‐peer (P2P) communities have the capability to construct a powerful virtual supercomputer by assembling idle internet cycles. The purpose of this paper is to present the scheduling issues in an unstructured P2P‐based high performance computing (HPC) system to achieve high performance for applications.

Design/methodology/approach

A new application model is proposed for the system, where applications are parallelized in the program level. To address high performance for these applications, the system resources are controlled in a semi‐centralized 3‐layer network, where volunteers form many autonomous unstructured P2P domains. Furthermore, based on such a resource management policy, a job scheduling strategy is adopted, which is collaborated by global and domain scheduling. The global scheduling is responsible for the balance among domains, while the domain scheduling resolve workpiles' execution in a domain.

Findings

Theoretical analysis and a benchmark experiment show that the scheduling provides scalable and enormous computing capability in the P2P‐based HPC system.

Originality/value

The paper shows that scheduling helps P2HP (an unstructured P2P‐based HPC system) provide scalable and enormous computing capability for HPC applications.

Keywords

Citation

Luo, F., Jin, H., Liao, X. and Zhang, Q. (2012), "Scheduling in an unstructured peer‐to‐peer‐based high performance computing system", Kybernetes, Vol. 41 No. 9, pp. 1209-1215. https://doi.org/10.1108/03684921211275225

Download as .RIS

Publisher

:

Emerald Group Publishing Limited

Copyright © 2012, Emerald Group Publishing Limited

Please note you might not have access to this content

You may be able to access this content by login via Shibboleth, Open Athens or with your Emerald account.
If you would like to contact us about accessing this content, click the button and fill out the form.
To rent this content from Deepdyve, please click the button.