An approach to cluster system task flow monitoring, analysis, and visualization

Authors

Keywords:

parallel computing, monitoring, tasks flow, computing cluster

Abstract

Big cluster systems are spreading wide, so that the efficiency of use of such systems is a very actual task for now. In order to solve this task, it is needed to identify the efficiency problems appearing during the task execution, to notify users about appeared problems, and to suggest possible ways to resolve them. This can be achieved by the continuous monitoring of running tasks and by data analysis. This paper discusses an approach to solve these tasks and describes a working prototype.

Author Biographies

References

Hewitt E. Cassandra: the definitive guide. Cambridge: O’Reilly Media, 2010.

White T. Hadoop: the definitive guide. Cambridge: O’Reilly Media, 2009.

Pig project (http://pig.apache.org/).

Downloads

Published

2011-11-10

Issue

Section

Section 2. Programming

Most read articles by the same author(s)

1 2 > >>