An approach to cluster system task flow monitoring, analysis, and visualization
Keywords:
parallel computing, monitoring, tasks flow, computing clusterAbstract
Big cluster systems are spreading wide, so that the efficiency of use of such systems is a very actual task for now. In order to solve this task, it is needed to identify the efficiency problems appearing during the task execution, to notify users about appeared problems, and to suggest possible ways to resolve them. This can be achieved by the continuous monitoring of running tasks and by data analysis. This paper discusses an approach to solve these tasks and describes a working prototype.
References
Hewitt E. Cassandra: the definitive guide. Cambridge: O’Reilly Media, 2010.
White T. Hadoop: the definitive guide. Cambridge: O’Reilly Media, 2009.
Pig project (http://pig.apache.org/).
Downloads
Published
2011-11-10
Issue
Section
Section 2. Programming