What is the use of balancer in HDFS?

1.	What is the use of balancer in HDFS?
Answer» Balancer is a utility provided by HDFS. As we know that, DataNodes stores the actual data related to any JOB or process. Datasets are divided into BLOCKS and these blocks are stored across the DataNodes in Hadoop cluster. Some of these nodes are underutilized and some are overutilized by the storage of blocks, so a balance needs to be maintained. Here comes the USE of balancer which analyses the BLOCK placement across various nodes and moves blocks from overutilized to underutilized nodes in order to maintain balance of data across the DataNodes until the cluster is DEEMED to be balanced.

Answer»

Balancer is a utility provided by HDFS. As we know that, DataNodes stores the actual data related to any JOB or process. Datasets are divided into BLOCKS and these blocks are stored across the DataNodes in Hadoop cluster. Some of these nodes are underutilized and some are overutilized by the storage of blocks, so a balance needs to be maintained.

Here comes the USE of balancer which analyses the BLOCK placement across various nodes and moves blocks from overutilized to underutilized nodes in order to maintain balance of data across the DataNodes until the cluster is DEEMED to be balanced.

Discussion

No Comment Found

Related InterviewSolutions

What do you mean by trigger in SQL?
What do you mean by SQL injection?
What do you mean by alias in SQL?
What are the differences between IN and BETWEEN operators?
What do you mean by SciPy?
Explain pass, continue and break statements in Python?
How can you differentiate between append() and extend() in Python?
Explain Decorator in Python?
How memory can be managed in Python?
How can you differentiate between “is” and “==” operators in Python?