InterviewSolution
Saved Bookmarks
InterviewSolution
| 1. |
What do you understand by worker node? |
|
Answer» Worker nodes are those nodes that run the Spark application in a cluster. The Spark driver program listens for the INCOMING connections and accepts them from the executors addresses them to the worker nodes for execution. A worker NODE is like a slave node where it gets the WORK from its master node and actually executes them. The worker nodes do data processing and REPORT the resources used to the master. The master decides what amount of resources needs to be allocated and then based on their availability, the tasks are scheduled for the worker nodes by the master. |
|