1.

What are the steps when you run the YARN job by calling submitApplication() method?

Answer»
  1. If any job is submitted by a client, it will come to the resource manager and resource manager is has a scheduler. It is the duty of the resource manager to SEE and calculate the required RESOURCES to run the job.
  2. Once it has calculated the number of resources whatever required, then the resource manager launches application specific application master.
  3. Application master daemon will be available until the job got completed.
  4. Application master is responsible to negotiate the resources from the resource manager. It MEANS application master will ask for more or fewer resources based on the requirement to the resource manager.
  5. Application master launches the CONTAINER in different node manager when data will be available.
  6. The container will be working under the surveillance of the node manager, so node manager is responsible for all the containers available in that node. The container will GIVE periodic updates to the application master about the job.
  7. Once the job was completed and the container/resources are freed up then the application master updates to the resource manager about the completion of job and client will get the update from the resource manager.


Discussion

No Comment Found

Related InterviewSolutions