InterviewSolution
Saved Bookmarks
InterviewSolution
| 1. |
Every hour Hadoop runs 100 jobs in parallel. Now currently, single job is running. How much of the resource capacity of the cluster will be used by this running single job? |
|
Answer» Under the Fair scheduler when a single application is running that application may request the entire cluster (if NEEDED). If additional applications are submitted, resources that are free are assigned "FAIRLY" to the NEW application so that each application gets roughly the same amount of resources. Fair scheduler organizes application further into queues and shares resources fairly between these queues. The fair scheduler in YARN supports hierarchical queues which means sub-queues can be created within a dedicated queue. All queues descend from a queue named “root”.A queue’s name starts with the names of its parents, with periods as separators. So a queue named “PARENT1” under the root queue would be referred to as “root.parent1”, and a queue named “queue2” under a queue named “parent1” would be referred to as “root.parent1.queue2” |
|