When Running On Hadoop, Each Map Task Quickly Reaches 100 Percent Com

1.	When Running On Hadoop, Each Map Task Quickly Reaches 100 Percent Completion, But Then Stalls For A Long Time. Why Does This Happen?
Answer» GOBBLIN CURRENTLY USES Hadoop map tasks as a container for running Gobblin tasks. Each map task runs 1 or more Gobblin workunits, and the progress of each workunit is not HOOKED into the progress of each map task. Even though the Hadoop JOB reports 100% completion, Gobblin is still doing work. Gobblin currently uses Hadoop map tasks as a container for running Gobblin tasks. Each map task runs 1 or more Gobblin workunits, and the progress of each workunit is not hooked into the progress of each map task. Even though the Hadoop job reports 100% completion, Gobblin is still doing work.

When Running On Hadoop, Each Map Task Quickly Reaches 100 Percent Completion, But Then Stalls For A Long Time. Why Does This Happen?

Answer»

GOBBLIN CURRENTLY USES Hadoop map tasks as a container for running Gobblin tasks. Each map task runs 1 or more Gobblin workunits, and the progress of each workunit is not HOOKED into the progress of each map task. Even though the Hadoop JOB reports 100% completion, Gobblin is still doing work.

Gobblin currently uses Hadoop map tasks as a container for running Gobblin tasks. Each map task runs 1 or more Gobblin workunits, and the progress of each workunit is not hooked into the progress of each map task. Even though the Hadoop job reports 100% completion, Gobblin is still doing work.

Discussion

No Comment Found

Related InterviewSolutions

How Do I Add A New Maven Repository To Pull Artifacts From?
How Do I Add A New External Dependency?
How Do I Compile Gobblin Against Cdh?
How Do I Fix Unsupportedfilesystemexception: No Abstractfilesystem For Scheme: Null?
Why Does Gobblin On Hadoop Stall For A Long Time Between Adding Files To The Distrbutedcache, And Launching The Actual Job?
When Running On Hadoop, Each Map Task Quickly Reaches 100 Percent Completion, But Then Stalls For A Long Time. Why Does This Happen?
How Is Gobblin Different From Sqoop?
How Do I Run And Schedule A Gobblin Job?
What Hadoop Version Can Gobblin Run On?
Does Gobblin Require Any External Software To Be Installed?