Cloudera Distributed Hadoop (often abbreviated as CDH) is a popular Hadoop distribution. TYPICALLY, when running Gobblin on a CDH cluster it is recommended that one also compile Gobblin against the same CDH version. Not doing so may cause unexpected runtime behavior. To compile against a specific CDH version simply use the hadoopVersion parameter. For example, to compile against version 2.5.0-cdh5.3.0 run ./gradlew clean build -PuseHadoop2 -PhadoopVersion=2.5.0-cdh5.3.0.

Resolve Gobblin-on-MR Exception IOException: Not all tasks running in mapper attempt_id completed successfully

This exception usually just means that a Hadoop Map Task running Gobblin Tasks threw some exception. Unfortunately, the exception isn't truly indicative of the underlying problem, all it is REALLY saying is that something went wrong in the Gobblin Task. Each Hadoop Map Task has its own log FILE and it is often easiest to look at the logs of the Map Task when debugging this problem. There are multiple ways to do this, but one of the easiest ways is to execute YARN logs -applicationId <application ID> [OPTIONS]

Gradle Build Fails With Cannot invoke method getURLs on null object

ADD -x test to build the project without running the tests; this will make the exception go away. If one needs to run the tests then make sure Java Cryptography Extension is installed.

Cloudera Distributed Hadoop (often abbreviated as CDH) is a popular Hadoop distribution. Typically, when running Gobblin on a CDH cluster it is recommended that one also compile Gobblin against the same CDH version. Not doing so may cause unexpected runtime behavior. To compile against a specific CDH version simply use the hadoopVersion parameter. For example, to compile against version 2.5.0-cdh5.3.0 run ./gradlew clean build -PuseHadoop2 -PhadoopVersion=2.5.0-cdh5.3.0.

Resolve Gobblin-on-MR Exception IOException: Not all tasks running in mapper attempt_id completed successfully

This exception usually just means that a Hadoop Map Task running Gobblin Tasks threw some exception. Unfortunately, the exception isn't truly indicative of the underlying problem, all it is really saying is that something went wrong in the Gobblin Task. Each Hadoop Map Task has its own log file and it is often easiest to look at the logs of the Map Task when debugging this problem. There are multiple ways to do this, but one of the easiest ways is to execute yarn logs -applicationId <application ID> [OPTIONS]

Gradle Build Fails With Cannot invoke method getURLs on null object

Add -x test to build the project without running the tests; this will make the exception go away. If one needs to run the tests then make sure Java Cryptography Extension is installed.