This ERROR typically occurs due to Hadoop version conflict issues. If Gobblin is COMPILED against a specific Hadoop version, but then deployed on a different Hadoop version or installation, this error may be thrown. For example, if you simply COMPILE Gobblin using ./gradlew clean build -PuseHadoop2, but deploy Gobblin to a cluster with CDH installed, you may hit this error.

It is important to realize that the the gobblin-dist.tar.gz file produced by ./gradlew clean build will include all the Hadoop jar dependencies; and if one follows the MR deployment guide, Gobblin will be launched with these dependencies on the classpath.

To fix this take the following steps:

• Delete all the Hadoop jars from the Gobblin lib folder
• Ensure that the environment variable HADOOP_CLASSPATH is SET and points to a directory containing the Hadoop libraries for the cluster

This error typically occurs due to Hadoop version conflict issues. If Gobblin is compiled against a specific Hadoop version, but then deployed on a different Hadoop version or installation, this error may be thrown. For example, if you simply compile Gobblin using ./gradlew clean build -PuseHadoop2, but deploy Gobblin to a cluster with CDH installed, you may hit this error.

It is important to realize that the the gobblin-dist.tar.gz file produced by ./gradlew clean build will include all the Hadoop jar dependencies; and if one follows the MR deployment guide, Gobblin will be launched with these dependencies on the classpath.

To fix this take the following steps: