Error Repository

Oozie Share Lib does not exist error 1

This entry was posted in Error Repository on by

In this post we will discuss about one of common/frequent error message faced by many oozie beginners due to incorrect/incomplete oozie setup. Oozie Share Lib does not exist error is received if oozie sharelib is not installed properly. Error Scenario: java.io.FileNotFoundException: File /user/user/share/lib does not exist This error message we will get when we submit any oozie job with below property set to true in job.properties file

and if you […]

Exhausted available authentication methods

This entry was posted in Error Repository on by

In this post we will discuss about common problem in installing cloudera manager 5.3.2 on Ubuntu 14.04 machine and solution for the root cause. Problem: When installing Cloudera Manager 5.3.2 on Ubuntu 14.04.2 Machine getting below error messages after giving root privileges on ssh configuration page. Exhausted available authentication methods or Installation failed on all hosts. Installation failed. Failed to authenticate In this case, ssh to root might be a […]

Cannot create an instance of InputFormat

This entry was posted in Error Repository and tagged cannot create an instance of inputformat class org.apache.hadoop.mapred.textinputformat hive cannot create an instance of inputformat class on by

Error Scenario: java.io.IOException: Cannot create an instance of InputFormat class We will get this error message when we try to execute simple hadoop fs commands or running any hive queries. Below is the complete error message.

Root Cause: This error message will be received when there are any spaces or spelling mistakes in any of the site.xml configuration file. Suppose in below core-site.xml file value for io.compression.codecs has spaces which […]

JDOFatalDataStoreException: Communications link failure

This entry was posted in Error Repository and tagged Error in metadata: javax.jdo.JDOFatalDataStoreException Error in starting hive metastore Hive MetaStore not starting Starting Hive Metastore Server error on by

Error Scenario: javax.jdo.JDOFatalDataStoreException: Communications link failure We get this error message when starting hive metastore service with MySQL as local metastore. This error message is received when MySQL database is not created properly or it is not updated with the tables correctly while configuring it as hive metastore database. While configuring hive metastore with MySQL, some times, metastore database (say hive_metastore_db) will not be created properly with all of the […]

NoClassDefFoundError or ClassNotFoundException

This entry was posted in Error Repository and tagged ClassNotFoundException Container exited with a non-zero exit code 1 Error starting MRAppMaster fatal org.apache.hadoop.mapreduce.v2.app.mrappmaster error starting mrappmaster hadoop mapreduce container exited with a non zero exit code 1 hadoop mapreduce Error starting MRAppMaster NoClassDefFoundError on by

In this post we will discuss about most frequent error messages NoClassDefFoundError or ClassNotFoundException in hadoop mapreduce jobs execution and possible solutions for them. Error Scenario: java.lang.ClassNotFoundException or java.lang.NoClassDefFoundError Error starting MRAppMaster & Container exited with a non-zero exit code 1 When we encounter a situation of NoClassDefFoundError or ClassNotFoundException even though we have required jar files added to our build path in eclipse, then we have […]

Hadoop Integration – Avro Errors 1

This entry was posted in Avro Error Repository and tagged Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.addDeprecations hadoop Bad connection to FS. command aborted. exception: org.apache.hadoop.ipc.RemoteException:Server IPC version 9 cannot communicate with client version 4 Server IPC version 7 cannot communicate with client version 4 Server IPC version 9 cannot communicate with client version 4 on by

In this post we will discuss about some of the errors or exceptions that can occur when there is mismatch in the integration of Avro and Hadoop distributions. When we do not use the correct version of avro release then we will run into so many errors or exceptions. In this post, we will consider the version compatibility for Hadoop-2.3.0 release. As it is Hadoop2 we need to use the […]

Expected timestamp in the Flume event headers, but it was null 1

This entry was posted in Error Repository and tagged flume hdfs.useLocalTimeStamp flume TimestampInterceptor HDFS sink with format escape sequences on by

Error Scenario: Expected timestamp in the Flume event headers, but it was null – NullPointerException This error message is received in ~/logs/flume.log file when starting a flume agent with HDFS sink with format escape sequences.(%Y, %M, %D, %H, %M, %S).