Cannot create an instance of InputFormat


Error Scenario:

java.io.IOException: Cannot create an instance of InputFormat class

We will get this error message when we try to execute simple hadoop fs commands or running any hive queries. Below is the complete error message.

Root Cause:

This error message will be received when there are any spaces or spelling mistakes in any of the site.xml configuration file. Suppose in below core-site.xml file value for io.compression.codecs has spaces which is resulting in the above error message while running hive queries on sequence files using snappy codec.

Solution:

We need to make sure there are no spaces or spell mistakes in core-site.xml, mapred-site.xml, yarn-site.xml, hdfs-site.xml, hive-site.xml or hbase-site.xml files. In the above core-site.xml file we need change that to as shown below.


Profile photo of Siva

About Siva

Senior Hadoop developer with 4 years of experience in designing and architecture solutions for the Big Data domain and has been involved with several complex engagements. Technical strengths include Hadoop, YARN, Mapreduce, Hive, Sqoop, Flume, Pig, HBase, Phoenix, Oozie, Falcon, Kafka, Storm, Spark, MySQL and Java.

Leave a comment

Your email address will not be published. Required fields are marked *


Review Comments
default image

I am a plsql developer. Intrested to move into bigdata.

Neetika Singh ITA Hadoop in Dec/2016 December 22, 2016

.