Hadoop Testing Tools

• MRUnit – Java framework that helps developers unit test Hadoop Map reduce jobs.
• Mockito – Java Framework, similar to MRUnit for unit testing Hadoop Map reduce jobs.
• PigUnit – Java framework that helps developers unit test Pig Scripts.
• HiveRunner – An Open Source unit test framework for hadoop hivequeries based on JUnit4
• Beetest – Unit Testing Framework for Hive Queries
• Hive_test – Another Open source unit testing framework for Hive
• HBaseTestingUtility – Java API for HBase Mini-cluster and we can use this along with Junit/Mockito/MRUnit frameworks to unit test Hbase Applications.
• QuerySurge – Test tool built to automate Data Warehouse testing and the ETL Testing process. JDBC-compliant db, DWH, DMart, flat file, XML, Hadoop.
• There are no automation tools or frameworks available for Flume, sqoop and oozie unit testing yet. These need to be tested manually.