Hadoop Testing Tools 3

Name: Scala, Spark
Item: Spark Nov 2016
Rating: 5
Author: Dharmeswaran

This entry was posted in Hadoop Hadoop Testing on July 17, 2015 by Siva

Hadoop Testing Tools

MRUnit – Java framework that helps developers unit test Hadoop Map reduce jobs.
Mockito – Java Framework, similar to MRUnit for unit testing Hadoop Map reduce jobs.
PigUnit – Java framework that helps developers unit test Pig Scripts.
HiveRunner – An Open Source unit test framework for hadoop hivequeries based on JUnit4
Beetest – Unit Testing Framework for Hive Queries
Hive_test – Another Open source unit testing framework for Hive
HBaseTestingUtility – Java API for HBase Mini-cluster and we can use this along with Junit/Mockito/MRUnit frameworks to unit test Hbase Applications.
QuerySurge – Test tool built to automate Data Warehouse testing and the ETL Testing process. JDBC-compliant db, DWH, DMart, flat file, XML, Hadoop.
There are no automation tools or frameworks available for Flume, sqoop and oozie unit testing yet. These need to be tested manually.

3 thoughts on “Hadoop Testing Tools”

Reply ↓

dinu November 30, 2016 at 2:33 pm

Can any body help how to connect fitness testing tool with hadoop platform?
Reply ↓

Anil bugatha December 8, 2016 at 1:01 pm

Hi,

My self Anil having 8 years of exp in manual testing. Can I learn the Hadoop testing and turn my carrer to this

Please let me know

Anil
Reply ↓

Praveen November 20, 2017 at 1:47 pm

Very good blog…things are explained with proper examples. Definitely helps.

Review Comments

I have attended Siva’s Spark and Scala training. He is good in presentation skills and explaining technical concepts easily to everyone in the group. He is having excellent real time experience and provided enough use cases to understand each concepts. Duration of the course and time management is awesome. Happy that I found a right person on time to learn Spark. Thanks Siva!!!

Dharmeswaran ETL / Hadoop Developer Spark Nov 2016 September 21, 2017

I really like your explanations.

Sylvain Nzeyang hadoop developer December/2016 November 23, 2016

Siva , your teaching's are great and indeed very useful for the people who are interested in hadoop. Your sessions are more close to real-time and helps every one to get clear in interviews. Thanks for your support.

kalpana Bhemireddy Hadoop developer Spark jul/2016 September 26, 2016

Course content is well structured. I like Siva's explanation of topics using slide decks & virtual machine (CDH cluster) at the same time,this will help audience to learn not only theory behind a topic but also practical aspect of it. Overall, I would recommend this course.

Kumar Big Data Developer Hadoop&Aug/2016 September 26, 2016

One of the best trainer is Siva Kumar, his way of communication and explantion superb,he teaches excellent as theratical and practically also,I suggest he is the Excellent trainer for Spark and Scala.

purushotham Sr.Software Engineer Spark August/2016 September 15, 2016

Here is 2 cents
1. Got More exercises and provide feedback. (also a final project)
2. Support (may be you need a part time person)

Lexman Architect Hadoop/Spark September 13, 2016

Siva will give excellent training for Hadoop,spark. He has 4 years real time experience. His teaching is will go close to real time.

sriniwaas Hadoop consultant June 2016 September 13, 2016

Excellent Training, classes were so interactive,I never got bored,Siva has Immense Knowledge in all the Hadoop tools.He explained everything so near to real-time . You can never find Hadoop course so pure in the market.

Akhila Hadoop Developer Hadoop/spark September 13, 2016

Siva did an excellent job in explaining each topic patiently, gave many real-time examples
And he was really patient enough in answering each of our doubts,responds well in time when needed.
He has Immense knowledge in all the Hadoop/spark eco-system tools. Never felt bored in his classes he makes the classes so interactive
He has an excellent blog..got addicted to it.

Akhila Hadoop Developer Hadoop/spark September 13, 2016

Spark and Hadoop course content is really apt for the beginners. Concept articulation gives clarity on the subject and recording are quite handy for reference. my request is to start an advance level course where it takes very close to real time feel

Ramesh Pallothu Senior Architect Spark Course September 13, 2016

Share this:

Leave a comment Cancel reply

3 thoughts on “Hadoop Testing Tools”

Review Comments