📁 Sqoop


Sqoop Interview Cheat Sheet 1

Install sqoop sudo yum install sqoop sudo apt-get install sqoop in sqoop-normal commnd prompt sqoop config file—sqoop site.xml install jdbc drivers After you’ve obtained the driver, you need to copy the driver’s JAR file(s) into Sqoop’s lib/ directory. If you’re using the Sqoop tarball, copy the JAR files directly into the lib/ directory after unzipping the tarball. If you’re using packages, you will need to copy the driver files into the /usr/lib/sqoop/lib directory […]


Sqoop Hive Use Case Example 2

This is another Use case on Sqoop, Hive concepts. Hive Use Case Example. Hive Use Case Example Problem Statement There are about 35,000 crime incidents that happened in the city of San Francisco in the last 3 months. Our task is to store this relational data in an RDBMS. Use Sqoop to import it into Hadoop. Can we answer the following queries on this data: Relative frequencies of different types of crime incidents […]


Sqoop Export Commands 1

Below are some Sqoop Export Commands and Other Miscellaneous commands Sqoop-export It is nothing but exporting data from HDFS to database. To use ‘export‘ command, a table in database should already exist. then only export functionality in sqoop will works. export command will works in two ways 1. insert 2. update 1. insert: insert mode will insert the new records from HDFS to RDBMS table. command:

Note: if a […]


Sqoop Import Command Arguments 2

In this post we will discuss about one of the important commands in Apache Sqoop, Sqoop Import Command Arguments with examples. This documentation is applicable for sqoop versions 1.4.5 or later because earlier versions doesn’t support some of the below mentioned arguments to import command As of Sqoop 1.4.5 version, Sqoop import command supports various number of arguments to import relational database tables into below tools or services. HDFS Hive […]


Sqoop Importing MySQL Data into HDFS

In this post, we will create a new database in MySQL server and create table and insert data into it and we will do importing MySQL data into HDFS via Sqoop tool. We assume that MySQL is installed and Sqoop & Hadoop are installed on local machine to test this example. We need to make sure that MySQL JDBC drivers connector jar file is downloaded and copied into SQOOP_HOME/lib directory. Prepare MySQL […]


SQOOP Installation on Ubuntu 2

In this post we will discuss about the basic introduction to Sqoop and Sqoop Installation on Ubuntu machine and we will discuss about example run of Sqoop from MySQL database in the next post. SQOOP Introduction: What is Sqoop? Sqoop is open source tool that enables users to transfer bulk data between Hadoop eco system and relational databases. Here Hadoop eco system includes, HDFS, Hive, HBase, HCatalog, etc. And Relational databases […]


Review Comments
default image

I have attended Siva’s Spark and Scala training. He is good in presentation skills and explaining technical concepts easily to everyone in the group. He is having excellent real time experience and provided enough use cases to understand each concepts. Duration of the course and time management is awesome. Happy that I found a right person on time to learn Spark. Thanks Siva!!!

Dharmeswaran ETL / Hadoop Developer Spark Nov 2016 September 21, 2017

.