Daily Archives: August 24, 2014

Flume Avro Client – Collecting a Remote File into Local File 1

In this post, we will discuss about setup of a Flume Agent using Avro Client, Avro Source, JDBC Channel, and File Roll sink. First we will create Agent3 in flume.conf file under FLUME_HOME/conf directory. Flume Agent – Avro Source, JDBC Channel and File Roll Sink: Add the below configuration properties in flume.conf file to create Agent3.

 Make sure /usr/lib/flume/agent/files/ directory is created and Flume use has write permissions to this location. […]

Hive CLI Commands 1

In our previous posts, we have seen about Hive Overview and Hive Architecture and now we will discuss about the default service in hive, Hive Command Line Interface and Hive CLI Commands. Ways to Interact with Hive CLI, command-line interface . Karmasphere (http://karmasphere.com ) (commercial product), Cloudera’s open source Hue (https://git hub.com/cloudera/hue ), A new “Hive-as-a-service” offering from Qubole (http://qubole.com) A simple web interface called Hive web interface (HWI), and programmatic […]