Category: Hadoop

Name of Innovation

Protected: PIG tutorials

There is no excerpt because this is a protected post.


June 5, 2017 0

HBase Commands

./bin/hbase shell woir> list woir> status woir> version woir> table_help woir> whoami woir> create ‘woir’, ‘family data’, ’work data’ woir> disable ‘woir’ woir> is_disabled ‘table name’ woir> is_disabled ‘woir’ woir> disable_all ‘amar.*’ woir> enable ‘woir’ woir> scan ‘woir’ woir> is_enabled ‘table name’ woir> is_enabled ‘woir’ woir> describe ‘woir’ woir> alter ‘woir’, NAME => ‘family data’,…
Read more


May 17, 2017 0

Protected: HIVE Queries

There is no excerpt because this is a protected post.


May 14, 2017 0

Hive Installation

Download woir@woir-VirtualBox:/tmp$ wget http://archive.apache.org/dist/hive/hive-2.1.0/apache-hive-2.1.0-bin.tar.gz woir@woir-VirtualBox:/tmp$ tar xvzf apache-hive-2.1.0-bin.tar.gz -C /home/woir copy paste following in the /home/woir/sourceme export HIVE_HOME=/home/woir/apache-hive-2.1.0-bin export HIVE_CONF_DIR=/home/woir/apache-hive-2.1.0-bin/conf export PATH=$HIVE_HOME/bin:$PATH export CLASSPATH=$CLASSPATH:/home/woir/hadoop-2.6.0/lib/*:. export CLASSPATH=$CLASSPATH:/home/woir/apache-hive-2.1.0-bin/lib/*:. export HADOOP_HOME=~/hadoop-2.6.0 hduser@laptop:/home/woir/apache-hive-2.1.1-bin$ source ~/.bashrc $ echo $HADOOP_HOME /home/woir/hadoop-2.6.0 $ hive –version Hive 2.1.0 Subversion git://jcamachguezrMBP/Users/jcamachorodriguez/src/workspaces /hive/HIVE-release2/hive -r 9265bc24d75ac945bde9ce1a0999fddd8f2aae29 Compiled by jcamachorodriguez on Fri Jun 17 01:03:25 BST 2016 From…
Read more


May 12, 2017 0

Running an external jar from Aws Hadoop

Hadoop AWS First select the services  and click on EMR from Analytics.   Then click on the add cluster.   Fill the Details of Cluster. Cluster name as Ananthapur-jntu Here we are checking the Logging Browse the s3 folder with the amar2017/feb Launch mode should be Step Extension After that select step type as custom…
Read more


February 16, 2017 0

Hadoop Word Count Problem

Few basics in Unix – UNIX TUTORIAL How to check if a process is running or not # ps -eaf | grep ‘java’  will list down all the process which uses java How to kill a process forcefully # ps -eaf | grep ‘java’ The above command shows the process ids of the process which…
Read more


February 3, 2017 0

Installer for Ubuntu

Please create a new user with sudo permission username – hduser Login to the system with the new user Setup ssh server sudo apt-get install ssh Uncheck the option in Startup Application RESTART BOX Install JPS – Please ensure ‘jps’ command is available. If not please type following to install it sudo apt-get install  openjdk-7-jdk…
Read more


January 29, 2017 0

Steps to Verify Hadoop/Elasticsearch/ActiveMQ/Cassandra Installation in One Box Setup VM

Hadoop Installation     Start Virtual Box, choose the machine you prepared in earlier step and click on the “Start” button ( green colour ). Please login as user Hadoop ( user id hduser), if asked for please enter password ‘abcd1234’ Click on the Ubuntu on the top-left corner and look for terminal and click on…
Read more


January 26, 2017 0

Steps to Install VM for workshop

Install Virtual Box ( follow the steps ) on your computer. http://www.htpcbeginner.com/install-virtualbox-on-windows/ Once the Virtual Box is installed  the VM ( please see the license terms and conditions to use it for any commercial/business purpose) can be downloaded from the following link – https://drive.google.com/file/d/0B2vqFbCIJR_USXBzNVZYZGloOVU/view?usp=sharing&resourcekey=0-VeauEhR0L3NE7mIvRsDixw The downloaded image name will be ‘woir.vdi’. Create a New Virtual Machine…
Read more


January 26, 2017 0