Verify Elasticsearch installation on Ubuntu VM

Verify Elasticsearch installation on Ubuntu VM

  •         Start Virtual Box, Choose the machine you prepared in earlier step and click on the “Start” button ( green color ).

screen-shot-2016-12-09-at-11-08-22-am

  • If asked for please enter password ‘abcd1234’

screen-shot-2016-12-09-at-11-09-13-am

  • Click on the Ubuntu on the top-left corner and look for terminal and click on the terminal

screen-shot-2016-12-09-at-11-10-51-am

  • Once the terminal is up and running it should look similar to following –

screen-shot-2016-12-09-at-11-12-16-am

  • Login as hduser user.
    • su hduser
    • password ‘abcd1234’
  • Set the JAVA_HOME
    • export JAVA_HOME=/usr/lib/jvm/java-8-oracle/
  • Start Elasticsearch –
    • cd /home/hduser/elasticsearch-5.0.2/bin
    • sudo ./elasticsearch 2>&1 > /home/hduser/elastic.log &
    • You should see some messages ( it should not have any ERROR ) in the last you may something similar –

screen-shot-2016-12-09-at-12-22-59-pm

  • Very the instance
    • Open browser ( firefox )
    • goto http://localhost:9200
    • You should see following output

screen-shot-2016-12-09-at-12-26-20-pm

Steps to Verify the One Box Setup of Hadoop

Steps to Verify the One Box Setup of Hadoop

  •         Start Virtual Box, Choose the machine you prepared in earlier step and click on the “Start” button ( green color ).

screen-shot-2016-12-09-at-11-08-22-am

  • If asked for please enter password ‘abcd1234’

screen-shot-2016-12-09-at-11-09-13-am

  • Click on the Ubuntu on the top-left corner and look for terminal and click on the terminal

screen-shot-2016-12-09-at-11-10-51-am

  • Once the terminal is up and running it should look similar to following –

screen-shot-2016-12-09-at-11-12-16-am

  • Login as hduser user.
    • su hduser
    • password ‘abcd1234’
  • Go to home directory and take a look on the directory presents
    • cd /home/hduser
    • ‘pwd’ command should show path as ‘/home/hduser’.
    • execute ‘ls -lart’ to take a look on the files and directory in general.
  • Start hadoop
    • cd /usr/local/hadoop/sbin/
    • ./start-all.sh
  • Confirm that serivce is running successfully or not
    • run ‘jps’ – you should see something similar to following –

screen-shot-2016-12-09-at-12-44-15-pm

  • Go to the cd /home/hduser/example/WordCount1/
  • Run command ‘ls’ – if there is a directory named ‘build’ please delete that and recreate the same directory. This step will ensure that your program does not uses precompiled jars and other files
    • rm -rf build
    • mkdir build
  • Set JAVA_HOME and update PATH
  • Build the example ( please make sure that when you copy – paste it does not leave any space between the command) –
    • javac -classpath /usr/local/hadoop/share/hadoop/common/hadoop-common 2.6.0.jar:/usr/local/hadoop/share/hadoop/common/lib/hadoop-annotations-2.6.0.jar:/usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.6.0.jar -d build WordCount.java

screen-shot-2016-12-09-at-11-31-18-am

  • Create Jar –
    • jar -cvf wcount.jar -C build/ .
  • Now prepare the input for the program ( please give ‘output’ directory your own name – it should not be existing earlier )
    • Make your own input directory –
    • hadoop dfs -mkdir /user/hadoop/input
    • Copy the input files ( file1, file2, file3 ) to hdfs location
    • hadoop dfs -put file* /user/hduser/input
    • Check if the output directory already exists.
      • hadoop dfs -ls /user/hduser/output
      • In the below screen shot it already exists
    • If it already existing delete with the help of following command –
      • dfs -rm /user/hduser/output/*
      • hadoop dfs -rmdir /user/hduser/output
  • Run the program
    • hadoop jar wcount.jar org.myorg.WordCount /user/hduser/input/ /user/hduser/output
    • At the end you should see something similar –

screen-shot-2016-12-09-at-11-44-33-am

  • Check if the output files have been generated

screen-shot-2016-12-09-at-11-37-51-am

  • hadoop dfs -ls /user/hduser/output     – you should see something similar to below screenshot

screen-shot-2016-12-09-at-11-46-35-am

  • Get the contents of the output files –
    • hadoop dfs -cat /user/hduser/output/part-r-00000

screen-shot-2016-12-09-at-11-48-22-am

  • Verify the word count with the input files-
    • cat file1 file2 file3
    • The words count should match.
Integrated Courses for Engg Students on Semester Break

Integrated Courses for Engg Students on Semester Break

Job Oriented Integrated Course with Hands-on with Live Project

(WOIR Software)

Job Oriented Course

  • Certification of completion
  • Live Project and certificate
  • Approx 4 hours per day

 

 

Course Duration Contents Category
Big Data Analytics

 

4 days Big Data Concepts, Columnar Databases, Elasticsearch & Kibana  DevOps
AWS 2 days Setup account, Setting up Linux/Windows instance, Instance Management, Command Line Interface DevOps
Python 2 days Objects in Python, if / else / for / while, Classes , lambda , nameless functions sorting

 

DevOps/General Programming
PHP/MySQL/

HTML/CSS/Javascript/AJAX

7 days End to end web design including but not limited to designing a live webpage, styling, Integration with DB, AJAX calls etc. Devops/Web-design
Linux/Unix 2 days What is Unix, all the major commands, Pipes, file permissions, shell scripting

 

Devops/Programming
Dockers 2 days Concepts around Dockers, Command lines interface, Setting up Analytical Platforms etc. Devops
Raspberry Pai / Arduino 5 days Concepts and Command lines interface Devops

 

Contact: –  +91-9555295300/amargud@gmail.com

Website – http://woir.in/

 

Big Data Analytics ( workshop on 19th Nov, 2016 )

Big Data Analytics ( workshop on 19th Nov, 2016 )

Workshop on Big Data Analytics

(WOIR Software)

Job Oriented Workshop

Opportunity to learn directly from Industry Veteran-

“Amar Sharma from IIT Delhi having around 17 years’ experience working with Microsoft, Yahoo, Motorola”

Date -:       19th Nov,2016 (Saturday)

Time-:        10:00 am to 5:00 pm

Lunch-:      Yes

Amount-:  1699/- 

Venue -: Amar Classes, 2nd Floor (Sesame Street School), (Near L&T Serene County, Gachibowli)

Prerequisite-: Basic understanding of the computer fundamentals, json, programming.

Laptop – It is advised to bring your own laptop so that you can take away your setup and hands-on work.

 * Special discount for students – please talk to us for the discounts

Title Who should attend Topics Covered
Big Data Paradigm and fitment of Elasticsearch and Kibana

 

This workshop is specially for 3rd year, 4th year, M. Tech, fresh engineering graduates/post graduates, and even working professionals who are looking for the change in the job profile.

 

Schema free designs, Big Data Concepts, Analytics and hands-on experiment

 

 

Contact: –  +91-9555295300/amargud@gmail.com

Website – http://woir.in

Registration Closes on 18th Nov, Thursday

 

Skills enhancements & Job Oriented Courses

Skills enhancements & Job Oriented Courses

Skills enhancements & Job Oriented Courses

(WOIR Software)

 

  • Special designed course for Engineering 3rd year & 4th year / M. Tech students and also for fresh out of the engineering college students.
  • Course designed by Industry Veteran (17-year experience working with Microsoft, Motorola, Yahoo and startups).
  • Counselling on how to prepare and attend interviews (on request).
  • Hands on with live projects.
  • Certificate of completions for the course.

 

Workshops schedule –

 * Special discount for students – please talk to us for the discounts

Date Title Timings Coverage Lunch Fee(per head) + applicable taxes New jobs
20th Nov, 2016 Big Data Paradigm and fitment of Elasticsearch and Kibana 10:00 am – 5:00 pm Schema free designs, Big Data Concepts, Analytics and hands on experiment Yes 1699/- Hot
27th Nov, 2016 Raspberry Programming 10:00 am – 5:00 pm About Raspberry, hardware, how it can be used for data processing, Basic commands in Linux, Python modules and AWS integration. Yes 1699/- Hot
20th Nov, 2016 Python 10:00 am – 5:00 pm Objects in Python, if / else / for / while classes , lambda , sorting Yes 1699/- Hot
3rd Dec, 2016 Linux/Unix Programming 10:00 am – 5:00 pm What is Unix, all the major commands, Pipes, file permissions, shell scripting Yes 1699/- Hot
             

 

Weekend  Workshop ( 12th & 13th Nov )

Weekend Workshop ( 12th & 13th Nov )

Workshop on Arduino Based Robotics

Learn Directly from Industry Veteran worked for Microsoft, Motorola & Yahoo

 

This workshop is aiming for kids & youngsters to give them exposure and basic understanding of Robotics.

Date Time Free Lunch Amount Location
12th Nov, Sat., 2016 10:30 am to 4:30 pm. Yes 1750/-

(plus applicable Taxes)

Sesame Street Preschool, 2nd Floor (Near L&T Serene County, Telecom Nagar)
13th Nov, Sunday, 2016 10:30 am to 4:30 pm.

 

Yes 1750/-

(plus applicable Taxes)

Aditya Sunshine, Izzath Nagar, Kondapur

 

Who can do Topic covered Project Concepts Outcome

(similar)

For all age, should be able to operate laptop Robots, controller, sensors,

Arduino Board

Obstacle Avoider Robot screen-shot-2016-09-16-at-10-31-51-pm

 

Amar Sharma

IIT Delhi(Computers)

Facebook – https://www.facebook.com/Robotic-Classes-513675805498465/

For Registration – please call us at 9555295300 (closes on 10th Nov,2016)