bigdatahadoop_pic

Reading Time: 5 minutes

Welcome Guys!

This blog is something special for beginners who wants to setup Big Data cluster in his/her local machine. There are different ways to install BigData Hadoop cluster, if you install straight forward on windows or linux platform you should be careful on setting

up environment variables, configurations, dependencies, may spend more time for troubleshooting etc., instead of that, how about setting up predefined environment or ready made environment just do plug and play? Yes, I’m going to explain this blog for how to setup BigData Hadoop Hortonworks Docker Sandbox on your PC.

Pre-requisites/Virtual box Troubleshooting information:

  1. Make sure Virtualization is enabled in your BIOS
  2. Disable Hyper-V acceleration in windows
    • Search “Program and Features”-> Turn Windows features on or off ->Locate Hyper-V option and unmark it and it’s sub folders.
    • In command prompt, “dism.exe /Online /Disable-Feature:Microsoft-Hyper-V-All”
  3. Make sure you have enough RAM
    1. Minimum 16 GB RAM must be available on your deskop/laptop
    2. Hortonworks requires minium 8GB of Physical RAM on your PC
  4. Follow the recommend steps given below

Getting Started

How to Host Big Data Hadoop Hortonworks Sandbox:

The first step to setup Big Data Hadoop hortonworks Sandbox is, installing Virtualbox.

  1. Navigate to URL https://www.virtualbox.org/
  2. Click on download latest version
  3. You can see virtual platform packages as mentioned belowdownloaded_virtualbox_ver
  4. Click on Windows hosts to downloadvirtualbox_download1
  5. Open the downloaded virtualbox installer, click next to finish the installer
  6. Now, download HDP(Hortonworks Data Platform) Sandbox by navigating to link https://hortonworks.com/products/sandbox/
  7.  download_hdp_sandbox
  8. Click on “Download HDP Sandbox” button which navigates to the page where OVA image can be downloadable.
  9. sandbox_downloadloc
  10. There are different Virtual installer for eg., VirtualBox or VMWARE (This is you have to install VMware Workstation Player) anything is fine, I used Virtualbox.
  11. The minimum size is more than 9-10 GB, hence it take time depends on your internet speed
  12. After downloaded, hdp_2-6-4_ova_imageclick on this ova file which actually popup Virtual box prompting you to import ova file
  13. ova_import
  14. Note, the above import minimum 8 GB RAM required on your machine. Click on import, which exactly take sometime to import all stuffs.
  15. After import is done, you can see the following image indicates import is success and Big Data Sandbox is ready to play further.
  16. hdp_up_running
  17. To verify Big Data Hortonworks Sandbox is success, Launch a browser and enter http://127.0.0.1:8888 where Ambari is running
  18. It navigate to main page, click Dashboard
  19. Ambari login page returns where you need to add credentials maria_dev/maria_dev
  20. After success, you can see all services are running as mentioned below.
  21. ambari_dashboard

How to Connect BigData Hadoop Sandbox Machine:

  1. Open putty (install it if you don’t have in your machine)
  2. Configure as mentioned below, port “2222” is opposed of 22 which connect HDP 2.6 Big Data Hadoop echo system
  3. putty_config
  4. Click open
  5. In command prompt, enter password “maria_dev”
  6. Sandbox machine gets connected where you can interaction for file operations or copying required files etc.,
  7. logintohdpmachine

How to Shutdown HDP Sandbox:

  1. In Ambari, Actions under bottom left, Select Stop All service which is first point for safest way to shutdown all services in sandbox and then click on ACPI Shutdown.
  2. stop_shutdown

That’s it, Congratulations! you have made it :-).

Thanks for your time on reading this blog. Hope! this may be helpful to you.

Any questions or clarifications, please contact automationcalling@gmail.com.

 

2 Comments

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s