Thursday, March 24, 2016

How install Spark in Linux

In this post I will walk through the process of install Apache Spark on Linux environment
uma@uma-VirtualBox:~/Downloads$ sudo wget http://www.eu.apache.org/dist/spark/spark-1.6.0/spark-1.6.0-bin-hadoop2.6.tgz
uma@uma-VirtualBox:~/Downloads$ sudo tar -xvf spark-1.6.0-bin-hadoop2.6.tgz -C /home/uma/work/
uma@uma-VirtualBox:~/work$ sudo mv spark-1.6.0-bin-hadoop2.6 spark-1.6.0
Bin/spark-shell
Lot of information
uma@uma-VirtualBox:~/work/spark-1.6.0/conf$ sudo cp log4j.properties.template log4j.properties
uma@uma-VirtualBox:~/work/spark-1.6.0/conf$ sudo gedit log4j.properties
uma@uma-VirtualBox:~$ cd work
uma@uma-VirtualBox:~/work$ sudo chmod -R 777 spark-1.6.0/
Bin/spark-shell

Cheers!
Uma

1 comment: