Install Apache Zeppelin binary on Ubuntu Linux - apache-spark

I'm trying to install Apache Zeppelin and various interpreters on Ubuntu Linux using AWS EC2. Below are my steps for the binary and from source.
SSH through Putty as ubuntu#IP
wget http://mirrors.gigenet.com/apache/zeppelin/zeppelin-0.6.2/zeppelin-0.6.2.tgz
sudo tar -zxf zeppelin-0.6.2.tgz
cd zeppelin-0.6.2
sudo bin/zeppelin-daemon.sh start
It gives me the following status in the cli:
Zeppelin start [OK]
Zeppelin process died [FAILED]
I then tried to install build from source using the following:
sudo apt-get update
sudo apt-get install git
sudo apt-get install openjdk-7-jdk
sudo apt-get install npm
sudo apt-get install libfontconfig
git clone https://github.com/apache/zeppelin.git
apt-cache search maven
sudo apt-get install maven
export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=1024m"
mvn -version
I use the java home directory and set the environment variable for JAVA_HOME by
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre
cd into zeppelin folder and then run
mvn clean package -Pspark-2.0 -Phadoop-2.4 -Pyarn -Ppyspark -Psparkr -Pscala-2.11
And it builds Zeppelin but fails at the next Zeppelin: Interpreter
How do I get her to work without going to AWS EMR? Thanks in advance.

The tgz file that you downloaded is source file. Not prebuild one. So you need to build it first before you try to start Zeppelin daemone. If you won't modify the source, I'd recommend you to download binary package.
$ http://mirrors.gigenet.com/apache/zeppelin/zeppelin-0.6.2/zeppelin-0.6.2-bin-all.tgz
$ sudo tar -zxf zeppelin-0.6.2-bin-all.tgz
$ cd zeppelin-0.6.2-bin-all
$ sudo bin/zeppelin-daemon.sh start
Then you can start Zeppelin server without any further steps.

Related

Docker - No rule to make target `hiredis'

I have been scratching my head since past 2 days for this issue. I am using amazon linux image and trying to install redis through a Dockerfile, but this doesn't work.
RUN yum install -y java-17-amazon-corretto.x86_64
RUN yum install -y tar
RUN yum install -y wget
RUN yum -y update
RUN yum -y install gcc make
RUN wget http://download.redis.io/redis-stable.tar.gz
RUN tar xvzf redis-stable.tar.gz
RUN cd redis-stable/deps
make hiredis jemalloc linenoise lua geohash-int
cd ..
make install
When I follow the docs, it says run make and make install from the root of the install directory.
RUN cd redis-stable
RUN make
RUN make install

apche mesos - install ubuntu 18.04 - start master failed - mesos version 1.6.0

I tried to install Apache Mesos 1.4.0 on Ubuntu 18.04, but start master failed error
./bin/mesos-master.sh: line 24: /home/hdpu00/mesos-1.4.0/build/src/mesos-master: No such file or directory
below details about installation process i tried:
mesos tar file
tar -zxf mesos-1.4.0.tar.gz
install the required packages and other Mesos dependencies.
$ sudo apt-get update
$ sudo apt-get install -y tar wget git<br>
$ sudo apt-get install -y openjdk-8-jdk<br>
$ sudo apt-get -y install build-essential python-dev \
python-six python-virtualenv \
libcurl4-nss-dev libsasl2-dev \
libsasl2-modules maven libapr1-dev \
libsvn-dev zlib1g-dev
Build mesos
$ cd mesos-1.4.0
$ mkdir build
$ cd build
$ ../configure
$ make
$ make check
$ make install
Run Mesos: from directory /home/hdpu00/mesos-1.4.0/build/, I run the command: $ ./bin/mesos-master.sh –ip=127.0.0.1 –work_dir=/var/lib/mesos
(I had previously created the dir /var/lib/mesos , and set up permissions correctly)
but run master mesos failed, how can i debug this error
/home/hdpu00/mesos-1.4.0/build/src/mesos-master: No such file or directory
thank you in advance for your help
O.S

Install Yarn Ubuntu 16.04 (Linux Mint 18.1)

I have a new installation of Linux Mint 18.1 with Ubuntu 16.04.
I have installed Node 6.10.0.
When doing the command that indicates the documentation of Yarn:
sudo apt-get update && sudo apt-get install yarn
It says "could not find yarn package"
I must do something else, because in the documentation I do not see anything about it.
Thank you.
On Ubuntu Linux, you can install Yarn via Debian package repository. You will first need to configure the repository:
curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | sudo apt-key add -
echo "deb https://dl.yarnpkg.com/debian/ stable main" | sudo tee /etc/apt/sources.list.d/yarn.list
Then you can simply:
sudo apt-get update && sudo apt-get install yarn
More information here
I was unable to install Yarn on Ubuntu 16.04 using the accepted answer but found it easy with npm:
npm install -g yarn
Then check install / version with
yarn --version
See on Installation | Yarn | Linux tab
There are instructions for several linux distributions
Here are more details about the official install instruction.
apt-key command gets the public authentication key for software integration check.
deb https://dl.yarnpkg.com/debian/ stable main is the Ubuntu repository containing yarn. Look at OP's screenshot, the top 10 lines list existing repositories to search for packages, but there is no yarn's one. So we need to add the repository by creating file /etc/apt/sources.list.d/yarn.list.
After the above two steps, issue apt/apt-get command to add yarn like usual Ubuntu packages.
Be careful when using &&. I get the same error when running sudo apt-get update, which prevents terminal from running sudo apt-get install yarn. I was able to successfully install yarn on Ubuntu 16.04 by running these commands separately (without using &&)
In Ubuntu or Linux you can install yarn using terminal ,But before installing You will first need to configure the repository, for that run the below commands
sudo apt install curl
curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | sudo apt-key add -
echo "deb https://dl.yarnpkg.com/debian/ stable main" | sudo tee /etc/apt/sources.list.d/yarn.list
after setting up the repository you can simply install yarn using below command
sudo apt-get update && sudo apt-get install yarn
Once the installation gets completed you can check the version using following command
yarn --version
for more details go to yarn documentation

PM2 inside bash script deployed and executed with puppet not working

#!/bin/bash
yum -y install gcc-c++
wget https://nodejs.org/dist/v0.12.7/node-v0.12.7.tar.gz
tar -xvzf node-v0.12.7.tar.gz
cd node-v0.12.7
./configure
make
sudo make install
yum -y install git
/usr/local/bin/npm install pm2 -g
cd /home/admin/Order-Management/
/usr/local/lib/node_modules/pm2/bin/pm2 start processes.json
The above script run perfectly when I run it locally but when I try to execute it with puppet on the client machine the last line throwing the following error.
/usr/bin/env: node: No such file or directory
I am using RedHat 6 master and RedHat 6 client. I saw a solution here
Node forever /usr/bin/env: node: No such file or directory However not working for me. Any help will be much appreciated.
I had to add environment variable for puppet exec resource. That was not a problem for node.

subvertpy install with reviewboard on SUSE

i installed subvertpy, and looks successfully.
Searching for subvertpy
Best match: subvertpy 0.9.1
Processing subvertpy-0.9.1-py2.6-linux-x86_64.egg
subvertpy 0.9.1 is already the active version in easy-install.pth
Installing subvertpy-fast-export script to /usr/local/bin
Using /usr/local/lib64/python2.6/site-packages/subvertpy-0.9.1-py2.6-linux-x86_64.egg
Processing dependencies for subvertpy
Finished processing dependencies for subvertpy
but when i tried to add a svn repository, it shows
The Python module "subvertpy" is not installed.You may need to restart the server after installing it.
is there anything i should configure in apache???
Install pysvn
apt-get install subversion python-svn
or
yum --enablerepo=epel install pysvn
also you can try
sudo yum install -y subversion-devel
wget http://pysvn.barrys-emacs.org/source_kits/pysvn-1.7.6.tar.gz
tar xf pysvn-1.7.6.tar.gz
(cd pysvn-1.7.6; cd Source;python setup.py backport;python setup.py configure;make;)
# copy
PythonLib="/usr/lib64/python2.6/site-packages/pysvn"
sudo mkdir -p ${PythonLib}
sudo cp pysvn-1.7.6/Source/pysvn/__init__.py ${PythonLib}
sudo cp pysvn-1.7.6/Source/pysvn/_pysvn*.so ${PythonLib}

Resources