Skip to content

Latest commit

 

History

History
73 lines (41 loc) · 2.15 KB

UserGuide.md

File metadata and controls

73 lines (41 loc) · 2.15 KB

User Guide

At this stage you should have Enigma installed but it won't be running yet.

Enigma is composed of 4 major parts

Starting Enigma

We have configured Enigma with some sensible default values for you, so all you should have to do is run it.

First, log onto the VM using vagrant.

vagrant ssh

You should see a number of directories

./enigma
./enigma_installers
./ingress

The enigma directory contains the full installation.

The enigma_installers contains the install media that was used by Vagrant to install Enigma

The ingress directory is used by the File Reader component to get files efficiently from your file system into HDFS

Now we can start Enigma

cd enigma
#setup your environment
. ./env-enigma

cd bin
#start Hadoop, Zookeeper and Kafka
./start-enigma-framework.sh

Accept the End User License Agreement

The first time you run start-enigma-framework.sh you will be presented with the Enigma EULA. If you accept the terms, type 'accept' and press Enter. Engima will then start. If you don't want to accept the terms, just press enter and the startup will terminate.

You will only be presented with the EULA the first time you run start-enigma-framework.sh

Enigma is now running.

View the Hadoop operations pages for YARN and HDFS

Replace the ip address below with the ip address of your vm, you can get this by running the following in the vm:

ifconfig

Hadoop HDFS has a web based management app that allows you to see what's going on with HDFS. You can access this at:

http://10.3.18.75:50070/dfshealth.html#tab-overview

YARN has a web based management app that allows you to see what jobs are running and their current status. You can also see the status of your Spark jobs in this app. You can access this at:

http://10.3.18.75:8088/cluster

Stopping Enigma

cd $HOME/enigma
# setup your env if you haven't already done so
. ./env-enigma
./stop-enigma-framework.sh