Docker HPCC

What is HPCCSystems (HPCC)

The HPCC Systems server platform is a free, open source, massively scalable platform for big data analytics. Download the HPCC Systems server platform now and take the reins of the same core technology that LexisNexis has used for over a decade to analyze massive data sets for its customers in industry, law enforcement, government, and science.

For more information and related downloads for HPCC Systems products, please visit https://hpccsystems.com

How to use Docker HPCC image

You can start the Docker HPCC image in interactive (-i -t) or daemon mode (-d). You must start the HPCC processes then go to ECLWatch to submit jobs, query, and explore your data with the HPCC Systems platform.

To map a docker container port to a host port.

"-p :"

The default ECLWatch port is 8010.

Ubuntu

To start Docker in interactive mode and map ECLWatch port 8010 to host 8010:

sudo docker run -t -i --privileged -p 8010:8010 hpcc /bin/bash

To start Docker in daemon mode and map ECLWatch port 8010 to host 8020:

sudo docker run -d --privileged -p 8020:8010 hpcc 

CentOS

To start Docker in interactive mode and map ECLWatch port 8020 to host 8010:

sudo docker run -t -i --privileged -e "container=docker" -p 8020:8010 hpcc:el7 /bin/bash

To start Docker in daemon mode and map ECLWatch port 8010 to host 8010:

sudo docker run -d --privileged -e "container=docker"-p 8010:8010 hpcc:el7

How to build Docker HPCC image

You can always create your own Dockerfile to build a Docker HPCC image. We provide some pre-defined Dockerfiles and tools here. These are for HPCC Platform for Ubuntu 16.04 and CentOS 7. HPCC Plugins Dockerfiles to be provided later.

Checkout this git reposiotry

git clone https://github.com/xwang2713/docker-hpcc.git

Currently there are two release versions: Gold Release: 6/ and Release Candidate: 6-rc/. There are two product types: platform and plugins. And two Linux distributes: Ubuntu (Ubuntu 16.04, default) and CentOS (CentOS 7).

Update HPCC Platform Version

Make sure the HPCC Platform version is available in HPCCSystems.com -> "Download" -> "HPCC SYSTEM PLATFORM" Update the version with update.sh. For example, if you want to build 6.4.16-1:

./update 6.4.16-1

Build

You can go to directory of interest which contains the Dockerfile to run the build, or you can run the test-build.sh script which includes test:

./test-build.sh -v 6 -l ubuntu -p platform

This will build HPCC Platform 6.x for Ubuntu 16.04.