Docker HPCC

What is HPCCSystems (HPCC)

The HPCC Systems server platform is a free, open source, massively scalable platform for big data analytics. Download the HPCC Systems server platform now and take the reins of the same core technology that LexisNexis has used for over a decade to analyze massive data sets for its customers in industry, law enforcement, government, and science.

For more information and related downloads for HPCC Systems products, please visit https://hpccsystems.com

How to use Docker HPCC image

You can start Docker HPCC image in interactive (-i -t) or daemon mode (-d). You need start HPCC processes then go to ECLWatch to submit jobs, query and explore your data with the HPCC Systems platform. "-p :" will map a port of docker container to a host port. The default ECLWatch port is 8010.

Ubuntu

To start Docker in interactive mode and map ECLWatch port 8010 to host 8010:

sudo docker run -t -i --privileged -p 8010:8010 hpcc /bin/bash

To start Docker in daemon mode and map ECLWatch port 8010 to host 8020:

sudo docker run -d --privileged -p 8020:8010 hpcc 

CentOS

To start Docker in interactive mode and map ECLWatch port 8020 to host 8010:

sudo docker run -t -i --privileged -e "container=docker" -p 8020:8010 hpcc:el7 /bin/bash

To start Docker in daemon mode and map ECLWatch port 8010 to host 8010:

sudo docker run -d --privileged -e "container=docker"-p 8010:8010 hpcc:el7

How to build Docker HPCC image

You always can create your own Dockerfile to build Docker HPCC image. We provide some pre-defined Dockerfiles and tools here. These are for HPCC Platform for Ubuntu 16.04 and CentOS 7. HPCC Plugins Dockerfiles will be provided later.

Checkout this git reposiotry

git clone https://github.com/xwang2713/docker-hpcc.git

Currently there are release two versions: Gold Release: 6/ and Release Candidate: 6-rc/. There are two product types: platform and plugins. And two Linux distributes: Ubuntu (Ubuntu 16.04, default) and CentOS (CentOS 7).

Update HPCC Platform Version

Make sure the HPCC Platform version is available in HPCCSystems.com -> "Download" -> "HPCC SYSTEM PLATFORM" Update the version with update.sh. For example you want to build 6.4.16-1:

./update 6.4.16-1

Build

You can go to interested directory which contains Dockerfile to run the build. Or you can run test-build.sh script which include test:

./test-build.sh -v 6 -l ubuntu -p platform

This will build HPCC Platform 6.x for Ubuntu 16.04.