-
Notifications
You must be signed in to change notification settings - Fork 2
Documentation about running SciSpark Zeppelin on AWS using Docker for Summer 2016 ESIP WORKSHOP
Mazi Boustani edited this page Sep 30, 2016
·
2 revisions
##Create Docker image
- dockerfile https://github.com/SciSpark/docker-scispark-zeppelin/blob/master/Dockerfile
- start-scispark.sh https://github.com/SciSpark/docker-scispark-zeppelin/blob/master/start-scispark.sh
- push container into dockerhub https://hub.docker.com/r/mboustani/scispark_zeppelin_workshop_v5/
##Create AMI on AWS
##Create Security group
- click on Create security group
- set the name as esip_workshop
- under rules for both Inbound and Outbound select All traffic from dropdown and set the destination to anywhere
##Setup Launch Configuration on AWS using AIM
- click on Create Launch Configuration
- select already create AIM under My AIMs on left sidebar
- choose instance type (depends on how powerful machine is needed)
- give a name under Configure details page
- click on Advanced Details, under User Data and copy paste the code below into box
runcmd:
- [ sh, -c, "systemctl enable docker.service" ]
- [ sh, -c, "systemctl start docker-storage-setup.service --ignore-dependencies" ]
- [ sh, -c, "systemctl start docker.service --ignore-dependencies" ]
- [ sh, -c, "docker pull mboustani/scispark_zeppelin_workshop_v5" ]
- [ sh, -c, "docker run -d --name zeppelin --cap-add NET_ADMIN --cap-add mknod --cap-add SYS_ADMIN --device=/dev/fuse --security-opt apparmor:unconfined -it --privileged -p 80:8080 mboustani/scispark_zeppelin_workshop_v5" ]
- Under configure security group, Select an existing security group and select esip_workshop
- Review and click Create launch configuration
##Setup AutoScalling on AWS using Launch Configuration
- Click on Create AutoScalling group button
- Choose existing Configure Launch just created in previous step
- Give the name to group
- Under subnet paste: subnet-6713b04d,subnet-cdf285f0,subnet-983580c0,subnet-b3d14cc5 ????
- Under Configure Scaling Policy, select Keep this group as its initial size
- Skip the Configure Notification
- Under Configure Tags give Key a name (maybe "name) and values as scispark-zeppelin-docker-instance-esip_workshop
##Fire up instances
- Under AutoScalling Groups, select the group just created
- Under "Details" section in bottom click on "Edit" button
- Set the Max and Desired to number of instances would like to fire up
- Click on Instances on left side bar and wait for instances to start
- Copy the Public IP and open in web browser