Skip to content
This repository has been archived by the owner on Apr 18, 2024. It is now read-only.

Terraform module to deploy Hadoop on Oracle Cloud Infrastructure (OCI)

License

Notifications You must be signed in to change notification settings

oracle-quickstart/oci-hadoop

Repository files navigation

oci-hadoop

Apache Hadoop on OCI

Deployment

This template uses Oracle Resource Manager to deploy an Apache Hadoop cluster on OCI. The schema driven install will guide you through customization options available prior to deployment.

Simply click the Deploy to OCI button here to initiate deployment of the stack.

Deploy to Oracle Cloud

Architecture

Here is a diagram of the deployment architecture when creating a VCN as part of the stack deployment:

Deployment Architecture Diagram

Hadoop Components

Cluster service topology is as follows:

  • Master 1 is NameNode and JobHistory server
  • Master 2 is ResourceManager, Timeline, Proxy and History Server
  • All Master hosts are ZooKeeper servers

Edge node has client libraries deployed in .bashrc for root user. Cluster hosts have deployment logs in /var/log/OCI-Hadoop.log which can be used to triage any deployment issues.