About the Hadoop cluster service test

updated: 2017/03/14

About the Hadoop cluster service test

The Hadoop cluster service test verifies that Sahara can launch a Hadoop cluster using the Vanilla plugin.

The following table describes the details of the Hadoop cluster tests.

Sahara platform tests
Name Description Scenario
Test that Sahara can launch a Hadoop cluster using the Vanilla plugin. The test verifies successful launch of the Hadoop cluster.
  1. Log in to the OpenStack dashboard.
  2. Register an image:
    1. Select Project ‣ Data Processing ‣ Image Registry.
    2. Click Register Image.
    3. In the Image field, select an image.
    4. Specify the User Name value for the selected OS.
    5. Set the following values:
      • Plugin=vanilla
      • Version=2.6.0
    6. Click Add plugin tags.
    7. Click Done.
   
  1. Create a master node group template:
    1. Select Project ‣ Data Processing ‣ Node Group Templates.
    2. Click Create Template.
    3. In the Create Node Group template dialog, set the following values:
      • Plugin name=Vanilla Apache Hadoop
      • Hadoop version=2.6.0
    4. Click Create to proceed.
    5. In the second Create Node Group template dialog, set the following values:
      • Template Name=vanilla2-master
      • OpenStack Flavor=m1.small
      • Floating IP pool=(external network)
    6. In the Process section, select:
      • namenode
      • secondarynamenode
      • resourcemanager
      • historyserver
      • oozie
    7. Click Create.
   
  1. Create a worker node group template:
    1. Select :menuselection: Project –> Data Processing –> Node Group Templates.
    2. Click Create Template.
    3. In the Create Node Group template dialog, set the following values:
      • Plugin name=Vanilla Apache Hadoop
      • Hadoop version=2.6.0
    4. Click Create to proceed.
    5. In the second Create Node Group template dialog, set the following values:
      • Template Name=vanilla2-worker
      • OpenStack Flavor=m1.small
      • Floating IP pool=(external network)
    6. In the Process section, select:
      • datanode
      • nodemanager
    7. Click Create.
   
  1. Create a cluster template:
    1. Select Project ‣ Data Processing ‣ Cluster Templates.
    2. Click Create Template.
    3. In the Create Cluster Template dialog, set the following values:
      • Plugin name=Vanilla Apache Hadoop
      • Hadoop version=2.6.0
    4. Click Create.
    5. In the second Create Cluster Template dialog, set the following values:
      • In the Details tab, specify Template Name=vanilla2-template.
      • In the Node Groups tab, specify vanilla2-master and vanilla2-worker.
      • In the HDFS Parameters tab, specify dfs.replication=1.
    6. Click Create.
   
  1. Launch the cluster:
    1. Select Project –> Data Processing –> Clusters.
    2. Click Launch Cluster.
    3. In the Launch Cluster dialog, set the following values:
      • Plugin name=Vanilla Apache Hadoop
      • Hadoop version=2.6.0
    4. Click Create to proceed.
    5. In the second Launch Cluster dialog, set :guilabel:Cluster Name=vanilla2-cluster.
    6. Click Create.
    7. Wait until the cluster has the Active status.
   
  1. Delete the cluster:
    1. In the Clusters page, select the vanilla2-cluster cluster.
    2. Click Delete Cluster.
  2. Delete the templates:
    1. Select Project ‣ Data Processing ‣ Cluster Templates.
    2. Select the vanilla2-template template.
    3. Click Delete Templates.
    4. Select Project –> Data Processing –> Node Group Templates.
    5. Select vanilla2-master and vanilla2-worker templates.
    6. Click Delete Templates.
updated: 2017/03/14
Creative Commons Attribution 3.0 License

Except where otherwise noted, this document is licensed under Creative Commons Attribution 3.0 License. See all OpenStack Legal Documents.

found an error? report a bug questions?

Contents