Managing a Hadoop Cluster

This chapter contains the following sections:

Managing a Hadoop Cluster

You can manage an existing cluster.

Step 1   On the menu bar, choose Solutions > Big Data Accounts.
Step 2   Select an account and click View Details.
Step 3   Click on each tab to view the details.
Name Description

Summary

Displays statistics data report for the selected Big Data Account and the high level report on the cluster and node account.

Hosts

See Managing Nodes in a Cluster to know the functionality of this tab.

Hadoop Clusters

This tab is only for information. Click Role Topology to view the topology of the nodes.

This tab is only for information. Click View Details to view the inputs for the Hadoop cluster you have created and the virtual network interface configuration.

Hadoop Services

Displays the list of Hadoop services and their status. You can start or stop all Hadoop services depending on their current status using Start All Services and Stop All Services. To start and stop a particular service, use Edit Service.

Hadoop Service Roles

Displays the list of Hadoop services.

To add a role to the cluster, do the following in the Add Role dialog box:

  1. From the Hadoop Service Name drop-down list, choose the Hadoop service.

  2. From the Role Type drop-down list, choose the role type.

  3. From the Node Name drop-down list, choose the node name.

  4. From the Role Name drop-down list, choose the role name.

  5. Click Submit.

To start or stop any role that you have created, do the following in the Start/Stop Role dialog box:

  1. From the Hadoop Service Roles tab, choose the Hadoop service.

  2. Click Start/Stop Role.

  3. Click Submit.

To delete a role in the cluster, do the following in the Delete Role dialog box:

  1. From the Hadoop Service Roles tab, choose the Hadoop service.

  2. Click Delete.

  3. click Submit.

More Reports

Additional reports that you can generate for data usage and CPU utilization.

Managing Nodes in a Cluster

You can add, delete, re-commission and decommission nodes in a cluster.

  • Managed Node—Any node that was already a member (managed) in the cluster and deleted, which can be added again in the cluster.

  • Live Node—Any node that has the operating system installed and a cluster to be installed.

  • Baremetal Node—Any node that has no operating system and cluster installed.

Step 1   On the menu bar, choose Solutions > Big Data Accounts.
Step 2   Select an account and click View Details.
Step 3   Click the Hosts tab to perform the following actions:
Name Description

Refresh

Refreshes the page.

Favorite

Adds the page to Favorites.

Add Managed Node

Add managed nodes to the Hadoop cluster.

Add Live Node

Add live nodes to the Hadoop cluster.

Add BareMetal Nodes

Add baremetal nodes to the Hadoop cluster.

Step 4   Select a host that allows you to perform the following actions:
Name Description

View Details

Displays the summary of the CPU usage, the I/O status of the hosts disks and so on.

Note   

If you see a License Status tab, it indicates a licensing issue.

Delete Node

Deletes node from the cluster.

Assign Rack

Assigns the node to the rack server.

Recommission Node/ Decommission Node

Decommissioning or Re-commissioning a node depends on its current status.

When the node is in decommissioned status, it means that all the roles for that node have been withdrawn.

Delete Node to BareMetal

The node is removed from cluster and disassociated from service profile. The node becomes a BareMetal server.

Adding Managed Nodes to the Hadoop Cluster

Add managed nodes to the Hadoop cluster.

Step 1   On the menu bar, choose Solutions > Big Data Containers.
Step 2   Double-click on the Big Data account.
Step 3   Click the Hosts tab.
Step 4   Click Add Managed Node.
Step 5   From the Host Name drop-down list, choose the host name.
Step 6   From the Rack Name drop-down list, choose the rack name.
Step 7   Click Submit.

Adding Live Nodes to the Hadoop Cluster

Add live nodes to the Hadoop cluster.

Step 1   On the menu bar, choose Solutions > Big Data Containers.
Step 2   Double-click on the Big Data account.
Step 3   Click the Hosts tab.
Step 4   Click Add Live Node.
Step 5   Enter the IPv4 address in the Host Management IPV4 Address field.
Step 6   Enter the name of the rack server in the Rack Name field.
Step 7   Enter the password in the (New Node) Password field for that rack server.
Step 8   Choose the Cluster Manager Version for the Hadoop distribution from the Cluster Management Version drop-down list.
Step 9   Choose the operating system to be installed on the servers in this cluster from the OS Version drop-down list.
Step 10   Click Submit.

Adding BareMetal Nodes to the Hadoop Cluster

Add baremetal nodes to the Hadoop cluster.

Step 1   On the menu bar, choose Solutions > Big Data Containers.
Step 2   Double-click on the Big Data account.
Step 3   Click the Hosts tab.
Step 4   Click Add BareMetal Nodes.
Step 5   In the Add Baremetal Nodes dialog box, complete the following fields:
Name Description

Big Data Account Name field

The name of the Big Data account.

UCSM Policy Name Prefix field

The UCSM Policy Name prefix.

Hadoop Cluster Name field

A unique name for the Hadoop cluster.

Hadoop Node Count field

The number of nodes in the Hadoop cluster.

Host Node Prefix field

The Host Node prefix for the cluster.

OS Version drop-down list

Choose the operating system to be installed on the servers in this cluster.

Hadoop Distribution drop-down list

Choose the Hadoop distribution to be used for this cluster.

Hadoop Distribution Version drop-down list

Choose the Hadoop distribution version.

Multi UCSM check box

Check the Multi UCSM check box if you use multiple UCSM accounts.

The following workflows are created during an Instant/Customized Hadoop Cluster creation:

  • UCS CPA Multi-UCSM Hadoop Cluster WF.

  • Single UCSM Server Configuration WF (This WF will be triggered per UCSM Account. For example, UCSM 120, UCSM121).

  • UCS CPA Node BareMetal (This WF will be triggered per Node).

UCS Manager Account drop-down list

Choose the Cisco UCS Manager account for this cluster.

Organization drop-down list

Choose the organization in which the servers for this cluster are located.

Server UUID Pool drop-down list

Choose the UUID pool to be used for servers in this cluster.

Note   

A UUID pool is a collection of SMBIOS UUIDs that are available to be assigned to servers. The first number of digits that constitute the prefix of the UUID are fixed. The remaining digits, the UUID suffix, are variable. A UUID pool ensures that these variable values are unique for each server associated with a service profile which uses that particular pool to avoid conflicts.

If you use UUID pools in service profiles, you do not have to manually configure the UUID of the server associated with the service profile.

UUID Prefix drop-down list

Choose the UUID prefix.

UUID Pool-From field

To specify manually, enter the UUID pool to start from.

UUID Pool-Size field

To specify manually, enter the UUID pool size.

PXE VLAN ID field

Enter the PXE VLAN ID.

UCS SP Template table

Check the UCS Service Profile Template check box that you want to use and click Submit.

Server Pool table

The server pool that you want to use for this cluster.

The Cisco UCS Manager account and the organization that you choose determine which server pools are displayed in this area.

Host Firmware Pakage table

The host firmware package that you want to use for this cluster.

The Cisco UCS Manager account and the organization that you choose determine which host firmware package are displayed in this area.

Step 6   In the vNIC Template table, review and, if desired, edit the vNIC templates available for the cluster.
Step 7   If you want to edit a vNIC template, select the row for that template and click Edit.
Step 8   In the Edit vNIC Template Entry dialog box, complete the following fields and click Submit.
Name Description

vNIC Name drop-down list

This field is for your information only.

IP Pool drop-down list

Choose the big data IP pool that you want to use for IP addresses assigned to this vNIC.

MAC Address Pool drop-down list

Choose the MAC address pool that you want to use for this cluster.

First MAC Address field

To specify manually, enter the MAC address.

Size field

To specify manually, enter the size .

VLAN ID field

The VLAN ID for this cluster.

Step 9   Click Submit.

Service Roles

For each Hadoop distribution, specific roles are added for all nodes that are newly added by using Add Node BareMetal, Add Managed Node, and Add Live Node options to the Hadoop cluster.

Service Roles

Cloudera

MapR

Hortonworks

FileServer

No

Yes

No

DataNode

Yes

No

Yes

NodeManager

Yes

Yes

Yes

Ganglia Monitor

No

No

Yes