The documentation set for this product strives to use bias-free language. For the purposes of this documentation set, bias-free is defined as language that does not imply discrimination based on age, disability, gender, racial identity, ethnic identity, sexual orientation, socioeconomic status, and intersectionality. Exceptions may be present in the documentation due to language that is hardcoded in the user interfaces of the product software, language used based on RFP documentation, or language that is used by a referenced third-party product. Learn more about how Cisco is using Inclusive Language.
Step 1 | Log in to the Cisco UCS Director Express for Big Data Baremetal Agent (BMA) server using the default credentials (root/pxeboot). Copy the UCSDExpress_BMA_5.2_Big_Data_1.1_Upgrade_Package.zip (BMA upgrade package) file and extract the BMA package file. Change directory to scripts/bin, add execute permissions to copyfiles.sh (chmod+x copyfiles.sh), and execute the copyfiles.sh (./copyfiles.sh). |
Step 2 | Copy Red Hat ISO contents into /opt/cnsaroot/images/RHEL6.x, a directory that already exists in the Cisco UCS Director Express for Big Data Baremetal Agent server. |
Step 3 | Copy Red Hat
specific image files such as TRANS.TBL, boot.msg, initrd.img, isolinux.cfg,
splash.jpg, vmlinuz, boot.cat, grub.conf, isolinux.bin, memtest, vesamenu.c32
that can be located in the Red Hat ISO directory
/opt/cnsaroot/images/RHEL6.x/isolinux/ into
/opt/cnsaroot/RHEL6.x.
|
Step 4 | Add Baremetal Agent account to Cisco UCS Director Express for Big Data, as described in Configuring Cisco UCS Director Express for Big Data Baremetal Agent. |
Step 5 | Configure DHCP, as described in Configuring the DHCP Server for a Baremetal Agent Account |
Step 6 | Download Cloudera, MapR, Hortonworks software RPMS to the Cisco UCS Director Express for Big Data server, as listed in Cloudera, MapR, and Hortonworks RPMs on Cisco UCS Director Express for Big Data Baremetal Agent. |
Step 7 | Initiate
Baremetal Agent services by clicking
Start
Services.
If the DHCP sever is not correctly configured, the status displayed in the Enabled Services column will indicate that services are not enabled. BMA status will become "active" once the network services are started correctly. |
Apply licenses to Hadoop distributions.
Download the following common packages to /opt/cnsaroot/bd-sw-rep/:
pssh-2.3.1.tar.gz from https://pypi.python.org/packages/source/p/pssh
clustershell-1.6-1.el6.noarch.rpm from http://dl.fedoraproject.org/pub/epel/6/x86_64
Download th following packages to /opt/cnsaroot/bd-sw-rep/cloudera-5.X.X:
ClouderaEnterpriseLicense.lic— Get the license keys from Cloudera
userrpmlist.txt—For additional packages list
catalog.properties—Provides the label name for the Cloudera version (x represents the Cloudera version on the Cisco UCS Director Express for Big Data Baremetal Agent)
mysql-connector-java-5.1.26.tar.gz from http://cdn.mysql.com/archives/mysql-connector-java-5.1
cm5.2.0-centos6.tar.gz from http://archive.cloudera.com/cm5/repo-as-tarball/5.2.0
cdh5.2.0-centos6.tar.gz from http://archive.cloudera.com/cdh5/repo-as-tarball/5.2.0
cm5.2.1-centos6.tar.gz from http://archive.cloudera.com/cm5/repo-as-tarball/5.2.1
cdh5.2.1-centos6.tar.gz from http://archive.cloudera.com/cdh5/repo-as-tarball/5.2.1
cm5.3.0-centos6.tar.gz from http://archive.cloudera.com/cm5/repo-as-tarball/5.3.0
cdh5.3.0-centos6.tar.gz from http://archive.cloudera.com/cdh5/repo-as-tarball/5.3.0
libgenders-devel-1.14-2.el6.rf.x86_64.rpm from http://pkgs.repoforge.org/libgenders/
libgenders-1.14-2.el6.rf.x86_64.rpm from http://pkgs.repoforge.org/libgenders/
ext-2.2.zip from http://dev.sencha.com/deploy/ext-2.2.zip
sshpass-1.05-1.el6.x86_64.rpm from ftp://ftp.univie.ac.at/systems/linux/fedora/epel/6/x86_64
soci-mysql-3.2.2-2.el6.x86_64.rpm from http://ftp.univie.ac.at/systems/linux/fedora/epel/6/x86_64
soci-3.2.2-2.el6.x86_64.rpm from http://ftp.univie.ac.at/systems/linux/fedora/epel/6/x86_64
pdsh-2.27-1.el6.rf.x86_64.rpm from http://pkgs.repoforge.org/pdsh
mapr-whirr-0.7.0.16780-1.noarch.rpm from http://archive.mapr.com/releases/ecosystem-all/redhat, or use the latest file mapr-whirr-0.8.1.18380-GA.noarch.rpm from http://archive.mapr.com/releases/ecosystem-all/redhat
mapr-drill-0.7.0.29434-1.noarch.rpm from http://archive.mapr.com/releases/ecosystem/redhat or use mapr-drill-0.8.0.31168-1.noarch.rpm from http://package.mapr.com/releases/ecosystem-4.x/redhat
mapr-ecosystem-20150309.rpm.tgz from http://package.mapr.com/releases/ecosystem-all/redhat
catalog.properties—Provides the label name for the MapR version (x represents the MapR version on the Cisco UCS Director Express for Big Data Baremetal Agent)
mapr-v4.0.1GA.rpm.tgz from http://archive.mapr.com/releases/v4.0.1/redhat
Download the following packages to /opt/cnsaroot/bd-sw-rep/MapR-4.0.2:
mapr-v4.0.2GA.rpm.tgz from http://archive.mapr.com/releases/v4.0.2/redhat
Download the following packages to /opt/cnsaroot/bd-sw-rep/MapR-4.1.0
libgenders-devel-1.14-2.el6.rf.x86_64.rpm from http://pkgs.repoforge.org/libgenders/
libgenders-1.14-2.el6.rf.x86_64.rpm from http://pkgs.repoforge.org/libgenders/
ext-2.2.zip from http://dev.sencha.com/deploy/ext-2.2.zip
sshpass-1.05-1.el6.x86_64.rpm from http://ftp.pbone.net/mirror/download.fedora.redhat.com/pub/fedora/epel/6/x86_64
soci-mysql-3.2.2-2.el6.x86_64.rpm from http://ftp.pbone.net/mirror/download.fedora.redhat.com/pub/fedora/epel/6/x86_64
soci-3.2.2-2.el6.x86_64.rpm from http://ftp.pbone.net/mirror/download.fedora.redhat.com/pub/fedora/epel/6/x86_64
pdsh-2.27-1.el6.rf.x86_64.rpm from http://pkgs.repoforge.org/pdsh
mapr-whirr-0.8.1.18380-GA.noarch.rpm from http://package.mapr.com/releases/ecosystem-all/redhat
mapr-ecosystem-4.x-20150610.rpm.tgz from http://package.mapr.com/releases/ecosystem-4.x/redhat
Download the following packages to /opt/cnsaroot/bd-sw-rep/MapR-4.1.0
mapr-v4.1.0GA.rpm.tgz from http://package.mapr.com/releases/v4.1.0/redhat
openssl-1.0.1e-30.el6.x86_64.rpm from ftp://rpmfind.net/linux/centos/6.6/os/x86_64/Packages
catalog.properties—Provides the label name for the Hortonworks version (x represents the Hortonworks version on the Cisco UCS Director Express for Big Data Baremetal Agent)
Download the following packages to /opt/cnsaroot/bd-sw-rep/Hortonworks-2.1:
HDP-2.1.5.0-centos6-rpm.tar.gz from http://public-repo-1.hortonworks.com/HDP/centos6
ambari-1.6.1-centos6.tar.gz from http://public-repo-1.hortonworks.com/ambari/centos6
HDP-UTILS-1.1.0.17-centos6.tar.gz from http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.17/repos/centos6
ambari.repo from http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/1.6.1
Download the following packages to /opt/cnsaroot/bd-sw-rep/Hortonworks-2.2:
HDP-2.2.0.0-centos6-rpm.tar.gz from http://public-repo-1.hortonworks.com/HDP/centos6
ambari-1.7.0-centos6.tar.gz from http://public-repo-1.hortonworks.com/ambari/centos6
HDP-UTILS-1.1.0.20-centos6.tar.gz from http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6
ambari.repo from http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/1.7.0
You can configure Cisco UCS Director Express for Big Data Baremetal Agent to have its clock synchronized to an external NTP server. This ensures that the correct calendar time is maintained on the Baremetal Agent.
Ensure that you synchronize Cisco UCS Director Express for Big Data and Cisco UCS Director Express for Big Data Baremetal Agent before you deploy any Hadoop cluster. It is recommended that you also synchronize Cisco UCS Manager and Cisco UCS Director Express for Big Data on the configured NTP server.
When you extract the BMA upgrade package (UCSDExpress_BMA_5.2_Big_Data_1.1_Upgrade_Package.zip) file, locate the ntp_server_config.sh file, add execute permissions (chmod+x ntp_server_config.sh), and execute ( ./ntp_server_config.sh <ntp_server_ip or hostname>) on the Cisco UCS Director Express for Big Data Baremetal Agent server.
To install user defined Hadoop related software, you can mention a list of RPMs in the userrpmlist.txt file, which can be located at /var/www/html/<hadoop_distribution_version>/userrpmlist.txt in the Baremetal Agent server. For example, /var/www/html/Cloudera_5.0.1/userrpmlist.txt.
This procedure is optional.
Note | For a multi-home DHCP configuration, use this procedure to configure the first subnet for the DHCP server. For the remaining subnets, you must manually edit the DHCP configuration file (/etc/dhcpd.conf). |
To provide required DHCP services, ensure that at least one DHCP server is located in the same PXE VLAN as Baremetal Agent and configure that DHCP server with an appropriate IP address range. The DHCP server, together with the TFTP server, are used to communicate with a PXE server.
Set up PXE boot requests.