تشغيل أداة التحقق من صحة HyperFlex وترقيته مسبقا

المقدمة

يصف هذا وثيقة العملية أن يركض ال Hypercheck صحة و pre-upgrade أداة.

المتطلبات الأساسية

المتطلبات

توصي Cisco بأن تكون لديك معرفة بالموضوع التالي:

• HyperFlex

المكونات المستخدمة

تستند المعلومات الواردة في هذا المستند إلى أداة Hypercheck Health و PreUpgrade.

تم إنشاء المعلومات الواردة في هذا المستند من الأجهزة الموجودة في بيئة معملية خاصة. بدأت جميع الأجهزة المُستخدمة في هذا المستند بتكوين ممسوح (افتراضي). إذا كانت شبكتك قيد التشغيل، فتأكد من فهمك للتأثير المحتمل لأي أمر.

معلومات أساسية

هذه الأداة عبارة عن أداة مساعدة تقوم بإجراء فحوصات ذاتية إستباقية على أنظمة HyperFlex لضمان استقرارها ومرونتها. وتساعد هذه الأداة على أتمتة قائمة بعمليات التحقق من الصحة وما قبل الترقية على أنظمة HyperFlex لتوفير الوقت أثناء عمليات الترقية والصيانة باستخدام تقنية HyperFlex.

ملاحظة: قم بتنزيل أحدث إصدار من الأداة دائما قبل الاستخدام. بما أن الأداة يتم تحسينها بشكل متكرر، فإن إستخدام إصدار سابق يمكن أن يؤدي إلى فقدان تحققات مهمة.

أنظمة HX المدعومة

• الإصدارات HyperFlex - 1.8 و 2.0 و 2.1 و 2.5 و 2.6 و 3.0 و 3.5 و 4.0 و 4.5 و 5.0 و 5.5
• مجموعة HyperFlex القياسية
• مجموعة HyperFlex الممتدة
• نظام HyperFlex Edge Cluster (ثنائي العقد و 3 العقد و 4 العقد)
• مدعوم فقط على مجموعة HyperFlex على VMWare ESXi

ملاحظة: لمزيد من المعلومات حول كيفية تشغيل HyperCheck على مجموعة HyperFlex HyperV، ارجع إلى HyperCheck: أداة التحقق من الصحة قبل الترقية HyperFlex - HyperV.

متى تستخدمه

الأوقات الفعالة لاستخدام أداة التحقق من صحة HyperFlex ومرحلة ما قبل الترقية هي:

• قبل ترقيات HyperFlex
• التحقق من سلامة HyperFlex قبل إطارات الصيانة وبعدها
• لتحديد محركات الأقراص/الأقراص المعطلة
• عندما تعمل مع Cisco TAC
• فحص الحماية الاستباقي في أي وقت

كيف تستخدمه

HX الإصدار 4.5 والإصدارات الأحدث

الخطوة 1. بدء اتصال SSH بالجهاز الظاهري لوحدة تحكم التخزين (SCVM) باستخدام IP الخاص بإدارة نظام المجموعة (CMIP)، وهو بروتوكول الإنترنت الخاص بك لعملية اتصال HX.

الخطوة 2. قم بتنفيذ الأمر hypercheck .

admin:~$ hypercheck

يدخل خطوة 3. ال SCVM مدير كلمة عندما يطلب ويدخل الجذر كلمة من ال ESXi.

admin:~$ hypercheck

                  HX Health Check 4.5.0

Please enter below info of HX-Cluster:
Enter the HX-Cluster Root Password:
Enter the HX-Cluster Admin Password:
Enter the ESX Root Password:

HX الإصدار 4.0 وما قبله

الخطوة 1. تنزيلHyperflex-Hypercheck.zipمن حساب Cisco Github. احصل على أحدث نسخة تتضمن آخر التحسينات والتحديثات.

ملاحظة: يمكن فقط لمستخدمي Cisco المسجلين الوصول إلى أدوات Cisco وملفات ومعلومات داخلية.

ملاحظة: أستخدم فقط البرنامج النصي الذي تم تنزيله من حساب Cisco Github Devnet.

الخطوة 2. قم بتحميله إلى SCVM باستخدام CMIP.

أستخدم طريقتك المفضلة -scp/sftp/ftp/tftp- لنسخHyperflex-Hypercheck.zipالدليل إلى/tmp.

بالنسبة إلى MAC:

أنجزت SCP من CLI (Hyperflex-Hypercheck.zipأكدت أن في ال نفسه مجلد من حيث أنت تشغل SCP).

# scp Hyperflex-Hypercheck.zip root@:/tmp/.

أستخدم هذا الخيار للتعرف على عنوان IP الخاص بإدارة نظام المجموعة في بيئة HX لديك - دفتر تشغيل HyperFlex.

بالنسبة لنظام التشغيل Windows:

يمكنك إستخدامWINSCPهذا الأمر لنقل الملفات كما هو موضح هنا:

الخطوة 3. استخرج محتوياتHyperflex-Hypercheck.zip.

اكتبcd /tmpللتغيير إلى/tmpالدليل.

root@SpringpathController7PVQWP6WV1:~# cd /tmp/

اكتب unzip Hyperflex-Hypercheck.zip in order to استخرجت الملفات.

root@SpringpathController7PVQWP6WV1:/tmp# unzip Hyperflex-Hypercheck.zip 
Archive:  Hyperflex-Hypercheck.zip
b61c59f7962b72902692ce70548ba3d760efdf06
   creating: Hyperflex-Hypercheck/
  inflating: Hyperflex-Hypercheck/HXTool.py 
  inflating: Hyperflex-Hypercheck/LICENSE.txt 
  inflating: Hyperflex-Hypercheck/ReadMe.txt 
  inflating: Hyperflex-Hypercheck/TestInfo.txt 
  inflating: Hyperflex-Hypercheck/prettytable.py 
  inflating: Hyperflex-Hypercheck/progressbar.py 
root@SpringpathController7PVQWP6WV1:/tmp# 

الخطوة 4. قم بتنفيذ البرنامج النصي HXTool Python.

اكتب  cd Hyperflex-Hypercheck للانتقال إلىHyperflex-Hypercheckالدليل.

root@SpringpathControllerABCDE01234:/tmp# cd Hyperflex-Hypercheck

اكتبpython HXTool.pyلتنفيذ البرنامج النصي.

root@SpringpathControllerABCDE01234:/tmp/Hyperflex-Hypercheck# python HXTool.py

يدخل خطوة 5. ال SCVM الجذر كلمة عندما يطلب.

Enter this information of HX-Cluster:
Enter the HX-Cluster Root Password:
Enter the ESX Root Password:

ملاحظة: لإيقاف تنفيذ البرنامج النصي أستخدم المفتاح (CTRL+Z) ويتوقف فورا.

الخطوة 6. تبدأ أداة HyperFlex-Hypercheck عمليات التحقق الخاصة بها. يستغرق إكمال التنفيذ ما بين 3 و 10 دقائق، وهذا يتوقف على عدد العقد المجمعة في نظام المجموعة.

الخطوة 7. احصل على تقرير عن مخرجات البرنامج النصي. يمكنك تلقيها كما هو موضح:

يتم حفظHypercheck Report tarالملف تحت/var/log/springpathو/tmp/Hyperflex-Hypercheck. لذلك، يمكنك تنزيل حزمة tar من تحت/var/log/springpathأو/tmp/Hyperflex-Hypercheck. بدلا من ذلك، يمكنك إنشاء وتحميل حزمة دعم القنوات التي تحتوي أيضا على تقرير HyperCheck tar.

مثال ملف tar التقرير -HX_Report_2020_08_30_10_43_50.tarيتم نسخه إلى المسار:  /var/log/springpath.

اكتبls -l | grep HX_Reportلمراجعة الملفات التي تم إنشاؤها بواسطة أداة HyperFlex-Hypercheck.

Under /var/log/springpath,

root@SpringpathControllerABCDE01234:/var/log/springpath# ls -l | grep HX_Report
-rw-r--r-- 1 root root 380K Sep 23 15:41 HX_Report_2020_08_30_10_43_50.tar
root@SpringpathControllerABCDE01234:/var/log/springpath#

Under /tmp/Hyperflex-Hypercheck,

root@SpringpathControllerABCDE01234:/tmp/Hyperflex-Hypercheck# ls
HX_Report_2020_08_30_10_43_50.tar prettytable.py HX_Report_2020_08_30_10_43_50 TestInfo.txt progressbar.py
HXTool.py prettytable.pyc ReadMe.txt progressbar.pyc LICENSE.txt
root@SpringpathControllerABCDE01234:/tmp/Hyperflex-Hypercheck# 

الملفات والسجلات في حزمة سجل HyperCheck:

root@SpringpathControllerABCDE01234:/tmp/Hyperflex-Hypercheck# ls HX_Report_2020_08_30_10_43_50/
HX_Tool_2020-08-30_10-43-50.log 
HX_Tool_Main_Report_2020-08-30_10-54-34.txt 
HX_Tool_Summary.json

الخطوة 8. تصديرHX_YYYY_MM_DD_HH_MM_SS.tarومشاركته مع TAC.

أستخدم الطريقة المفضلة لديك لتصدير سجلات HyperCheck باستخدامscp/sftp/ftp/tftpSCVM أو يمكنك ببساطة تنزيل حزمة دعم التخزين التي تحتوي على حزمة tar HX_REPORT.

فهم المخرجات/عمليات الفحص التي تم إجراؤها

عمليات التحقق التي يتم إجراؤها بواسطة Hypercheck

يتم إجراء هذه التحققات بواسطة أداة HyperFlex-Hypercheck:

Hyperflex Checks: (Below checks are performed on all the storage controller VMs)
    Cluster services check - Verifies the status of storfs, stMgr and stNodeMgr services
    Enospc state check - Checks if the cluster space usage is above the warning threshold or no   
    Zookeeper check - Checks whether the Zookeeper is running or no
    Exhibitor check - Verfies the status of the Exhibitor service which manages the ZK
    System Disks Usage - Checks if /sda1, var/stv and /var/zookeeper is less than 80% 
    HDD health check - Reports if you have any blacklisted disk in your cluster      
    DNS check - Checks whether DNS is configured and reachable                
    vCenter reachability check - Checks whether the vCenter is reachable on the required ports
    Timestamp check - Checks if all the controller VMs have the exact same time           
    NTP sync check - Checks whether NTP is reachable from the storage controller VMs and synced
    Check package & versions - Checks for packages and versions on Storage Controller VMs
    Check Iptables count - Checks for Iptables count on and ensure it is same on all Storage Controller VMs.              
    Extra pnodes check - Looks for any extra/duplicate pnode entries in the cluster
    Out of memory check - Checks through the log files if the cluster had any oom event
    Supported vSphere versions - Shows all the vSphere Versions supported with your current HXDP version
    Permissions for /tmp  - Checks if the /tmp permissions are set correctly
    Check Cluster Policy  - Checks the Configured Cluster Policy
    Check springpath_keystore.jceks file - Check if All the SCVM have same keystore file
    SED Capable  - Checks if the cluster is SED Capable
    SED Enabled - Checks if Encryption is enabled in the Cluster
    USB-0 Check - If Encryption is enabled, Checks that USB0 interface is present on all the SCVMs
    SED 5100/5200 Drive Check - If we have Micron SED 5100 drives and version is below 3.5.2b, we wont be able to replace or add new 5200 drives
    Disk Lock Check - If Encryption is enabled, Checks for any Locked drives
    Network Checks - Checks the connectivity in Storage network
    Check ZK-Cleanup-Script - Checks to identify ZKTxnCleanUp Script
    Replication Checks - If replication is enabled, we check the local and remote network connectivity (HX 4.5 Only)
    Stretched Cluster Checks - Checks the latency between the sites and the witness VM (HX 4.5 Only)

ESXi Checks: (Below checks are performed on each ESXI node)
    HX User Account check - Verifies if the HXUser is created on all the esxi hosts and has admin rights
    vMotion enabled check - Checks if the vMotion network is confirgued
    Check for ESXI Failback timer - Check for ESXi Failback timer on ESXi host
    Check connectivity between vmk1 and eth1 - Checks the connectivity between the Mgmt and Storage network
    No extra controller vm folders check - Checks for duplicate Controller SCVM Folders
    VMware Tools location check  - Checks for Non default VMware Tools location
    vfat Disk Usage check - Checks for vfat Disk Usage
    Check /tmp usage - Checking for /tmp usage
    Compute Node Checks - All the ESXI checks are also performed on Compute nodes (HX 4.5 Only)

نموذج لمخرجات Hypercheck من نظام المجموعة ذات 4 عقد الممتدة

Enter this information of HX-Cluster:
Enter the HX-Cluster Root Password:
Enter the ESX Root Password:

Cluster Name: HX-10-Stretched
 Site-100
 Site-97

Cluster Type: STRETCH_CLUSTER

SSH connection established to HX Node: 192.168.53.135
SSH connection established to HX Node: 192.168.53.136
SSH connection established to HX Node: 192.168.53.137
SSH connection established to HX Node: 192.168.53.138

HX Cluster Nodes:
+-------+--------------+--------------------------------+
| Nodes | IP Address   | HostName                       |
+-------+--------------+--------------------------------+
| 1     | 10.39.53.134 | SpringpathControllerOHCWUK9X3N |
+-------+--------------+--------------------------------+
| 2     | 10.39.53.135 | SpringpathController37MHMEIBCY |
+-------+--------------+--------------------------------+
| 3     | 10.39.53.136 | SpringpathControllerDWRWWIBFLF |
+-------+--------------+--------------------------------+
| 4     | 10.39.53.137 | SpringpathControllerWB4UNXDKX3 |
+-------+--------------+--------------------------------+

SSH connection established to ESX Host: 10.39.53.133
SSH connection established to ESX Host: 10.39.53.130
SSH connection established to ESX Host: 10.39.53.132
SSH connection established to ESX Host: 10.39.53.131

HX Controller: 192.168.53.135
Cluster services check      [########################] COMPLETED
ZooKeeper & Exhibitor check [########################] COMPLETED
HDD health check            [########################] COMPLETED
Pre-Upgrade Check           [########################] COMPLETED
Network check               [########################] COMPLETED

HX Controller: 192.168.53.136
Cluster services check      [########################] COMPLETED
ZooKeeper & Exhibitor check [########################] COMPLETED
HDD health check            [########################] COMPLETED
Pre-Upgrade Check           [########################] COMPLETED
Network check               [########################] COMPLETED

HX Controller: 192.168.53.137
Cluster services check      [########################] COMPLETED
ZooKeeper & Exhibitor check [########################] COMPLETED
HDD health check            [########################] COMPLETED
Pre-Upgrade Check           [########################] COMPLETED
Network check               [########################] COMPLETED

HX Controller: 192.168.53.138
Cluster services check      [########################] COMPLETED
ZooKeeper & Exhibitor check [########################] COMPLETED
HDD health check            [########################] COMPLETED
Pre-Upgrade Check           [########################] COMPLETED
Network check               [########################] COMPLETED


HX Controller: 192.168.53.135
Test Summary:
+--------------------------------------+-----------+----------------------------------------------------------------+
| Name                                 | Result    | Comments                                                       |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Cluster services check               | PASS      | Checks storfs, stMgr, sstNodeMgr service running on each node. |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Enospc state check                   | PASS      | Checks if the cluster storage utilization is above threshold.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Zookeeper check                      | PASS      | Checks if Zookeeper service is running.                        |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Exhibitor check                      | PASS      | Checks if Exhibitor in running.                                |
+--------------------------------------+-----------+----------------------------------------------------------------+
| System Disks Usage                   | PASS      | Checks if /sda1, var/stv and /var/zookeeper is less than 80%.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| HDD Health check                     | PASS      | Checks if any drive is in blacklisted state.                   |
+--------------------------------------+-----------+----------------------------------------------------------------+
| DNS check                            | PASS      | Checks if configured DNS is reachable.                         |
+--------------------------------------+-----------+----------------------------------------------------------------+
| vCenter reachability check           | PASS      | Checks if vCenter is network reachable using PING.             |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Timestamp check                      | PASS      | Checks if the timestamp is same across all Nodes.              |
+--------------------------------------+-----------+----------------------------------------------------------------+
| NTP sync check                       | PASS      | Checks if the NTP is synced with NTP server.                   |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check package & versions             | PASS      | Checks for count and version of HX packages on each node.      |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Iptables count                 | PASS      | Checks if the IP Table count matches on all nodes.             |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Extra pnodes check                   | PASS      | Checks for any stale Node entry.                               |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Memory usage check                   | PASS      | Checks for available memory more than 2GB.                     |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Incidence of OOM in the log file     | PASS      | Checks for any previous incidence of Out Of Memory Condition.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Supported vSphere versions           | 6.0.0-U3  | Prints the supported ESXi versions.                            |
|                                      | 6.5.0-U1  |                                                                |
|                                      | 6.5.0-U2  |                                                                |
|                                      | 6.5.0-U3  |                                                                |
|                                      | 6.7.0-UGA |                                                                |
|                                      | 6.7.0-U1  |                                                                |
|                                      | 6.7.0-U2  |                                                                |
|                                      | 6.7.0-U3  |                                                                |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check permissions for /tmp           | PASS      | Checks if the /tmp permissions are set correctly.              |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Cluster Policy                 | Lenient   | Checks the Configured Cluster Policy                           |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check springpath_keystore.jceks file | PASS      | All the SCVM have same keystore file.                          |
+--------------------------------------+-----------+----------------------------------------------------------------+
| SED Capable                          | NO        | Checks if the cluster is SED Capable.                          |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Witness Reachability           | PASS      | Checks Witness VM IP address is reachabile.                    |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check ZK-Cleanup-Script              | PASS      | Checks to identify ZKTxnCleanUp Script.                        | 
+--------------------------------------+-----------+----------------------------------------------------------------+

HX Controller: 192.168.53.136
Test Summary:
+--------------------------------------+-----------+----------------------------------------------------------------+
| Name                                 | Result    | Comments                                                       |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Cluster services check               | PASS      | Checks storfs, stMgr, sstNodeMgr service running on each node. |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Enospc state check                   | PASS      | Checks if the cluster storage utilization is above threshold.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Zookeeper check                      | PASS      | Checks if Zookeeper service is running.                        |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Exhibitor check                      | PASS      | Checks if Exhibitor in running.                                |
+--------------------------------------+-----------+----------------------------------------------------------------+
| System Disks Usage                   | PASS      | Checks if /sda1, var/stv and /var/zookeeper is less than 80%.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| HDD Health check                     | PASS      | Checks if any drive is in blacklisted state.                   |
+--------------------------------------+-----------+----------------------------------------------------------------+
| DNS check                            | PASS      | Checks if configured DNS is reachable.                         |
+--------------------------------------+-----------+----------------------------------------------------------------+
| vCenter reachability check           | PASS      | Checks if vCenter is network reachable using PING.             |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Timestamp check                      | PASS      | Checks if the timestamp is same across all Nodes.              |
+--------------------------------------+-----------+----------------------------------------------------------------+
| NTP sync check                       | PASS      | Checks if the NTP is synced with NTP server.                   |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check package & versions             | PASS      | Checks for count and version of HX packages on each node.      |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Iptables count                 | PASS      | Checks if the IP Table count matches on all nodes.             |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Extra pnodes check                   | PASS      | Checks for any stale Node entry.                               |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Memory usage check                   | PASS      | Checks for available memory more than 2GB.                     |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Incidence of OOM in the log file     | PASS      | Checks for any previous incidence of Out Of Memory Condition.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Supported vSphere versions           | 6.0.0-U3  | Prints the supported ESXi versions.                            |
|                                      | 6.5.0-U1  |                                                                |
|                                      | 6.5.0-U2  |                                                                |
|                                      | 6.5.0-U3  |                                                                |
|                                      | 6.7.0-UGA |                                                                |
|                                      | 6.7.0-U1  |                                                                |
|                                      | 6.7.0-U2  |                                                                |
|                                      | 6.7.0-U3  |                                                                |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check permissions for /tmp           | PASS      | Checks if the /tmp permissions are set correctly.              |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Cluster Policy                 | Lenient   | Checks the Configured Cluster Policy                           |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check springpath_keystore.jceks file | PASS      | All the SCVM have same keystore file.                          |
+--------------------------------------+-----------+----------------------------------------------------------------+
| SED Capable                          | NO        | Checks if the cluster is SED Capable.                          |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Witness Reachability           | PASS      | Checks Witness VM IP address is reachabile.                    |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check ZK-Cleanup-Script              | PASS      | Checks to identify ZKTxnCleanUp Script.                        | 
+--------------------------------------+-----------+----------------------------------------------------------------+

HX Controller: 192.168.53.137
Test Summary:
+--------------------------------------+-----------+----------------------------------------------------------------+
| Name                                 | Result    | Comments                                                       |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Cluster services check               | PASS      | Checks storfs, stMgr, sstNodeMgr service running on each node. |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Enospc state check                   | PASS      | Checks if the cluster storage utilization is above threshold.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Zookeeper check                      | PASS      | Checks if Zookeeper service is running.                        |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Exhibitor check                      | PASS      | Checks if Exhibitor in running.                                |
+--------------------------------------+-----------+----------------------------------------------------------------+
| System Disks Usage                   | PASS      | Checks if /sda1, var/stv and /var/zookeeper is less than 80%.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| HDD Health check                     | PASS      | Checks if any drive is in blacklisted state.                   |
+--------------------------------------+-----------+----------------------------------------------------------------+
| DNS check                            | PASS      | Checks if configured DNS is reachable.                         |
+--------------------------------------+-----------+----------------------------------------------------------------+
| vCenter reachability check           | PASS      | Checks if vCenter is network reachable using PING.             |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Timestamp check                      | PASS      | Checks if the timestamp is same across all Nodes.              |
+--------------------------------------+-----------+----------------------------------------------------------------+
| NTP sync check                       | PASS      | Checks if the NTP is synced with NTP server.                   |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check package & versions             | PASS      | Checks for count and version of HX packages on each node.      |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Iptables count                 | PASS      | Checks if the IP Table count matches on all nodes.             |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Extra pnodes check                   | PASS      | Checks for any stale Node entry.                               |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Memory usage check                   | PASS      | Checks for available memory more than 2GB.                     |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Incidence of OOM in the log file     | PASS      | Checks for any previous incidence of Out Of Memory Condition.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Supported vSphere versions           | 6.0.0-U3  | Prints the supported ESXi versions.                            |
|                                      | 6.5.0-U1  |                                                                |
|                                      | 6.5.0-U2  |                                                                |
|                                      | 6.5.0-U3  |                                                                |
|                                      | 6.7.0-UGA |                                                                |
|                                      | 6.7.0-U1  |                                                                |
|                                      | 6.7.0-U2  |                                                                |
|                                      | 6.7.0-U3  |                                                                |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check permissions for /tmp           | PASS      | Checks if the /tmp permissions are set correctly.              |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Cluster Policy                 | Lenient   | Checks the Configured Cluster Policy                           |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check springpath_keystore.jceks file | PASS      | All the SCVM have same keystore file.                          |
+--------------------------------------+-----------+----------------------------------------------------------------+
| SED Capable                          | NO        | Checks if the cluster is SED Capable.                          |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Witness Reachability           | PASS      | Checks Witness VM IP address is reachabile.                    |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check ZK-Cleanup-Script              | PASS      | Checks to identify ZKTxnCleanUp Script.                        | 
+--------------------------------------+-----------+----------------------------------------------------------------+

HX Controller: 192.168.53.138
Test Summary:
+--------------------------------------+-----------+----------------------------------------------------------------+
| Name                                 | Result    | Comments                                                       |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Cluster services check               | PASS      | Checks storfs, stMgr, sstNodeMgr service running on each node. |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Enospc state check                   | PASS      | Checks if the cluster storage utilization is above threshold.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Zookeeper check                      | PASS      | Checks if Zookeeper service is running.                        |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Exhibitor check                      | PASS      | Checks if Exhibitor in running.                                |
+--------------------------------------+-----------+----------------------------------------------------------------+
| System Disks Usage                   | PASS      | Checks if /sda1, var/stv and /var/zookeeper is less than 80%.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| HDD Health check                     | PASS      | Checks if any drive is in blacklisted state.                   |
+--------------------------------------+-----------+----------------------------------------------------------------+
| DNS check                            | PASS      | Checks if configured DNS is reachable.                         |
+--------------------------------------+-----------+----------------------------------------------------------------+
| vCenter reachability check           | PASS      | Checks if vCenter is network reachable using PING.             |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Timestamp check                      | PASS      | Checks if the timestamp is same across all Nodes.              |
+--------------------------------------+-----------+----------------------------------------------------------------+
| NTP sync check                       | PASS      | Checks if the NTP is synced with NTP server.                   |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check package & versions             | PASS      | Checks for count and version of HX packages on each node.      |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Iptables count                 | PASS      | Checks if the IP Table count matches on all nodes.             |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Extra pnodes check                   | PASS      | Checks for any stale Node entry.                               |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Memory usage check                   | PASS      | Checks for available memory more than 2GB.                     |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Incidence of OOM in the log file     | PASS      | Checks for any previous incidence of Out Of Memory Condition.  |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Supported vSphere versions           | 6.0.0-U3  | Prints the supported ESXi versions.                            |
|                                      | 6.5.0-U1  |                                                                |
|                                      | 6.5.0-U2  |                                                                |
|                                      | 6.5.0-U3  |                                                                |
|                                      | 6.7.0-UGA |                                                                |
|                                      | 6.7.0-U1  |                                                                |
|                                      | 6.7.0-U2  |                                                                |
|                                      | 6.7.0-U3  |                                                                |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check permissions for /tmp           | PASS      | Checks if the /tmp permissions are set correctly.              |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Cluster Policy                 | Lenient   | Checks the Configured Cluster Policy                           |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check springpath_keystore.jceks file | PASS      | All the SCVM have same keystore file.                          |
+--------------------------------------+-----------+----------------------------------------------------------------+
| SED Capable                          | NO        | Checks if the cluster is SED Capable.                          |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Witness Reachability           | FAIL      | Checks Witness VM IP address is reachabile.                    |
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check ZK-Cleanup-Script              | PASS      | Checks to identify ZKTxnCleanUp Script.                        | 
+--------------------------------------+-----------+----------------------------------------------------------------+
| Check Disk for SMART Failure.        | PASS      | Checks disks for SMART Failure.                                |
+--------------------------------------+-----------+----------------------------------------------------------------+
################################################################################
                        Network check:
################################################################################

ESX vmk0: 10.39.53.130, 10.39.53.131, 10.39.53.132, 10.39.53.133

ESX vmk1: 192.168.53.130, 192.168.53.131, 192.168.53.132, 192.168.53.133

SCVM eth0: 10.39.53.134, 10.39.53.135, 10.39.53.136, 10.39.53.137

SCVM eth1: 192.168.53.135, 192.168.53.136, 192.168.53.137, 192.168.53.138

ESX Host: 10.39.53.130
+--------------------------------------+--------+-------------------------------------------------+
| Name                                 | Result | Comments                                        |
+--------------------------------------+--------+-------------------------------------------------+
| HX User Account check                | PASS   | Checks if HXUSER is present.                    |
+--------------------------------------+--------+-------------------------------------------------+
| vMotion enabled check                | PASS   | Checks if vMotion is enabled on the host.       |
+--------------------------------------+--------+-------------------------------------------------+
| Check for ESXI Failback timer        | PASS   | Checks for ESXi FAILBACK timer set to 30000ms.  |
+--------------------------------------+--------+-------------------------------------------------+
| Check vmk1 ping to eth1              | PASS   | Checks Network between ESXi vmk1 and SCVM eth1. |
+--------------------------------------+--------+-------------------------------------------------+
| No extra controller vm folders check | PASS   | Checks for duplicate Controller SCVM Folders.   |
+--------------------------------------+--------+-------------------------------------------------+
| VMware Tools location check          | PASS   | Checks for Non default VMware Tools location.   |
+--------------------------------------+--------+-------------------------------------------------+
| vfat Disk Usage check                | PASS   | Checks for vfat Disk Usage.                     |
+--------------------------------------+--------+-------------------------------------------------+
| Check /tmp usage                     | PASS   | Checking for /tmp usage.                        |
+--------------------------------------+--------+-------------------------------------------------+

ESX Host: 10.39.53.131
+--------------------------------------+--------+-------------------------------------------------+
| Name                                 | Result | Comments                                        |
+--------------------------------------+--------+-------------------------------------------------+
| HX User Account check                | PASS   | Checks if HXUSER is present.                    |
+--------------------------------------+--------+-------------------------------------------------+
| vMotion enabled check                | PASS   | Checks if vMotion is enabled on the host.       |
+--------------------------------------+--------+-------------------------------------------------+
| Check for ESXI Failback timer        | PASS   | Checks for ESXi FAILBACK timer set to 30000ms.  |
+--------------------------------------+--------+-------------------------------------------------+
| Check vmk1 ping to eth1              | PASS   | Checks Network between ESXi vmk1 and SCVM eth1. |
+--------------------------------------+--------+-------------------------------------------------+
| No extra controller vm folders check | PASS   | Checks for duplicate Controller SCVM Folders.   |
+--------------------------------------+--------+-------------------------------------------------+
| VMware Tools location check          | PASS   | Checks for Non default VMware Tools location.   |
+--------------------------------------+--------+-------------------------------------------------+
| vfat Disk Usage check                | PASS   | Checks for vfat Disk Usage.                     |
+--------------------------------------+--------+-------------------------------------------------+
| Check /tmp usage                     | PASS   | Checking for /tmp usage.                        |
+--------------------------------------+--------+-------------------------------------------------+

ESX Host: 10.39.53.132
+--------------------------------------+--------+-------------------------------------------------+
| Name                                 | Result | Comments                                        |
+--------------------------------------+--------+-------------------------------------------------+
| HX User Account check                | PASS   | Checks if HXUSER is present.                    |
+--------------------------------------+--------+-------------------------------------------------+
| vMotion enabled check                | PASS   | Checks if vMotion is enabled on the host.       |
+--------------------------------------+--------+-------------------------------------------------+
| Check for ESXI Failback timer        | PASS   | Checks for ESXi FAILBACK timer set to 30000ms.  |
+--------------------------------------+--------+-------------------------------------------------+
| Check vmk1 ping to eth1              | PASS   | Checks Network between ESXi vmk1 and SCVM eth1. |
+--------------------------------------+--------+-------------------------------------------------+
| No extra controller vm folders check | PASS   | Checks for duplicate Controller SCVM Folders.   |
+--------------------------------------+--------+-------------------------------------------------+
| VMware Tools location check          | PASS   | Checks for Non default VMware Tools location.   |
+--------------------------------------+--------+-------------------------------------------------+
| vfat Disk Usage check                | PASS   | Checks for vfat Disk Usage.                     |
+--------------------------------------+--------+-------------------------------------------------+
| Check /tmp usage                     | PASS   | Checking for /tmp usage.                        |
+--------------------------------------+--------+-------------------------------------------------+

Main Report File: HX_Tool_Main_Report_2020-08-26_09-54-59.txt
Report tar file: HX_Report_2020_08_26_09_43_18.tar
Report file copied to path: /var/log/springpath

Release Notes:
https://www.cisco.com/c/en/us/support/hyperconverged-systems/hyperflex-hx-data-platform-software/products-release-notes-list.html

Upgrade Guides:
https://www.cisco.com/c/en/us/support/hyperconverged-systems/hyperflex-hx-data-platform-software/products-installation-guides-list.html

Note:
1) If upgrading to HX 4.0(2a), please review the following link and perform workaround – https://tinyurl.com/wc7j5qp
2) Please check the status of Compute nodes manually, script only verifies the config on the converged nodes.
3) Hypercheck doesnot perform FAILOVER TEST, so please ensure that the upstream is configured for network connectivity for JUMBO or NORMAL MTU size as needed.
4) If you have performed any activity on your vcenter(like upgrade, certificate replacement,etc.), it is recommended to reregister your cluster to the vcenter before performing upgrades. Refer to the Hyperflex CLI guide for relevant commands. 

تحليل مخرجات الأداة

الخطوات التالية

• تقوم الأداة بأتمتة عملية تشغيل الأوامر اليدوية على أنظمة HyperFlex.
• إذا كانت الأداة تعمل موافق وتعطي تمرير في كل الاختبارات، فإن نظام HX يكون جيد لكل التحققات التي قام البرنامج النصي بتنفيذها.
• في الحالات التي تعجز فيها الأداة عن العمل على بعض التحققات أو لا تعمل بنجاح، يمكنك إستخدام أوامر CLI (المدرجة) لتنفيذ نفس التحققات على نظام HyperFlex كما هو الحال مع النص التنفيذي يدويا.
• لا تقوم الأداة بالتحقق من وجود أي تحذيرات قديمة/جديدة/مفتوحة/تم حلها، ومن ثم يوصى بشدة بمراجعة ملاحظات إصدار HyperFlex وأدلة الترقية قبل أي نشاط ترقية أو صيانة.

ملاحظة: لا تقم بفتح حالة مركز المساعدة الفنية بسبب فشل تشغيل البرنامج النصي. قم بتشغيل الأوامر يدويا، والتعرف على المشكلة، وفتح SR للمشكلة المحددة.

أوامر CLI

على HyperFlex SCVM:

SSH to All Hyperflex SCVMs-

# service_status.sh

# sysmtool --ns cluster --cmd enospcinfo

# echo srvr | nc 0 2181

# pidof exhibitor

# stcli disk list --ip <Corresponding ESXi Mgmt IP Address> |grep -B 2 -A 8 blacklisted

# stcli services dns show (and ping the IPs listed)

# ping <vCenter IP Address>

# date ; compare the time on all SCVMs. They should ideally be identical

# stcli services ntp show

# stcli cleaner info

# ntpq -p -4 

# dpkg -l | grep -i springpath | grep -v storfs-support*

# sysmtool --ns disk --cmd list | grep -i blacklisted

# iptables -L -n | wc -l 

# stcli cluster info

# df -h ; check that /var/stv should be less than 80%

# zgrep -i “out of memory” /var/log/springpath/debug-storfs.*

# ping -I eth0 <eth0> of all SCVMs

# ping -I eth1 <eth1> of all SCVMs

# "ls -ld /tmp" check for 775 and 777

# stcli cluster info | grep -i 'clusterAccessPolicy:' | head -1

# md5sum /etc/springpath/secure/springpath_keystore.jceks

# cat /etc/springpath/sed_capability.conf

# cat /etc/springpath/sed.conf

# cat /var/log/springpath/diskslotmap-v2.txt

# stcli cluster info | grep dataZkIp (ping dataZkIp for latency)

على أنظمة ESXi:

SSH to all ESXi hosts

# esxcli system account list

# esxcli network firewall ruleset list | grep -i vMotion

# esxcli software vib list| egrep -i 'scvm|stHyper|stfs'

# chkconfig --list | grep -E 'ntpd|hostd|vpxa|stHypervisorSvc|scvmclient|hxctlvm' 

# esxcfg-vmknic -l ; confirm that vMotion VMK2 is created

# vmkping -I vmk1 <eth1> of all SCVMs

# cd /vmfs/volumes/Springpath-XXXXXXXXXX ; Ensure that it has only one Folder that has the Storage Controller VM

# df -h | grep vfat  ; Ensure dir has free space

معلومات ذات صلة

• الدعم الفني والتنزيلات من Cisco