تشغيل HyperCheck: أداة التحقق من صحة HyperFlex ومرحلة ما قبل الترقية
المحتويات
المقدمة
يصف هذا وثيقة العملية أن يركض ال hypercheck صحة و pre-upgrade أداة.
معلومات أساسية
هذه الأداة عبارة عن أداة مساعدة تقوم بإجراء فحوصات ذاتية إستباقية على الأنظمة التي تعمل بتقنية HyperFlex لضمان إستقرار هذه الأجهزة ومرونتها. وتساعد هذه الأداة على أتمتة قائمة بعمليات التحقق من الصحة وما قبل الترقية على أنظمة HyperFlex لتوفير الوقت أثناء عمليات الترقية والصيانة باستخدام تقنية HyperFlex.
ملاحظة: قم بتنزيل أحدث إصدار من الأداة دائما قبل الاستخدام. بما أن الأداة يتم تحسينها بشكل متكرر، فإن إستخدام إصدار سابق يمكن أن يؤدي إلى فقدان تحققات مهمة.
أنظمة HX المدعومة
- الإصدارات HyperFlex - 1.8 و 2.0 و 2.1 و 2.5 و 2.6 و 3.0 و 3.5 و 4.0 و 4.5 و 5.0 و 5.5
- مجموعة HyperFlex القياسية
- مجموعة HyperFlex الممتدة
- نظام HyperFlex Edge Cluster (ثنائي العقد و 3 العقد و 4 العقد)
- مدعوم فقط على مجموعة HyperFlex على VMWare ESXi
ملاحظة: للحصول على معلومات حول كيفية تشغيل HyperCheck على مجموعة HyperFlex HyperV، تفضل بزيارة موقع الويب https://www.cisco.com/c/en/us/support/docs/hyperconverged-infrastructure/hyperflex-hx-data-platform/216027-hypercheck-hyperflex-health-pre-upgr.html.
متى تستخدمه
- قبل ترقيات HyperFlex
- التحقق من سلامة HyperFlex قبل إطارات الصيانة وبعدها
- لتحديد محركات الأقراص/الأقراص المعطلة
- عندما تعمل مع Cisco TAC
- فحص الحماية الاستباقي في أي وقت
كيف تستخدمه
HX الإصدار 4.5 والإصدارات الأحدث
الخطوة 1. ابدأ اتصال SSH بالجهاز الظاهري لوحدة تحكم التخزين (SCVM) باستخدام IP الخاص بإدارة نظام المجموعة (CMIP)، وهو عنوان IP الخاص بك للتوصيل عبر نظام HX.
الخطوة 2. تنفيذ الأمر hypercheck .
admin:~$ hypercheck
الخطوة 3. أدخل كلمة مرور مسؤول SCVM عند طلبها وأدخل كلمة مرور الجذر الخاصة ب ESXi.
admin:~$ hypercheck
HX Health Check 4.5.0
Please enter below info of HX-Cluster:
Enter the HX-Cluster Root Password:
Enter the HX-Cluster Admin Password:
Enter the ESX Root Password:
HX الإصدار 4.0 وما قبله
الخطوة 1. تنزيل Hyperflex-Hypercheck.zip من حساب Cisco Github Devnet هنا. احصل على أحدث نسخة تتضمن آخر التحسينات والتحديثات.
ملاحظة: أستخدم فقط البرنامج النصي الذي تم تنزيله من حساب Cisco Github Devnet.
الخطوة 2. قم بتحميله إلى SCVM باستخدام CMIP.
أستخدم طريقتك المفضلة - scp/sftp/ftp/tftp - لنسخ Hyperflex-Hypercheck.zip إلى /tmp دليل.
بالنسبة إلى MAC:
تنفيذ SCP من CLI (تأكيد أن Hyperflex-Hypercheck.zip في نفس المجلد الذي تقوم بتشغيل SCP منه).
# scp Hyperflex-Hypercheck.zip root@
أستخدم هذا الخيار للتعرف على عنوان IP الخاص بإدارة نظام المجموعة في بيئة HX لديك - دفتر تشغيل HyperFlex.
بالنسبة لنظام التشغيل Windows:
يمكنك إستخدام WINSCP لنقل الملفات كما هو موضح هنا:
الخطوة 3. إستخراج محتويات Hyperflex-Hypercheck.zip.
النوع cd /tmp من أجل التغيير إلى /tmp دليل.
root@SpringpathController7PVQWP6WV1:~# cd /tmp/
النوع unzip Hyperflex-Hypercheck.zip in order to استخرجت المبرد.
root@SpringpathController7PVQWP6WV1:/tmp# unzip Hyperflex-Hypercheck.zip
Archive: Hyperflex-Hypercheck.zip
b61c59f7962b72902692ce70548ba3d760efdf06
creating: Hyperflex-Hypercheck/
inflating: Hyperflex-Hypercheck/HXTool.py
inflating: Hyperflex-Hypercheck/LICENSE.txt
inflating: Hyperflex-Hypercheck/ReadMe.txt
inflating: Hyperflex-Hypercheck/TestInfo.txt
inflating: Hyperflex-Hypercheck/prettytable.py
inflating: Hyperflex-Hypercheck/progressbar.py
root@SpringpathController7PVQWP6WV1:/tmp#
الخطوة 4. قم بتنفيذ نص HXTool Python.
النوع cd Hyperflex-Hypercheck من أجل الانتقال إلى Hyperflex-Hypercheck دليل.
root@SpringpathControllerABCDE01234:/tmp# cd Hyperflex-Hypercheck
النوع python HXTool.py لتنفيذ البرنامج النصي.
root@SpringpathControllerABCDE01234:/tmp/Hyperflex-Hypercheck# python HXTool.py
الخطوة 5. أدخل كلمة مرور جذر SCVM عند طلبها.
Enter this information of HX-Cluster:
Enter the HX-Cluster Root Password:
Enter the ESX Root Password:
ملاحظة: لإيقاف تنفيذ البرنامج النصي، أستخدم المفتاح (CTRL+Z) ويتوقف فورا.
الخطوة 6. تقوم أداة HyperFlex-Hypercheck بتشغيل عمليات التحقق الخاصة بها. يستغرق إكمال التنفيذ ما بين 3 و 10 دقائق، وهذا يتوقف على عدد العقد المجمعة في نظام المجموعة.
الخطوة 7. الحصول على تقرير عن مخرجات البرنامج النصي. يمكنك الحصول عليها كما هو موضح:
يعرض الأمر Hypercheck Report tar يتم حفظ الملف ضمن /var/log/springpath و /tmp/Hyperflex-Hypercheck. إذا، يمكنك تنزيل حزمة القار من تحت /var/log/springpath أو /tmp/Hyperflex-Hypercheck. بدلا من ذلك، يمكنك إنشاء حزمة دعم الأنظمة وتحميلها فقط، والتي تحتوي أيضا على تقرير الاختبار التشعبي tar.
مثال ملف tar للتقرير - HX_Report_2020_08_30_10_43_50.tar تم نسخه إلى المسار: /var/log/springpath.
النوع ls -l | grep HX_Report لمراجعة الملفات التي تم إنشاؤها بواسطة أداة HyperFlex-Hypercheck.
Under /var/log/springpath,
root@SpringpathControllerABCDE01234:/var/log/springpath# ls -l | grep HX_Report
-rw-r--r-- 1 root root 380K Sep 23 15:41 HX_Report_2020_08_30_10_43_50.tar
root@SpringpathControllerABCDE01234:/var/log/springpath#
Under /tmp/Hyperflex-Hypercheck,
root@SpringpathControllerABCDE01234:/tmp/Hyperflex-Hypercheck# ls
HX_Report_2020_08_30_10_43_50.tar prettytable.py HX_Report_2020_08_30_10_43_50 TestInfo.txt progressbar.py
HXTool.py prettytable.pyc ReadMe.txt progressbar.pyc LICENSE.txt
root@SpringpathControllerABCDE01234:/tmp/Hyperflex-Hypercheck#
الملفات والسجلات في حزمة سجل HyperCheck:
root@SpringpathControllerABCDE01234:/tmp/Hyperflex-Hypercheck# ls HX_Report_2020_08_30_10_43_50/
HX_Tool_2020-08-30_10-43-50.log
HX_Tool_Main_Report_2020-08-30_10-54-34.txt
HX_Tool_Summary.json
الخطوة 8. تصدير HX_YYYY_MM_DD_HH_MM_SS.tar وشاركه مع TAC.
أستخدم طريقتك المفضلة لتصدير سجلات HyperCheck باستخدام scp/sftp/ftp/tftp من ال SCVM أو أنت يستطيع ببساطة جلبت ال storfs-support حزمة أي يحتوي ال hx_report tar حزمة.
فهم المخرجات/عمليات الفحص التي تم إجراؤها
عمليات التحقق التي يتم إجراؤها بواسطة Hypercheck
يتم إجراء هذه التحققات بواسطة أداة HyperFlex-Hypercheck:
Hyperflex Checks: (Below checks are performed on all the storage controller VMs)
Cluster services check - Verifies the status of storfs, stMgr and stNodeMgr services
Enospc state check - Checks if the cluster space usage is above the warning threshold or no
Zookeeper check - Checks whether the Zookeeper is running or no
Exhibitor check - Verfies the status of the Exhibitor service which manages the ZK
System Disks Usage - Checks if /sda1, var/stv and /var/zookeeper is less than 80%
HDD health check - Reports if you have any blacklisted disk in your cluster
DNS check - Checks whether DNS is configured and reachable
vCenter reachability check - Checks whether the vCenter is reachable on the required ports
Timestamp check - Checks if all the controller VMs have the exact same time
NTP sync check - Checks whether NTP is reachable from the storage controller VMs and synced
Check package & versions - Checks for packages and versions on Storage Controller VMs
Check Iptables count - Checks for Iptables count on and ensure it is same on all Storage Controller VMs.
Extra pnodes check - Looks for any extra/duplicate pnode entries in the cluster
Out of memory check - Checks through the log files if the cluster had any oom event
Supported vSphere versions - Shows all the vSphere Versions supported with your current HXDP version
Permissions for /tmp - Checks if the /tmp permissions are set correctly
Check Cluster Policy - Checks the Configured Cluster Policy
Check springpath_keystore.jceks file - Check if All the SCVM have same keystore file
SED Capable - Checks if the cluster is SED Capable
SED Enabled - Checks if Encryption is enabled in the Cluster
USB-0 Check - If Encryption is enabled, Checks that USB0 interface is present on all the SCVMs
SED 5100/5200 Drive Check - If we have Micron SED 5100 drives and version is below 3.5.2b, we wont be able to replace or add new 5200 drives
Disk Lock Check - If Encryption is enabled, Checks for any Locked drives
Network Checks - Checks the connectivity in Storage network
Check ZK-Cleanup-Script - Checks to identify ZKTxnCleanUp Script
Replication Checks - If replication is enabled, we check the local and remote network connectivity (HX 4.5 Only)
Stretched Cluster Checks - Checks the latency between the sites and the witness VM (HX 4.5 Only)
ESXi Checks: (Below checks are performed on each ESXI node)
HX User Account check - Verifies if the HXUser is created on all the esxi hosts and has admin rights
vMotion enabled check - Checks if the vMotion network is confirgued
Check for ESXI Failback timer - Check for ESXi Failback timer on ESXi host
Check connectivity between vmk1 and eth1 - Checks the connectivity between the Mgmt and Storage network
No extra controller vm folders check - Checks for duplicate Controller SCVM Folders
VMware Tools location check - Checks for Non default VMware Tools location
vfat Disk Usage check - Checks for vfat Disk Usage
Check /tmp usage - Checking for /tmp usage
Compute Node Checks - All the ESXI checks are also performed on Compute nodes (HX 4.5 Only)
نموذج لمخرجات Hypercheck من نظام المجموعة ذات 4 عقد الممتدة
Enter this information of HX-Cluster: Enter the HX-Cluster Root Password: Enter the ESX Root Password: Cluster Name: HX-10-Stretched Site-100 Site-97 Cluster Type: STRETCH_CLUSTER SSH connection established to HX Node: 192.168.53.135 SSH connection established to HX Node: 192.168.53.136 SSH connection established to HX Node: 192.168.53.137 SSH connection established to HX Node: 192.168.53.138 HX Cluster Nodes: +-------+--------------+--------------------------------+ | Nodes | IP Address | HostName | +-------+--------------+--------------------------------+ | 1 | 14.39.53.134 | SpringpathControllerOHCWUK9X3N | +-------+--------------+--------------------------------+ | 2 | 14.39.53.135 | SpringpathController37MHMEIBCY | +-------+--------------+--------------------------------+ | 3 | 14.39.53.136 | SpringpathControllerDWRWWIBFLF | +-------+--------------+--------------------------------+ | 4 | 14.39.53.137 | SpringpathControllerWB4UNXDKX3 | +-------+--------------+--------------------------------+ SSH connection established to ESX Host: 14.39.53.133 SSH connection established to ESX Host: 14.39.53.130 SSH connection established to ESX Host: 14.39.53.132 SSH connection established to ESX Host: 14.39.53.131 HX Controller: 192.168.53.135 Cluster services check [########################] COMPLETED ZooKeeper & Exhibitor check [########################] COMPLETED HDD health check [########################] COMPLETED Pre-Upgrade Check [########################] COMPLETED Network check [########################] COMPLETED HX Controller: 192.168.53.136 Cluster services check [########################] COMPLETED ZooKeeper & Exhibitor check [########################] COMPLETED HDD health check [########################] COMPLETED Pre-Upgrade Check [########################] COMPLETED Network check [########################] COMPLETED HX Controller: 192.168.53.137 Cluster services check [########################] COMPLETED ZooKeeper & Exhibitor check [########################] COMPLETED HDD health check [########################] COMPLETED Pre-Upgrade Check [########################] COMPLETED Network check [########################] COMPLETED HX Controller: 192.168.53.138 Cluster services check [########################] COMPLETED ZooKeeper & Exhibitor check [########################] COMPLETED HDD health check [########################] COMPLETED Pre-Upgrade Check [########################] COMPLETED Network check [########################] COMPLETED HX Controller: 192.168.53.135 Test Summary: +--------------------------------------+-----------+----------------------------------------------------------------+ | Name | Result | Comments | +--------------------------------------+-----------+----------------------------------------------------------------+ | Cluster services check | PASS | Checks storfs, stMgr, sstNodeMgr service running on each node. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Enospc state check | PASS | Checks if the cluster storage utilization is above threshold. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Zookeeper check | PASS | Checks if Zookeeper service is running. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Exhibitor check | PASS | Checks if Exhibitor in running. | +--------------------------------------+-----------+----------------------------------------------------------------+ | System Disks Usage | PASS | Checks if /sda1, var/stv and /var/zookeeper is less than 80%. | +--------------------------------------+-----------+----------------------------------------------------------------+ | HDD Health check | PASS | Checks if any drive is in blacklisted state. | +--------------------------------------+-----------+----------------------------------------------------------------+ | DNS check | PASS | Checks if configured DNS is reachable. | +--------------------------------------+-----------+----------------------------------------------------------------+ | vCenter reachability check | PASS | Checks if vCenter is network reachable using PING. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Timestamp check | PASS | Checks if the timestamp is same across all Nodes. | +--------------------------------------+-----------+----------------------------------------------------------------+ | NTP sync check | PASS | Checks if the NTP is synced with NTP server. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check package & versions | PASS | Checks for count and version of HX packages on each node. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Iptables count | PASS | Checks if the IP Table count matches on all nodes. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Extra pnodes check | PASS | Checks for any stale Node entry. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Memory usage check | PASS | Checks for available memory more than 2GB. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Incidence of OOM in the log file | PASS | Checks for any previous incidence of Out Of Memory Condition. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Supported vSphere versions | 6.0.0-U3 | Prints the supported ESXi versions. | | | 6.5.0-U1 | | | | 6.5.0-U2 | | | | 6.5.0-U3 | | | | 6.7.0-UGA | | | | 6.7.0-U1 | | | | 6.7.0-U2 | | | | 6.7.0-U3 | | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check permissions for /tmp | PASS | Checks if the /tmp permissions are set correctly. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Cluster Policy | Lenient | Checks the Configured Cluster Policy | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check springpath_keystore.jceks file | PASS | All the SCVM have same keystore file. | +--------------------------------------+-----------+----------------------------------------------------------------+ | SED Capable | NO | Checks if the cluster is SED Capable. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Witness Reachability | PASS | Checks Witness VM IP address is reachabile. | +--------------------------------------+-----------+----------------------------------------------------------------+
| Check ZK-Cleanup-Script | PASS | Checks to identify ZKTxnCleanUp Script. |
+--------------------------------------+-----------+----------------------------------------------------------------+ HX Controller: 192.168.53.136 Test Summary: +--------------------------------------+-----------+----------------------------------------------------------------+ | Name | Result | Comments | +--------------------------------------+-----------+----------------------------------------------------------------+ | Cluster services check | PASS | Checks storfs, stMgr, sstNodeMgr service running on each node. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Enospc state check | PASS | Checks if the cluster storage utilization is above threshold. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Zookeeper check | PASS | Checks if Zookeeper service is running. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Exhibitor check | PASS | Checks if Exhibitor in running. | +--------------------------------------+-----------+----------------------------------------------------------------+ | System Disks Usage | PASS | Checks if /sda1, var/stv and /var/zookeeper is less than 80%. | +--------------------------------------+-----------+----------------------------------------------------------------+ | HDD Health check | PASS | Checks if any drive is in blacklisted state. | +--------------------------------------+-----------+----------------------------------------------------------------+ | DNS check | PASS | Checks if configured DNS is reachable. | +--------------------------------------+-----------+----------------------------------------------------------------+ | vCenter reachability check | PASS | Checks if vCenter is network reachable using PING. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Timestamp check | PASS | Checks if the timestamp is same across all Nodes. | +--------------------------------------+-----------+----------------------------------------------------------------+ | NTP sync check | PASS | Checks if the NTP is synced with NTP server. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check package & versions | PASS | Checks for count and version of HX packages on each node. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Iptables count | PASS | Checks if the IP Table count matches on all nodes. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Extra pnodes check | PASS | Checks for any stale Node entry. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Memory usage check | PASS | Checks for available memory more than 2GB. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Incidence of OOM in the log file | PASS | Checks for any previous incidence of Out Of Memory Condition. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Supported vSphere versions | 6.0.0-U3 | Prints the supported ESXi versions. | | | 6.5.0-U1 | | | | 6.5.0-U2 | | | | 6.5.0-U3 | | | | 6.7.0-UGA | | | | 6.7.0-U1 | | | | 6.7.0-U2 | | | | 6.7.0-U3 | | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check permissions for /tmp | PASS | Checks if the /tmp permissions are set correctly. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Cluster Policy | Lenient | Checks the Configured Cluster Policy | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check springpath_keystore.jceks file | PASS | All the SCVM have same keystore file. | +--------------------------------------+-----------+----------------------------------------------------------------+ | SED Capable | NO | Checks if the cluster is SED Capable. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Witness Reachability | PASS | Checks Witness VM IP address is reachabile. | +--------------------------------------+-----------+----------------------------------------------------------------+
| Check ZK-Cleanup-Script | PASS | Checks to identify ZKTxnCleanUp Script. |
+--------------------------------------+-----------+----------------------------------------------------------------+ HX Controller: 192.168.53.137 Test Summary: +--------------------------------------+-----------+----------------------------------------------------------------+ | Name | Result | Comments | +--------------------------------------+-----------+----------------------------------------------------------------+ | Cluster services check | PASS | Checks storfs, stMgr, sstNodeMgr service running on each node. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Enospc state check | PASS | Checks if the cluster storage utilization is above threshold. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Zookeeper check | PASS | Checks if Zookeeper service is running. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Exhibitor check | PASS | Checks if Exhibitor in running. | +--------------------------------------+-----------+----------------------------------------------------------------+ | System Disks Usage | PASS | Checks if /sda1, var/stv and /var/zookeeper is less than 80%. | +--------------------------------------+-----------+----------------------------------------------------------------+ | HDD Health check | PASS | Checks if any drive is in blacklisted state. | +--------------------------------------+-----------+----------------------------------------------------------------+ | DNS check | PASS | Checks if configured DNS is reachable. | +--------------------------------------+-----------+----------------------------------------------------------------+ | vCenter reachability check | PASS | Checks if vCenter is network reachable using PING. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Timestamp check | PASS | Checks if the timestamp is same across all Nodes. | +--------------------------------------+-----------+----------------------------------------------------------------+ | NTP sync check | PASS | Checks if the NTP is synced with NTP server. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check package & versions | PASS | Checks for count and version of HX packages on each node. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Iptables count | PASS | Checks if the IP Table count matches on all nodes. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Extra pnodes check | PASS | Checks for any stale Node entry. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Memory usage check | PASS | Checks for available memory more than 2GB. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Incidence of OOM in the log file | PASS | Checks for any previous incidence of Out Of Memory Condition. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Supported vSphere versions | 6.0.0-U3 | Prints the supported ESXi versions. | | | 6.5.0-U1 | | | | 6.5.0-U2 | | | | 6.5.0-U3 | | | | 6.7.0-UGA | | | | 6.7.0-U1 | | | | 6.7.0-U2 | | | | 6.7.0-U3 | | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check permissions for /tmp | PASS | Checks if the /tmp permissions are set correctly. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Cluster Policy | Lenient | Checks the Configured Cluster Policy | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check springpath_keystore.jceks file | PASS | All the SCVM have same keystore file. | +--------------------------------------+-----------+----------------------------------------------------------------+ | SED Capable | NO | Checks if the cluster is SED Capable. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Witness Reachability | PASS | Checks Witness VM IP address is reachabile. | +--------------------------------------+-----------+----------------------------------------------------------------+
| Check ZK-Cleanup-Script | PASS | Checks to identify ZKTxnCleanUp Script. |
+--------------------------------------+-----------+----------------------------------------------------------------+ HX Controller: 192.168.53.138 Test Summary: +--------------------------------------+-----------+----------------------------------------------------------------+ | Name | Result | Comments | +--------------------------------------+-----------+----------------------------------------------------------------+ | Cluster services check | PASS | Checks storfs, stMgr, sstNodeMgr service running on each node. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Enospc state check | PASS | Checks if the cluster storage utilization is above threshold. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Zookeeper check | PASS | Checks if Zookeeper service is running. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Exhibitor check | PASS | Checks if Exhibitor in running. | +--------------------------------------+-----------+----------------------------------------------------------------+ | System Disks Usage | PASS | Checks if /sda1, var/stv and /var/zookeeper is less than 80%. | +--------------------------------------+-----------+----------------------------------------------------------------+ | HDD Health check | PASS | Checks if any drive is in blacklisted state. | +--------------------------------------+-----------+----------------------------------------------------------------+ | DNS check | PASS | Checks if configured DNS is reachable. | +--------------------------------------+-----------+----------------------------------------------------------------+ | vCenter reachability check | PASS | Checks if vCenter is network reachable using PING. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Timestamp check | PASS | Checks if the timestamp is same across all Nodes. | +--------------------------------------+-----------+----------------------------------------------------------------+ | NTP sync check | PASS | Checks if the NTP is synced with NTP server. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check package & versions | PASS | Checks for count and version of HX packages on each node. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Iptables count | PASS | Checks if the IP Table count matches on all nodes. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Extra pnodes check | PASS | Checks for any stale Node entry. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Memory usage check | PASS | Checks for available memory more than 2GB. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Incidence of OOM in the log file | PASS | Checks for any previous incidence of Out Of Memory Condition. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Supported vSphere versions | 6.0.0-U3 | Prints the supported ESXi versions. | | | 6.5.0-U1 | | | | 6.5.0-U2 | | | | 6.5.0-U3 | | | | 6.7.0-UGA | | | | 6.7.0-U1 | | | | 6.7.0-U2 | | | | 6.7.0-U3 | | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check permissions for /tmp | PASS | Checks if the /tmp permissions are set correctly. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Cluster Policy | Lenient | Checks the Configured Cluster Policy | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check springpath_keystore.jceks file | PASS | All the SCVM have same keystore file. | +--------------------------------------+-----------+----------------------------------------------------------------+ | SED Capable | NO | Checks if the cluster is SED Capable. | +--------------------------------------+-----------+----------------------------------------------------------------+ | Check Witness Reachability | FAIL | Checks Witness VM IP address is reachabile. | +--------------------------------------+-----------+----------------------------------------------------------------+
| Check ZK-Cleanup-Script | PASS | Checks to identify ZKTxnCleanUp Script. |
+--------------------------------------+-----------+----------------------------------------------------------------+ | Check Disk for SMART Failure. | PASS | Checks disks for SMART Failure. |
+--------------------------------------+-----------+----------------------------------------------------------------+ ################################################################################ Network check: ################################################################################ ESX vmk0: 14.39.53.130, 14.39.53.131, 14.39.53.132, 14.39.53.133 ESX vmk1: 192.168.53.130, 192.168.53.131, 192.168.53.132, 192.168.53.133 SCVM eth0: 14.39.53.134, 14.39.53.135, 14.39.53.136, 14.39.53.137 SCVM eth1: 192.168.53.135, 192.168.53.136, 192.168.53.137, 192.168.53.138 ESX Host: 14.39.53.130 +--------------------------------------+--------+-------------------------------------------------+ | Name | Result | Comments | +--------------------------------------+--------+-------------------------------------------------+ | HX User Account check | PASS | Checks if HXUSER is present. | +--------------------------------------+--------+-------------------------------------------------+ | vMotion enabled check | PASS | Checks if vMotion is enabled on the host. | +--------------------------------------+--------+-------------------------------------------------+ | Check for ESXI Failback timer | PASS | Checks for ESXi FAILBACK timer set to 30000ms. | +--------------------------------------+--------+-------------------------------------------------+ | Check vmk1 ping to eth1 | PASS | Checks Network between ESXi vmk1 and SCVM eth1. | +--------------------------------------+--------+-------------------------------------------------+ | No extra controller vm folders check | PASS | Checks for duplicate Controller SCVM Folders. | +--------------------------------------+--------+-------------------------------------------------+ | VMware Tools location check | PASS | Checks for Non default VMware Tools location. | +--------------------------------------+--------+-------------------------------------------------+ | vfat Disk Usage check | PASS | Checks for vfat Disk Usage. | +--------------------------------------+--------+-------------------------------------------------+ | Check /tmp usage | PASS | Checking for /tmp usage. | +--------------------------------------+--------+-------------------------------------------------+ ESX Host: 14.39.53.131 +--------------------------------------+--------+-------------------------------------------------+ | Name | Result | Comments | +--------------------------------------+--------+-------------------------------------------------+ | HX User Account check | PASS | Checks if HXUSER is present. | +--------------------------------------+--------+-------------------------------------------------+ | vMotion enabled check | PASS | Checks if vMotion is enabled on the host. | +--------------------------------------+--------+-------------------------------------------------+ | Check for ESXI Failback timer | PASS | Checks for ESXi FAILBACK timer set to 30000ms. | +--------------------------------------+--------+-------------------------------------------------+ | Check vmk1 ping to eth1 | PASS | Checks Network between ESXi vmk1 and SCVM eth1. | +--------------------------------------+--------+-------------------------------------------------+ | No extra controller vm folders check | PASS | Checks for duplicate Controller SCVM Folders. | +--------------------------------------+--------+-------------------------------------------------+ | VMware Tools location check | PASS | Checks for Non default VMware Tools location. | +--------------------------------------+--------+-------------------------------------------------+ | vfat Disk Usage check | PASS | Checks for vfat Disk Usage. | +--------------------------------------+--------+-------------------------------------------------+ | Check /tmp usage | PASS | Checking for /tmp usage. | +--------------------------------------+--------+-------------------------------------------------+ ESX Host: 14.39.53.132 +--------------------------------------+--------+-------------------------------------------------+ | Name | Result | Comments | +--------------------------------------+--------+-------------------------------------------------+ | HX User Account check | PASS | Checks if HXUSER is present. | +--------------------------------------+--------+-------------------------------------------------+ | vMotion enabled check | PASS | Checks if vMotion is enabled on the host. | +--------------------------------------+--------+-------------------------------------------------+ | Check for ESXI Failback timer | PASS | Checks for ESXi FAILBACK timer set to 30000ms. | +--------------------------------------+--------+-------------------------------------------------+ | Check vmk1 ping to eth1 | PASS | Checks Network between ESXi vmk1 and SCVM eth1. | +--------------------------------------+--------+-------------------------------------------------+ | No extra controller vm folders check | PASS | Checks for duplicate Controller SCVM Folders. | +--------------------------------------+--------+-------------------------------------------------+ | VMware Tools location check | PASS | Checks for Non default VMware Tools location. | +--------------------------------------+--------+-------------------------------------------------+ | vfat Disk Usage check | PASS | Checks for vfat Disk Usage. | +--------------------------------------+--------+-------------------------------------------------+ | Check /tmp usage | PASS | Checking for /tmp usage. | +--------------------------------------+--------+-------------------------------------------------+ Main Report File: HX_Tool_Main_Report_2020-08-26_09-54-59.txt Report tar file: HX_Report_2020_08_26_09_43_18.tar Report file copied to path: /var/log/springpath Release Notes: https://www.cisco.com/c/en/us/support/hyperconverged-systems/hyperflex-hx-data-platform-software/products-release-notes-list.html Upgrade Guides: https://www.cisco.com/c/en/us/support/hyperconverged-systems/hyperflex-hx-data-platform-software/products-installation-guides-list.html Note: 1) If upgrading to HX 4.0(2a), please review the following link and perform workaround – https://tinyurl.com/wc7j5qp 2) Please check the status of Compute nodes manually, script only verifies the config on the converged nodes. 3) Hypercheck doesnot perform FAILOVER TEST, so please ensure that the upstream is configured for network connectivity for JUMBO or NORMAL MTU size as needed.
4) If you have performed any activity on your vcenter(like upgrade, certificate replacement,etc.), it is recommended to reregister your cluster to the vcenter before performing upgrades. Refer to the Hyperflex CLI guide for relevant commands.
تحليل مخرجات الأداة - الخطوات التالية
- تقوم الأداة بأتمتة عملية تشغيل الأوامر اليدوية على أنظمة HyperFlex.
- إذا كانت الأداة تعمل موافق وتعطي تمرير في كل الاختبارات، فإن نظام HX يكون جيد لكل التحققات التي قام البرنامج النصي بتنفيذها.
- في الحالات التي تكون فيها الأداة
FAILSفي بعض التحققات أو التي لا تعمل بنجاح، يمكنك إستخدام أوامر CLI (المدرجة) لتنفيذ نفس التحققات على HyperFlex System كما تم من قبل النص التنفيذي يدويا. - لا تقوم الأداة بالتحقق من وجود أي تحذيرات قديمة/جديدة/مفتوحة/تم حلها، وبالتالي يوصى بشدة بمراجعة
Hyperflex Release Notes and Upgrade Guidesقبل أي نشاط للترقية أو الصيانة.
ملاحظة: لا تفتح حالة مركز المساعدة الفنية بسبب فشل تشغيل البرنامج النصي. قم بتشغيل الأوامر يدويا، والتعرف على المشكلة، وفتح SR للمشكلة المحددة.
أوامر CLI
على HyperFlex SCVM:
SSH to All Hyperflex SCVMs-
# service_status.sh
# sysmtool --ns cluster --cmd enospcinfo
# echo srvr | nc 0 2181
# pidof exhibitor
# stcli disk list --ip <Corresponding ESXi Mgmt IP Address> |grep -B 2 -A 8 blacklisted
# stcli services dns show (and ping the IPs listed)
# ping <vCenter IP Address>
# date ; compare the time on all SCVMs. They should ideally be identical
# stcli services ntp show
# stcli cleaner info
# ntpq -p -4
# dpkg -l | grep -i springpath | grep -v storfs-support*
# sysmtool --ns disk --cmd list | grep -i blacklisted
# iptables -L -n | wc -l
# stcli cluster info
# df -h ; check that /var/stv should be less than 80%
# zgrep -i “out of memory” /var/log/springpath/debug-storfs.*
# ping -I eth0 <eth0> of all SCVMs
# ping -I eth1 <eth1> of all SCVMs
# "ls -ld /tmp" check for 775 and 777
# stcli cluster info | grep -i 'clusterAccessPolicy:' | head -1
# md5sum /etc/springpath/secure/springpath_keystore.jceks
# cat /etc/springpath/sed_capability.conf
# cat /etc/springpath/sed.conf
# cat /var/log/springpath/diskslotmap-v2.txt
# stcli cluster info | grep dataZkIp (ping dataZkIp for latency)
على أنظمة ESXi:
SSH to all ESXi hosts
# esxcli system account list
# esxcli network firewall ruleset list | grep -i vMotion
# esxcli software vib list| egrep -i 'scvm|stHyper|stfs'
# chkconfig --list | grep -E 'ntpd|hostd|vpxa|stHypervisorSvc|scvmclient|hxctlvm'
# esxcfg-vmknic -l ; confirm that vMotion VMK2 is created
# vmkping -I vmk1 <eth1> of all SCVMs
# cd /vmfs/volumes/Springpath-XXXXXXXXXX ; Ensure that it has only one Folder that has the Storage Controller VM
# df -h | grep vfat ; Ensure dir has free space
محفوظات المراجعة
| المراجعة | تاريخ النشر | التعليقات |
|---|---|---|
1.0 |
21-May-2019 |
الإصدار الأولي |
التعليقات