VxRail upgrade stuck at 66% & won’t fail during unpacking composite bundle upload – upgrade hung

Posted by
Machine generated alternative text:
System software for this cluster 
vxRai1 4.5.229-10764994 
Instal led on 6/13/2019 
A hyper-converged infrastructure appliance that combines VMware compute, networking and storage into one single system for ease of 
deployment and management 
Unpacking composite bundle 
Details 
• COMPOSITE_UNPACKcomplete 
Action: Unpacking composite bu ndle 
Installed components 
Learn more 
Message: unzipped the entry bundles/VMware-vCenter-Server-App fam the composite bu ndle package. 
Action: Unpacking composite bu ndle 
Message: unzipped the entry from the composite bundle package. 
Action: uploading bundle: 45xzipwith total size: 4258 Ma. 
Message: uploading bundle: NTXRAlL_COMPOSlTE-4.7.410-26262335 for 4_5xzipwith total size:4258 MB.

Have you ever been upgrading VxRail and the composite bundle upload stalls at 66% during the unpacking composite bundle bootstrap?  It happened to me recently.  Here is a quick fix that has worked for me in the past I wanted to share. However; I cannot stress enough that if you are not experienced enough or do not feel comfortable, please engage DellEMC support.

Steps:
First putty into the VxRail Manager
Log in as mystic and SU to Root
Execute the following commands:
# psql -U postgres mysticmanager -c ” update virtual_appliance set upgrade_status=’HAS_NEWER’ where id=1;”
UPDATE 1

# psql -U postgres mysticmanager -c “delete from composite_upgrade;”
DELETE 0

# psql -U postgres mysticmanager -c ” update virtual_appliance set upgrade_status_response=’ ‘ where id=1;”
UPDATE 1

Machine generated alternative text:
St opped 
da Iprdvxrmgt02 : - 
psql (9.4. 13) 
Type "help" for 
select 
applianceid 
DE300185016252 
DE3001B5016253 
DE3001B5016251 
(3 rows) 
AZ 
L 2 + Stopped 
dalprdvxrrrgtD2 : 
—c 
—c 
—C 
com.vce.commons. 
psq1 
help . 
psql 
postgres mystlcmanager 
" update virtual_appliance set NEWER 
"delete from composite_upgrade; " 
" update virtual _ appliance set ' ' 
where idel;" 
where id—l;" 
-U postgres marvin 
applianceid, ip from vxraiIh03t; 
10.17 .55. 161 
10.17.55.163 
10.17 .55. 162 
psql —U postgres marvin 
reboot 
login as: mystic 
Keyboard—interactive authentication prompts from server : 
Password: 
End of keyboard-interactive prompts from server 
Last login: Wed Feb 19 22:31:36 2020 from .54.131 
mystic@daIprdvxrmgt02 su 
Password: 
dalprdvxrrmgt02 : /home/mystic 
UPDATE 1 
dalprdvxrmgt02 : / home/mystic 
DELETE O 
dalprdvxrmgt02 : / home/mystic 
UPDATE 1 
dalprdvxrrrgt02 : / home/myst ic 
psql 
psql 
tail 
INFO 
—U 
—U 
—U 
postgres mysticmanager 
postgres mysticmanager 
postgres mysticmanager 
/ var/ og/mysti c/ cm. og 
t tomcat—http——30) com.vce.cornmons.core.connection.misc.ConnectionUtiIs ConnectionUtiIs.getSsoUrI:124 
— Trying to obtain sso token from: https://dalprdesx 
vic01. freemanco.com/sts/STSService/ freemanco. vsphere. local 
993+0000 INFO I tomcat—http——30J com.vce.cornrnons.core.services.ops.VCEntityService VCEntityService.findRoIeIdByName:123 
Trying to find role: VMware HCIA Management in 
VC•. dalprdesxvicOI freemanco.com 
INFO (tomcat—http——301 com.vce.commons.core.services.ops.VCEntityService VCEntityService.findR01eIdByName:126 
Retrieved role list from VC. 
.020+0000 INFO L tomcat—http——30J com.vce.cornrm•ns . core. services . ops .VCEntityService VCEntityService.findRoIeIdByName:129 
Found matched role id: 2033411246 
.253+0000 INFO com.vce.cornmons.core.connection.misc.connectionütils ConnectionütiIs.getSsoürI:124 
— Trying to obtain sso token from: https://dalprdes 
xvic01. freemanco.com/sts/STSService/ freemanco. vsphere. local 
. 366+0000 INFO t tomcat—http——50J com.vce.cornrnons.core.repositories.RuntimePropertiesRepositoryImpI RuntimePropertiesRepositoryImpI.setProperty: 139 
Setting property da 
ta. managementpassword to encrypted password. 
INFO t tomcat—http——501 com.vce.common3.core.rep03itorie3.RuntimePropertie3Rep03itoryImp1 RuntimePropertie3Rep03itoryImp1.write:190 — Writing properties file: 
/var/ I ib/vmware—marvi n/ runt ime . propert i es 
. 915+0000 INFO tmyschedu1er-6) 
2020-02-19T23:24 . 916+0000 INFO tmyschedu1er-61 
e vxrailmgmt@freemanco.vsphere.local 
INFO tmyschedu1er-6) 
co 1 . freemanco.com/3t3/STS5erwice/freemanco.vsphere.local 
INFO tmyscheduler-l) 
INFO tmyscheduler-l) 
e vxrailmgrntgtreemanco. vsphere. local 
com.vce.commons.core. 
com.vce.cornrnons.core. 
com.vce . commons . core 
com.vce.cornmons.core. 
core. 
services. ConnectionHeIper ConnectionHeIper. refreshConnection:34 — VC connection timed out, reconnecting. 
services. ConnectionHe1per ConnectionHe1per. refreshConnection:36 
Connecting to dalprdesxvic01. freemanco.com usernam 
connection. misc. ConnectionUtiIs ConnectionUtiIs. getSsoUrI:124 
— Trying to obtain sso token from: https://dalprdesxvi 
. services . ConnectionHeIper ConnectionHeIper . : 34 
services. ConnectionHeIper ConnectionHeIper. refreshConnection : 36 
— VC connection timed out, reconnecting . 
— Connecting to dalprdesxvicOI . freemanco.com usernam

Summary:
As you can see it is a quick and easy process.  However, I cannot stress enough to engage DellEMC support if you are not comfortable with this fix.  Once again, I hope y’all find this article useful.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s