Pivotal Knowledge Base

Follow

DCA ISO upgrade fails with "Brocade driver not on expected versions to run this workflow" error.

Problem

DCA ISO upgrade fails with 'Brocade driver not on expected versions to run this workflow' error.

20120312:18:04:35:dca_upgrade_master:mdw:root-[INFO]:-remote command (smdw): . /usr/local/greenplum-db/./greenplum_path.sh; /opt/greenplum/duf/bin/dca_upgrade_prereq_tester --workflow WorkFlow_Smdw_1_0_2_1_to_1_0_3_0 --fliplinks
20120312:18:04:42:dca_upgrade_master:mdw:root-[ERROR]:-smdw: Traceback (most recent call last):
20120312:18:04:42:dca_upgrade_master:mdw:root-[ERROR]:-smdw: File "/opt/greenplum/duf/bin/dca_upgrade_prereq_tester", line 192, in <
module>
20120312:18:04:42:dca_upgrade_master:mdw:root-[ERROR]:-smdw: checkWorkflowState()
20120312:18:04:42:dca_upgrade_master:mdw:root-[ERROR]:-smdw: File "/opt/greenplum/duf/bin/dca_upgrade_prereq_tester", line 104, in c
heckWorkflowState
20120312:18:04:42:dca_upgrade_master:mdw:root-[ERROR]:-smdw: raise Exception(e.__str__())
20120312:18:04:42:dca_upgrade_master:mdw:root-[ERROR]:-smdw: Exception: Pre-requisite test for Workflow action 16 of 60 failed: Brocade driver not on expected versions to run this workflow
20120312:18:04:42:dca_upgrade_master:mdw:root-[ERROR]:-error running command . /usr/local/greenplum-db/./greenplum_path.sh; /opt/greenplum/duf/bin/dca_upgrade_prereq_tester --workflow WorkFlow_Smdw_1_0_2_1_to_1_0_3_0 --fliplinks on host smdw
20120312:18:04:42:dca_upgrade_master:mdw:root-[ERROR]:-error running remote command: . /usr/local/greenplum-db/./greenplum_path.sh;
/opt/greenplum/duf/bin/dca_upgrade_prereq_tester --workflow WorkFlow_Smdw_1_0_2_1_to_1_0_3_0 --fliplinks
20120312:18:04:42:dca_upgrade_master:mdw:root-[ERROR]:-Error running pre-requisite testing before running workflow
20120312:18:04:42:dca_upgrade_master:mdw:root-[CRITICAL]:-early exit from dca_upgrade_master

Cause

The Brocade driver is not the one expected for this upgrade.

The sample error message, for example, indicates an upgrade from DCA ISO 1.0.2.1 to 1.0.3.0.

The expected Brocade driver version before upgrading is 2.2.0.3 and the target version after upgrading is 2.2.0.4.

However, current Brocade driver version is 2.2.0.0. This can be confirmed by running modinfo bna and modinfo bfa.

[root@mdw gpadmin]# modinfo bna
filename:       /lib/modules/2.6.18-194.26.1.el5/weak-updates/bna-rhel5u5/bna.ko
version:        2.2.0.0
description:    Brocade 10G PCIe Ethernet driver
license:        GPL
author:         Brocade
srcversion:     75DB26EFF1DF695D48E35E9
alias:          pci:v00001657d00000014sv*sd*bc02sc00i*
depends:       
vermagic:       2.6.18-194.el5 SMP mod_unload gcc-4.1
parm:           bnad_msix:Enable MSI-X (uint)
parm:           bnad_small_large_rxbufs:Enable small/large buffer receive (uint)
parm:           bnad_rxqsets_used:Number of RxQ sets to be used (uint)
parm:           bnad_ipid_mode:0 - Use IP ID 0x0000 - 0x7FFF for LSO; 1 - Use full range of IP ID for LSO (uint)
parm:           bnad_txq_depth:Maximum number of entries per TxQ (uint)
parm:           bnad_rxq_depth:Maximum number of entries per RxQ (uint)
parm:           bnad_vlan_strip:Let the hardware strip off VLAN header (uint)
parm:           bnad_log_level:Log level (uint)
parm:           bnad_ioc_auto_recover:Enable auto recovery (uint)
parm:           bnad_lro:Enable LRO (uint)


[root@mdw gpadmin]# modinfo bfa
filename:       /lib/modules/2.6.18-194.26.1.el5/weak-updates/bfa-rhel5u5/bfa.ko
version:        2.2.0.0
author:         Brocade Communications Systems, Inc.
description:    Brocade Fibre Channel HBA Driver fcpim
license:        GPL
srcversion:     B6F793DE1FCF45057D44697
alias:          pci:v00001657d00000021sv*sd*bc0Csc04i00*
alias:          pci:v00001657d00000014sv*sd*bc0Csc04i00*
alias:          pci:v00001657d00000017sv*sd*bc*sc*i*
alias:          pci:v00001657d00000013sv*sd*bc*sc*i*
depends:        scsi_mod,scsi_transport_fc
vermagic:       2.6.18-194.el5 SMP mod_unload gcc-4.1
parm:           os_name:OS name of the hba host machine (charp)
parm:           os_patch:OS patch level of the hba host machine (charp)
parm:           host_name:Hostname of the hba host machine (charp)
parm:           num_rports:Max number of rports supported per port (physical/logical), default=1024 (int)
parm:           num_ios:Max number of ioim requests, default=2000 (int)
parm:           num_tms:Max number of task im requests, default=128 (int)
parm:           num_fcxps:Max number of fcxp requests, default=64 (int)
parm:           num_ufbufs:Max number of unsolicited frame buffers, default=64 (int)
parm:           reqq_size:Max number of request queue elements, default=256 (int)
parm:           rspq_size:Max number of response queue elements, default=64 (int)
parm:           num_sgpgs:Number of scatter/gather pages, default=2048 (int)
parm:           rport_del_timeout:Rport delete timeout, default=90 secs, Range[>0] (int)
parm:           bfa_lun_queue_depth:Lun queue depth, default=32, Range[>0] (int)
parm:           bfa_io_max_sge:Max io scatter/gather elements , default=255 (int)
parm:           log_level:Driver log level, default=3, Range[Critical:1"Error:2"Warning:3"Info:4] (int)
parm:           ioc_auto_recover:IOC auto recovery, default=1, Range[off:0"on:1] (int)
parm:           ipfc_enable:Enable IPoFC, default=0, Range[off:0"on:1] (int)
parm:           ipfc_mtu:MTU value of IPoFC interfaces, default=2024, Range[2024-65280] (int)
parm:           linkup_delay:Link up delay, default=30 secs for boot port. Otherwise 10 secs in RHEL4 & 0 for [RHEL5, SLES10, ESX40] Range[>0] (int)
parm:           msix_disable_cb:Disable Message Signaled Interrupts for Brocade-415/425/815/825 cards, default=0, Range[false:0"true:1] (int)
parm:           msix_disable_ct:Disable Message Signaled Interrupts if possible for Brocade-1010/1020/804 cards, default=0, Range[false:0"true:1] (int)
parm:           fdmi_enable:Enables fdmi registration, default=1, Range[false:0"true:1] (int)
parm:           pcie_max_read_reqsz:PCIe max read request size, default=0 (use system setting), Range[128"256"512"1024"2048"4096] (int)

Solution

Follow these steps:

  • Find the Brocade driver 2.2.0.4 in the /opt/greenplum/duf/bin/content directory.
[root@mdw-ext1 content]# ls -altr"grep brocade
-r--r--r-- 1 gpadmin gpadmin 64578002 Mar  7  2011 brocade_driver_linux_rhel5_2.2.0.3.tar.gz
-r--r--r-- 1 gpadmin gpadmin 64579391 Mar  7  2011 brocade_driver_linux_rhel5_2.2.0.4.tar.gz
[root@mdw-ext1 content]# pwd
/opt/greenplum/duf/bin/content
  • Uncompress brocade_driver_linux_rhel5_2.2.0.4.tar.gz on all affected servers.
  • Install Brocade driver 2.2.0.4 RPM using brocade_install_rhel.sh in the uncompressed directory.
[root@smdw]# ./brocade_install_rhel.sh
Installing the Brocade driver 2.2.0.4 RPM's
Found Previously Installed Brocade RPM's:
kmod-bfa-rhel5u5-2.2.0.0-0
bfa_util_linux-2.2.0.0-0
kmod-bna-rhel5u5-2.2.0.0-0
Remove old and continue fresh driver installation? (y/n) >
y
Unloading bfa driver ...done
Unloading bna driver ...done
Uninstalling the installed Brocade RPM's
Removing bfa_util_linux-2.2.0.0-0 RPM
Uninstall CLIs ... done
Uninstall HBAAPI Library ... done
Stopping and Uninstalling the HBAAGENT ... done
Removing kmod-bfa-rhel5u5-2.2.0.0-0 RPM
Removing kmod-bna-rhel5u5-2.2.0.0-0 RPM
Installing the BNA driver RPM: kmod-bna-rhel5u5-2.2.0.4-0.x86_64.rpm
Preparing...                ########################################### [100%]
   1:kmod-bna-rhel5u5       ########################################### [100%]
WARNING: Can't read module /lib/modules/2.6.18-194.11.1.el5/weak-updates/bfa-rhel5u5/bfa.ko: No such file or directory
WARNING: Can't read module /lib/modules/2.6.18-194.26.1.el5/weak-updates/bfa-rhel5u5/bfa.ko: No such file or directory
WARNING: Can't read module /lib/modules/2.6.18-194.11.1.el5/weak-updates/bfa-rhel5u5/bfa.ko: No such file or directory
unable to stat -f: No such file or directory
WARNING: No module bfa found for kernel 2.6.18-194.26.1.el5, continuing anyway
WARNING: Can't read module /lib/modules/2.6.18-194.26.1.el5/weak-updates/bfa-rhel5u5/bfa.ko: No such file or directory
WARNING: No module bfa found for kernel 2.6.18-194.el5, continuing anyway
Installing the BFA driver RPM: kmod-bfa-rhel5u5-2.2.0.4-0.x86_64.rpm
Preparing...                ########################################### [100%]
   1:kmod-bfa-rhel5u5       ########################################### [100%]
Installing the util driver RPM
Preparing...                ########################################### [100%]
   1:bfa_util_linux         ########################################### [100%]
Install cli ... done
Install HBAAPI library ... done
Install HBAAGENT ... done
Loading bna driver ... done
Loading bfa driver ... done
Saving current initrd to /boot/initrd-2.6.18-194.26.1.el5.img.bak
initrd update .... done
  • Verify the Brocade driver version is 2.2.0.4 using "modinfo bna" and "modinfo bfa."
[root@smdw ]# modinfo bna
filename:       /lib/modules/2.6.18-194.26.1.el5/weak-updates/bna-rhel5u5/bna.ko
version:        2.2.0.4
description:    Brocade 10G PCIe Ethernet driver
license:        GPL
author:         Brocade
srcversion:     8656A874CD4E8B33DA78493
alias:          pci:v00001657d00000014sv*sd*bc02sc00i*
depends:       
vermagic:       2.6.18-194.el5 SMP mod_unload gcc-4.1
parm:           bnad_msix:Enable MSI-X (uint)
parm:           bnad_small_large_rxbufs:Enable small/large buffer receive (uint)
parm:           bnad_rxqsets_used:Number of RxQ sets to be used (uint)
parm:           bnad_ipid_mode:0 - Use IP ID 0x0000 - 0x7FFF for LSO; 1 - Use full range of IP ID for LSO (uint)
parm:           bnad_txq_depth:Maximum number of entries per TxQ (uint)
parm:           bnad_rxq_depth:Maximum number of entries per RxQ (uint)
parm:           bnad_vlan_strip:Let the hardware strip off VLAN header (uint)
parm:           bnad_log_level:Log level (uint)
parm:           bnad_ioc_auto_recover:Enable auto recovery (uint)
parm:           bnad_lro:Enable LRO (uint)

[root@smdw ]# modinfo bfa
filename:       /lib/modules/2.6.18-194.26.1.el5/weak-updates/bfa-rhel5u5/bfa.ko
version:        2.2.0.4
author:         Brocade Communications Systems, Inc.
description:    Brocade Fibre Channel HBA Driver fcpim
license:        GPL
srcversion:     550E124A6F3135061570389
alias:          pci:v00001657d00000021sv*sd*bc0Csc04i00*
alias:          pci:v00001657d00000014sv*sd*bc0Csc04i00*
alias:          pci:v00001657d00000017sv*sd*bc*sc*i*
alias:          pci:v00001657d00000013sv*sd*bc*sc*i*
depends:        scsi_mod,scsi_transport_fc
vermagic:       2.6.18-194.el5 SMP mod_unload gcc-4.1
parm:           os_name:OS name of the hba host machine (charp)
parm:           os_patch:OS patch level of the hba host machine (charp)
parm:           host_name:Hostname of the hba host machine (charp)
parm:           num_rports:Max number of rports supported per port (physical/logical), default=1024 (int)
parm:           num_ios:Max number of ioim requests, default=2000 (int)
parm:           num_tms:Max number of task im requests, default=128 (int)
parm:           num_fcxps:Max number of fcxp requests, default=64 (int)
parm:           num_ufbufs:Max number of unsolicited frame buffers, default=64 (int)
parm:           reqq_size:Max number of request queue elements, default=256 (int)
parm:           rspq_size:Max number of response queue elements, default=64 (int)
parm:           num_sgpgs:Number of scatter/gather pages, default=2048 (int)
parm:           rport_del_timeout:Rport delete timeout, default=90 secs, Range[>0] (int)
parm:           bfa_lun_queue_depth:Lun queue depth, default=32, Range[>0] (int)
parm:           bfa_io_max_sge:Max io scatter/gather elements , default=255 (int)
parm:           log_level:Driver log level, default=3, Range[Critical:1"Error:2"Warning:3"Info:4] (int)
parm:           ioc_auto_recover:IOC auto recovery, default=1, Range[off:0"on:1] (int)
parm:           ipfc_enable:Enable IPoFC, default=0, Range[off:0"on:1] (int)
parm:           ipfc_mtu:MTU value of IPoFC interfaces, default=2024, Range[2024-65280] (int)
parm:           linkup_delay:Link up delay, default=30 secs for boot port. Otherwise 10 secs in RHEL4 & 0 for [RHEL5, SLES10, ESX40] Range[>0] (int)
parm:           msix_disable_cb:Disable Message Signaled Interrupts for Brocade-415/425/815/825 cards, default=0, Range[false:0"true:1] (int)
parm:           msix_disable_ct:Disable Message Signaled Interrupts if possible for Brocade-1010/1020/804 cards, default=0, Range[false:0"true:1] (int)
parm:           fdmi_enable:Enables fdmi registration, default=1, Range[false:0"true:1] (int)
parm:           pcie_max_read_reqsz:PCIe max read request size, default=0 (use system setting), Range[128"256"512"1024"2048"4096] (int)

Comments

Powered by Zendesk