This README file contains the latest information about installing IBM TotalStorage™ DS4000 Storage Manager version 9.1 for VMware ESX Server 2.1 and ESX Server 2.5 when it is available from VMWare, Inc. Note: VMware ESX Server 2.0 is supported by the DS4000 Storage Manager version 8.x only. Refer to the IBM TotalStorage™ Support Web Site or CD for the installation and support guide. For other related publications refer to Related Publications in the installation and support guide. Last Update: 11/19/2004 Products Supported: ---------------------------------------------------------------- | New Model | Old Model | Machine Type | Model | |------------|-----------|--------------|------------------------| | DS4500 | FAStT 900 | 1742 | 90X, 90U | |------------|-----------|--------------|------------------------| | DS4400 | FAStT 700 | 1742 | 1RX, 1RU | |------------|-----------|--------------|------------------------| | DS4300 | FAStT 600 | 1722 | 6LX, 6LU, 60X and 60U | |------------|-----------|--------------|------------------------| | DS4100 | FAStT 100 | 1724 | 100, 1SC | ----------- ---------------------------------------------------- IBM TotalStorage DS4000 Manager version 9.1 for VMware does not support the FAStT500 and FAStT200 machine types 3552 and 2542) with ESX Server 2.1 or ESX Server 2.5. Please refer to the latest storage interoperability matrix and ServerProven matrix at the following web sites: http://www-1.ibm.com/servers/storage/disk/ds4000/interop-matrix.html http://www.pc.ibm.com/us/compat/nos/matrix.shtml CONTENTS -------- 1.0 Change History 2.0 Limitations 3.0 Enhancements 4.0 Helpful Configuration Information 5.0 Web Sites and Support Phone Number 6.0 Trademarks and Notices 7.0 Disclaimer ======================================================================= 1.0 Change History - 11/24/2004 Support for DS4000 Storage Manager 9.1 with DS4000 controller firmware version 06.10.11.xx - 08/20/2004 Support for DS4000 Storage Manager 9.1 with DS4000 controller firmware version 06.10.06.xx - 06/18/2004 Support for the DS4100 Storage Server - 08/27/2003 This is the first support release of the IBM TotalStorage™ DS4000 Storage Manager version 8.4 in VMware ESX Server 2.0. ======================================================================= 1.5 Dependencies -------------------------- ATTENTION: 1. DS4000 STORAGE SERVER CONTROLLER FIRMWARE VERSION 06.10.XX.XX REQUIRES THAT THE FIRMWARE VERSION OF AN ATTACHED EXP100 ENVIRONMENTAL SERVICE MODULE (ESM) BE AT VERSION 955X OR HIGHER. IT IS NOT POSSIBLE TO UPGRADE EXP100 ESM FIRMWARE VERSIONS THROUGH 953X TO VERSION 955X. TO DETERMINE THE FIRMWARE LEVEL OF AN EXP100 ESM, IDENTIFY THE PRODUCT LABEL LOCATED AT THE REAR OF THE EXP100 ENCLOSURE. ONLY LABELS ON WHICH THE FIELD REPLACEABLE UNIT (FRU) PART NUMBER READS 25R0156 POSITIVELY INDICATE THAT AN ESM MODULE IS RUNNING FIRMWARE VERSION 955X OR HIGHER. IF THERE IS NO LABEL OR THE PART NUMBER ON THE LABEL DOES NOT READ 25R0156, THE ESM MAY STILL HAVE THE FIRMWARE VERSION 955X OR HIGHER IF IT HAD BEEN PREVIOUSLY UPGRADED. IF NECESSARY, CONTACT YOUR IBM REPRESENTATIVE, SUPPORT, OR RESELLER FOR ASSISTANCE. 2. DS4000 STORAGE SERVER CONTROLLER FIRMWARE VERSION 06.10.XX.XX REQUIRES THAT THE FIRMWARE VERSION OF AN ATTACHED EXP700 ENVIRONMENTAL SERVICE MODULE (ESM) BE AT VERSION 9326 OR HIGHER. IF THE EXP700 ESM FIRMWARE IS EARLIER THAN THE 9326 VERSIONS, THE EXP700 ENCLOSURE AND THE INSTALLED DRIVES MAY NOT BE DISPLAYED IN THE DS4000 SUBSYSTEM MANAGEMENT WINDOW AFTER THE CONTROLLER FIRMWARE IS UPGRADED. 3. CURRENTLY, THE ONLY DS4000 STORAGE SERVERS THAT ARE SUPPORTED BY THE 06.1X.XX.XX CONTROLLER FIRMWARE VERSION ARE THE DS4300 WITH TURBO OPTION, THE DS4400 AND THE DS4500. DO NOT DOWNLOAD THIS CONTROLLER FIRMWARE ON ANY OTHER DS4000 STORAGE SERVER. THERE IS NOT ANY CHECKING FOR THIS RESTRICTION INSIDE THE STORAGE MANAGER CLIENT PROGRAM. 4. IN-BAND MANAGEMENT IS NOT SUPPORTED WITH VMWARE ESX SERVER 2.1 or 2.5. THE STORAGE MANAGER 9.1 CLIENT PROGRAM MUST BE INSTALLED IN OUT-OF-BAND MANAGEMENT CONFIGURATIONS, PREFERABLY ON THE SAME SYSTEM THAT IS USED TO MANAGE THE ESX SERVER 2.1. THE DS4000 STORAGE MANAGER 9.1 CLIENT PROGRAMS FOR THE FOLLOWING OPERATING SYSTEMS - MICROSOFT WINDOWS 2000 AND WINDOWS SERVER 2003 AND LINUX THAT ARE INCLUDED IN THE CD. PLEASE REFER TO THE FOLLOWING DIRECTORIES IN THE CD FOR THE DS4000 STORAGE MANAGER 9.1 CLIENT PROGRAM THAT IS APPROPRIATE FOR THE OPERATING SYSTEM IN THE COMPUTER THAT IS USED TO MANAGE THE DS4000 STORAGE SERVER - WIN32 (WINDOWS 2000), WS03_32BIT AND WS03_64BIT (WINDOWS SERVER 2003 IA32 AND IA64, RESPECTIVELY) AND LINUX (REDHAT AND SUSE SLES 8.) IBM DS4000 Storage Manager version 09.1x.xx.xx provides full management support for IBM machine types 1722 (DS4000 600 Turbo), 1742 (DS4000 700), and 1742-900 (DS4000 900) storage controllers that have at least firmware version 06.10.02.xx. In addition, DS4000 Storage Manager version 09.10.xx.xx provides management capabilities to IBM Machine type 1722 (DS4000 600) and 1724 (DS4000 100) storage controllers that have at least firmware version 05.34.xx.xx and 05.42.xx.xx, respectively. ======================================================================= Limitations --------------- 1. In-band management is not supported with VMware ESX Server 2.1 and 2.5. The Storage Manager 9.1 client program must be installed in out-of-band management configurations, preferably on the same system that is used to manage the ESX Server. 2. An ESX Server 2.1 or 2.5 configuration is currently supported with up to 16 virtual guest operating systems maximum. You should consult the VMware web site for specifics on guest operating system support and configurations. 3. LUN sharing across multiple ESX servers is only supported when configuring Microsoft Cluster nodes. LUNS can be mapped to a Host Group for the ESX servers and will be available to all members of the Host Group. For additional information on Windows Clustering with ESX Server, please reference the ESX 2.1 Installation guide at http://www.vmware.com/support/esx21/doc/index.html 4. Dynamic Volume Expansion is not supported for VMFS formatted LUNS. 5. Booting the ESX Server from DS4000 storage server logical drive (aka. Root-boot or SAN-boot) is not supported. 6. ESX Server 2.1 does not have the capability of running IBM DS4000 Management Suite Java (FAStT-MSJ) for Fibre Channel path diagnostics. 7. When using two HBAs in one VMware server, LUN numbers must be the same for each HBA attached to DS4000 Storage Server. 8. Please contact IBM Support, IBM resellers and IBM Representatives for the availability of DS4000 Copy Service features support for DS4000 Storage Server having LUNs mapped to an ESX 2.1 server. 9. The IBM DS4000 Storage Server hardware and software is designed to have redundant paths from the host system to ensure the availability of storage. However, it is possible to connect a single host adapter from the host system to one of the controller minihubs and then connect this minihub to the minihub of the other controller. This configuration will create a FC-AL loop between the host adapter and the two IBM DS4000 Storage Server controllers and no redundant path to the host system. When you connect the two minihubs together, always connect the "IN" port of one minihub to the "OUT" port of the other minihub or vice versa. Do not connect the "IN" port of one to the "IN" port of the other minihub or the "OUT" port of one minihub to the "OUT" port of the other minihub. 10. Dynamically changing the cache read ahead multiplier setting via the storage manager client may result in an error message indicating the operation has failed. Despite the error message, the request to change the cache read ahead multiplier will remain queued to the controllers and will eventually complete when I/O activity to the storage subsystem has subsided. In order to avoid the error message and any delays in the cache read ahead multiplier value changing, it is recommended to change the cache read ahead multiplier when the subsystem is in a quiesced state. 11. This following behavior applies for the direct Fibre Channel connection setup between the DS4300 storage server host ports and the server HBA ports only. If all DS4300 host ports are occupied, the DS4300 event log may show "host-side data rate negotiation failed" error when the server is booted up, this is normal error that were generated during the host rate negotiation routine inside the DS4300 storage server. 12. If the EXP100 ESM firmware version is 953x or earlier, no IOs are allowed during the duration that the EXP100 ESMs are being updated with new firmware, including clustering reservation checking IOs. 13. The DS4000 storage server when configured with the DS4000 EXP100 SATA Drive Expansion Unit is currently reporting a higher frequency of informational events such as Destination Driver Events (DDEs) and Fibre Channel link up/down events ... in the DS4000 Controller event log compared to the DS4000 storage server configured with Fibre Channel drives. Slower response times of SATA disk drives compared to Fibre Channel disk drives cause higher I/O retries from the DS4000 storage server controllers, resulting in a greater number of informational events logged. In addition, the number of information events reported in the DS4000 storage server event log will also grow in proportion to the increase in I/Os to the Logical Drives. In all cases, the DS4000 storage server controller will always successfully service the timeout I/O on the subsequent retries. 14. Single controller DS4000 storage server models are not support at this time. Please contact your IBM representatives or resellers for availability of such supports in the future. 15. When saving the DS4000 storage server Major Event Log entries, it may take up to several minutes to save all entries in the event log depending on the DS4000 management workstation resources. However, the DS4000 Storage Manager client GUI will show the completion of the event log saving almost instantly. The work around is to check the file size of the file that the event log entries are saved periodically; if the file size does not change, the event log saving is completed. 16. Do not perform other storage management tasks, such as creating or deleting logical drives, reconstructing arrays, and so on, while downloading the DS4000 storage server controller firmware, NVSRAM or ESM or drive firmware. It is recommended that you close all storage management sessions (other than the session that you use to upgrade the firmware) to the DS4000 storage server that you plan to update. 17. Enclosure IDs may be listed incorrectly in the Subsystem Management window, even if the Enclosure ID switch settings appear to be correct. This is because of the physical design and movement of the Enclosure ID switch, it is possible to leave the switch in a “dead zone” between ID numbers, which will return an incorrect Enclosure ID (this value is 0 in most cases) to the storage management software. When setting the Enclosure ID, ensure that the switch has actuated completely and has settled where the value is clearly visible in the viewing window. 18. The intermixing of DS4000 EXP100 (SATA) and EXP 700 (FC) drive expansion enclosures in the same DS4000 storage server is not supported. In addition, the DS4000 100 (machine type 1724) can not be connected to EXP700 (FC) drive expansion enclosure. New limitations with version 9.10.xx.02 release 19. The DS4000 Copy Service RVM is not supported at this time for DS4300 and DS4100 Base and Single Controller storage servers models. 20. In the Storage Manager version 9 client Subsystem Management window, the preferred owner of a defined logical drive can not be changed if the logical drive is managed by the preferred owner/controller. There is no work-around. If the drive is currently managed by a non- preferred owner/controller, one can change the currently managed non-preferred owner/controller into currently managed preferred owner/controller. 21. Concurrent firmware download (downloading firmware/NVSRAM to the DS4000 storage server controllers with IOs to the host servers) is not supported when upgrading the controller firmware from a 05.xx.xx.xx version to a 06.10.xx.xx version. ALL IOs must be stopped during the version 06.10.xx.xx controller firmware upgrade from a pre- 06.10.xx.xx version. 22. Do not pull or inserting drives during the drive firmware download. In addition, ALL IOs must also be stopped during the drive firmware download. Otherwise, drives may be shown as missing, unavailable or failed. 23. When instructing to remove and reinsert or to replace a hard drive, wait at least 70 seconds before inserting either the removed existing drive or the new drive into the drive slot. Similarly, wait at least 70 seconds before reinserting either the removed existing ESM module or the new ESM module into the empty ESM slot in the EXP drive expansion enclosure. There is no work-around. 24. Staged firmware and NVSRAM download function is not available on the DS4000 700 (machine type 1742) models with firmware 06.1x.00.00 in conjunction with IBM Storage Manager 09.1x.xx.xx." 25. Auto LUN/Array Transfer is not supported. If a controller fails over arrays to the alternate controller and the failed controller is replaced and brought back online, the arrays do not automatically transfer to the preferred controller. This must be done manually by redistributing arrays. 26. When using VMFS volumes with virtual disk (.vmdk/.dsk) files, the Flashcopy and the VolumeCopy logical drives can only be read on a different ESX server than the ESX server which has the source logical drives that the Flashcopy or the Volumecopy logical drives are made from. If using the System/LUN (Raw) disk configuration the Flashcopy and the VolumeCopy logical drives can be used on the same ESX server which has the source logical drives. New limitations with Storage Manager version 9.10.xx.05 and DS4000 controller firmware version 06.10.11.xx release 27. Do not update the DS4000 storage server controller firmware to version 06.1x.xx.xx from versions 05.4x.xx.xx or earlier if the exp700 esm firmware of the attached exp700 was not at 9326. If the EXP700 ESM firmware is earlier than the 9326 versions, the EXP700 enclosure and the installed drives may not be displayed in the DS4000 subsystem management window after the controller firmware is upgraded to 06.1x.xx.xx version. The workaround is to update the EXP700 ESM firmware to the 9326 version first before upgrading the controller firmware to version 06.1x.xx.xx. (260160 - pr 82841) 28. When connecting the EXP100 enclosures, one must set the single digit (X1) of the enclosure ID to unique values. This is to prevent the possiblity that the controller blade has the same ALPA as one of the drives in the EXP100 enclosures under certain DS4000 controller reboot scenarios. (261188) ======================================================================= 3.0 Enhancements ------------------------------ IMPORTANT: New features that are introduced with the DS4000 Storage Manager version 9.1 host software will not be available for any DS4000 storage server controllers without the controller firmware version 06.10.xx.xx installed. The DS4000 storage server controller firmware version 6.10.xx.xx is available for the following DS4000 storage server only - DS4000 600 Turbo option, DS4000 700 and DS4000 900. Please contact your IBM service representative or IBM resellers for availability of additional DS4000 storage server models support with controller firmware version 6.10.xx in the future. A summary list of the new features that are introduced with the DS4000 Storage Manager version 9.1 host software for Microsoft Windows 2000 and Server 2003 operating systems in conjunction with the DS4000 storage server controller firmware version 06.10.xx.xx is as followed: - Enhance Remote Mirroring support. Besides Metro Mirroring, IBM DS4000 Storage Manager version 9.1 also supports Global Copy and Global Mirroring Remote Mirror options. Please refer the IBM DS4000 Storage Manager Version 9 Copy Services User's Guide for more information. - Parallel hard drive firmware download support. Up to four different drive firmware packages can be downloaded to multiple drives of four different drive types simultaneously. Note: Drive firmware download is an offline management event. You must schedule downtime for the download because no IOs to the storage server are allowed during the drive firmware download process. - Staged controller firmware download support. The controller firmware and NVSRAM can be downloaded to the DS4300 Turbo and DS4500 storage server Flash area for later activation. Note: DS4400 storage server does not support this functionality. - Full command-line SMcli support. - Support for both FC and SATA hard-drive technology EXP enclosures - Improve DS4000 Storage manager client Subsystem Management GUI interface - Serviceability enhancements: This includes one-click collection of support data, drive diagnostic data, drive channel state management, controller ‘service mode’, reporting of none functional controller and ability to save host topology information. - Improve media error handling for better reporting of unreadable sectors in the DS4000 Storage server event log and persistent reporting of unreadable sectors. - Support for the DS4000 EXP710 drive expansion enclosure (10/15/2004). - Support for the DS4000 FC/SATA storage expansion enclosure intermix option (11/24/2004) - Support for the attachement of EXP100 SATA storage expansion enclosures to the DS4400 storage server (11/24/2004) - Support for the increase in the maximum number of EXP100 drive expansion enclosures that can be connected to a DS4100 storage server. The maximum EXP100 drive enclosure that can be connected to DS4100 is now 7 instead of 4 (11/24/2004) - DS4000 Flashcopy and VolumeCopy copy services are supported with ESX 2.1 and 2.5. Please refer to the New Features section of the IBM DS4000 Storage Manager version 9 Installation and Support Guide for Windows 2000/Server 2003, Netware, ESX Server, and Linux for additional information about the the IBM DS4000 Storage Manager version 9 enhancements. ======================================================================= 3.0 Helpful Configuration Tips ------------------------------ 1. ESX 2.1 server customers we recommend the use of "LNXCL" as the host type to disable AVT. This reduces path thrashing behavior in the VM kernel during failover. In certain conditions this change can cause the vmkernel to hang on boot up due to a known issue with LUN discovery in ESX Server. Prior to implementing this change, please reference the IBM RedBook: "Implementing VMware ESX Server 2.1 with IBM TotalStorage DS4000 ", available from the IBM support web-site. The LUN discovery issue is to be corrected with the ESX Server 2.5 release. 2. MRU (Most Recently Used) is the supported failover policy when AVT is disabled. Preferred Path can be configured using the DS4000 Storage Manager client and then using the Rescan SAN option within the Storage Management MUI. 3. LUNS should be assigned to the ESX Server starting with LUN number 0. 4. The Access LUN should not be mapped to the ESX server host. 5. The VMware ESX Server 2.1 FC HBA driver includes failover support. You will need to have two HBAs in the server to enable failover. Using a single HBA is supported; but, you will not have path failover support. VMware ESX Server 2.1 does not have the capability to utilize DS4000 MSJ program for multi-path I/O configuration. Instead, use the VMware ESX server 2.1 instructions in the ESX Server 2.x Administration Guide to set up IO path fail-over support and to redistribute the LUNs between the FC HBAs. 6. Always use the VMware ESX Server driver for the FC HBA. Please refer to VMware documentation on how to install and configure these FC HBA drivers. 7. Unique partition labels should be used if multiple targets (multiple DS4000 ) are installed to insure proper labeling of logical volumes when the server is rebooted. 8. With ESX Server 2.1 it is no longer necessary to reboot when creating or deleting LUNS. Use the Rescan SAN function within the Storage Management MUI to automatically recognize changes on the Storage Subsystem. 9. The ESX Server advanced option: "Disk.RetryUnitAttention" must be set to "1" for use with DS4000 Storage. 10. Please refer to the ESX Server 2.1 Administrator guides and README for more info on how to setup storage in a SAN environment. 11. The DS4000 controller host ports or the Fibre Channel HBA ports can not be connected to a Cisco FC switch ports with "trunking" enable. You might encounter failover and failback problems if you do not change the Cisco FC switch port to "non-trunking" using the following procedure: a. Launch the Cicso FC switch Device Manager GUI. b. Select one or more ports by a single click. c. Right click the port(s) and select Configure, a new window pops up d. Select the "Trunk Config" tab from this window, a new window opens e. In this window under Admin, select the "non-trunk" radio button, it is set to auto by default. f. Refresh the entire fabric. 12. When making serial connections to the DS4000 storage controller, the baud rate is recommended to be set at either 38200 or 57600. Note: Do not make any connections to the DS4000 storage server serial ports unless it is instructed by IBM Support. Incorrect use of the serial port might result in lost of configuration, and possibly, data. 13. Fabric topology zoning requirement. To avoid possible problem at the host level, it is best practice that all Fibre Channel (FC) Switches must be zoned such that a single FC host bus adapter can only access one controller per storage array. In addition, this zoning requirement also ensures the maximum number of host connections can be seen and log into the controller FC host port. This is because if a FC HBA port is seen by both controller A and B host ports, it will be counted as two host connections to the storage subsystem - one for controller A port and one for controller B port. Note: The DS4000 Storage Subsystem DS4000 900, DS4000 700 and DS4000 500 (IBM machine type 1742 and 3552) have two ports per controller - one per minihub slot. The DS4000 Storage DS4000 600 (IBM machine type 1722) has two ports per controller. The DS4000 storage Subsystem DS4000 200 (IBM machine type 3542) has only one port per controller. 4.0 WEB Sites and Support Phone Number -------------------------------------- 4.1 IBM TotalStorage™ Disk Storage Systems Technical Support web site: http://www.ibm.com/servers/storage/support/disk/ 4.2 IBM TotalStorage™ Marketing Web Site: http://www.ibm.com/servers/storage/disk 4.3 If you have any questions about this update, or problem applying the update go to the following HelpCenter World Telephone Numbers URL: http://www.ibm.com/planetwide IMPORTANT: You should download the latest version of the DS4000 Storage Manager host software, the DS4000 storage server controller firmware, the DS4000 drive expansion enclosure ESM firmware and the drive firmware at the time of the initial installation and when product updates become available. To be notified of important product updates, you must first register at the IBM Support and Download Web site: www-1.ibm.com/servers/storage/disk/ Perform the following steps to register at the IBM Support and Download Web site: 1. Click on My Support in the Additional Support box in the right side of the DS4000 Support web page. 2. The Sign In window displays. Either enter your IBM ID and Password in the sign in area to sign in and proceed to step 6 or, if you are not currently registered with the site, click Register Now. 3. The My IBM Registration window Step 1 of 2 opens. Enter the appropriate information and click Continue to get to the second My IBM Registration window. 4. In the My IBM Registration window Step 2 of 2, enter the appropriate information and click Submit to register. 5. The My IBM Registration windows opens with the following message, “Thank you for registering with ibm.com. Continue to explore ibm.com as a registered user.” Click Edit Profile in the My IBM box on the right side of the window. 6. The My Support window opens. Click Add Products to add products to your profile. 7. Use the pull-down menus to choose the appropriate DS4000 storage server and expansion enclosures that you want to add to your profile. To add the product to your profile, select the appropriate box or boxes next to the product names and click Add Product. 8. Once the product or products are added to your profile, click Subscribe to Email folder tab 9. Select Storage in the pull down menu. Select Please send these documents by weekly email and select Downloads and drivers and Flashes to receive important information about product updates. Click Updates. 10. Click Sign Out to log out of My Support. ======================================================================= 5.0 Trademarks and Notices -------------------------- The following terms are trademarks of the IBM Corporation in the United States or other countries or both: IBM DS4000 ToTalStorage™ the e-business logo xSeries pSeries HelpCenter Microsoft, Windows, and Windows NT are trademarks of Microsoft Corporation in the United States, other countries, or both. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Sun Microsystems, Inc. in the United states, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvalds. ESX Server is a registered trademark of VMware Corporation. Other company, product, and service names may be trademarks or service marks of others. ======================================================================= 6.0 Disclaimer --------------- THIS DOCUMENT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND. IBM DISCLAIMS ALL WARRANTIES, WHETHER EXPRESS OR IMPLIED, INCLUDING WITHOUT LIMITATION, THE IMPLIED WARRANTIES OF FITNESS FOR A PARTICULAR PURPOSE AND MERCHANTABILITY WITH RESPECT TO THE INFORMATION IN THIS DOCUMENT. BY FURNISHING THIS DOCUMENT, IBM GRANTS NO LICENSES TO ANY PATENTS OR COPYRIGHTS. Note to U.S. Government Users -- Documentation related to restricted rights -- Use, duplication or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corporation. Refer to the appropriate Storage Manager Client package for the Operating system that you plan to use for management of the DS4000 Storage Subsystem.