logoInstalling ESX4

Build Document for ESX4.0 System in Main Office




I deployed an ESX 4.0 server and VMWare Infrastructure in the Davis Server Room to accommodate testing and migration to the new vSphere Platform. I have also deployed the same ESX 4.0 server and VMWare Infrastructure in the Sacramento Colo. This is the build document for those two deploys.


Test the conciquences of going from physical servers to a VMWare Environment:

  • FreeBSD 6.3
  • CentOS 5.3
  • Solaris 10
  • Windows 2003 R2 Server (VCS Server)
  • Mac OS/X (optional)

Test the capabilities of the following VMWare Features:

  • Failover with Hot Spare.
  • Failover with the backup Hot Spare.
  • Performance - Net / Disk / CPU / Mem.
  • Thin Provisioning.
  • Disk Expansion.

SAN Multipathing.


I performed the following to deploy the servers:


I put three Aberdeen servers up in the lab so far, with the SAS 1.4TB array as external storage for the time being.

IP Addresses and Management

I used the following IP addresses to deploy the Davis VMW setup:

  • - Lab Router.
  • - SAS 1.4 TB SAN Management Console.
  • - ESX 4.0 Host -1.
  • - ESX 4.0 Host -2.
  • - ESX 4.0 Host -3.
  • - ESX 4.0 Host -4.
  • - VCS Server - This is what you want to Terminal Services into to manage the Davis VM Environment. It is also a VM.

* - Use for your VMs.

iSCSI Network:

  • - Eth0 on the SAS SAN.
  • - Eth1 on the SAS SAN.
  • - iSCSI1 Host1
  • - iSCSI2 Host1
  • - iSCSI1 Host2.
  • - iSCSI2 Host2.
  • - iSCSI1 Host3.
  • - iSCSI2 Host3.
  • - iSCSI1 Host4.
  • - iSCSI2 Host4.


  • 134 Fault Tolerance
  • 135 Vmotion
  • 2901 Admin
  • 2920 IHC
  • 2921 IDX
  • 2922 MLS
  • 2923 CRM
  • 2924 CTT
  • 2925 PBX
  • 2926 AUX
  • 2927 Mail
  • 2928 MIS

There is one router, lab-router, at, which does sub-interface dot1Q encapsulation, to which, for each VLAN, the router's IP address will be <network>.1. So for Aux, that router will be The router has another leg, interface 0/1, that is directly attached to the DSL modem at, with a GW of It's routes are:

  • Default = WWW.XXX.YYY.ZZZ
  • =
  • =


To manage the environment, Terminal Services into, launch the VMWare Infrastructure Client on the Desktop, log into "localhost" with Administrator / <PW>, you're good to go.

SAN Management

To manage the SAN, point the web browser on the VCS VM ( to with grp-admin / <PW>. I have already created 3 256GB volumes and have formatted them as a VMFS filesystem and labelled them as ESX-Vol1-3.

Colo Install / Remove

I have removed the cluster from the colo.

OS Specific Installs

Solaris 10 Notes

Solaris 10 and VMWare vmxnet ethernet driver

The problem that I had been experiencing was that I was unable to install the VMWare vxmnet ethernet driver onto a Solaris 10 x86 server running on a VMWare vSphere 4.0 server.

The solution to getting the vmxnet interface to work is as follows:

1) install stock e1000 ethernet interface on a Solaris VM
2) install the VMWare 4.0 tools on a Solaris VM
3) halt and power off VM
4) install a second ethernet interface onto a Solaris VM, using the vmxnet3 driver
5) ifconfig vmxnet3s0 plumb
6) ifconfig e1000g0 unplumb
7) mv /etc/hostname.e1000g0 /etc/hostname.vmxnet3s0
8) reboot

The trick is to have two ethernet interfaces (e1000 and vmxnet3) and just unplumb from Solaris the e1000 interface. Don't remove the e1000 interface from the VMWare host configuration.