Sstrutt: /* NIC Operations */ Added "Display ARP Cache"

2012-10-16T10:11:13Z

NIC Operations: Added "Display ARP Cache"

← Older revision		Revision as of 10:11, 16 October 2012
Line 155:		Line 155:
	** <code> vsish -e get net/pNics/vmnic<no>/properties</code>		** <code> vsish -e get net/pNics/vmnic<no>/properties</code>
	** Where <code><no></code> is your NIC no, eg <code> vsish -e get net/pNics/vmnic1/properties </code>		** Where <code><no></code> is your NIC no, eg <code> vsish -e get net/pNics/vmnic1/properties </code>

			== Display ARP Cache ==
			* '''ESX'''
			** <code> arp -a </code>
			* '''ESXi'''
			** <code> esxcli network neighbor list </code>

	= HBA and SAN Operations =		= HBA and SAN Operations =

Sstrutt: Minor reformatting, page needs major revision

2012-03-13T14:34:15Z

Minor reformatting, page needs major revision

Show changes

Sstrutt: Export from original ESX page

2011-11-08T08:30:35Z

Export from original ESX page

New page

= Procedures =
Links to VMware KB docs...
* [http://kb.vmware.com/kb/1026380 VMware KB1026380 - Committing snapshots on ESX/ESXi host from command line]

== Quick commands ==
{|cellpadding="2" cellspacing="0" border="1"
|-
|<code> vmware -v </code> || ESX3 software version and build
|-
|<code> vmware -l </code> || ESX4 software version and build
|-
|<code> vm-support -x </code> || List running VM's
|-
|<code> vmware-cmd -l </code> || List config files of VM's registered to ESX
|-
|<code> esxcfg-rescan vmhba0 </code> || Perform LUN rescan on vmhba0
|-
|<code> esxcfg-vmhbadevs </code> || List HBA LUN mappings
|-
|<code> esxcfg-scsidevs --hbas </code> || List HBA devices
|-
|<code> esxcfg-mpath -l </code> || List all LUNS and their paths
|}

== ESX Shutdown / Reboot ==
'''ESX'''
* Shutdown a host ready for power off
** <code> shutdown -h now </code>
* Restart a host
** <code> shutdown -r now </code>

'''ESXi'''
* Shutdown a host ready for power off, either of
** <code> /bin/host_reboot.sh </code>
** <code> reboot </code>
* Restart a host
** <code> /bin/host_shutdown.sh </code>

== High Availability Stop/Start ==
* Stop HA...
** <code> /etc/init.d/VMWAREAAM51_vmware stop </code>
* Start HA...
** <code> /etc/init.d/VMWAREAAM51_vmware start </code>

== VMware Management Agent Restart ==
'''ESX'''
<pre>
service mgmt-vmware restart
Stopping VMware ESX Server Management services:
VMware ESX Server Host Agent Services [ OK ]
VMware ESX Server Host Agent Watchdog [ OK ]
VMware ESX Server Host Agent [ OK ]
Starting VMware ESX Server Management services:
VMware ESX Server Host Agent (background) [ OK ]
Availability report startup (background) [ OK ]
</pre>

If this fails to stop the service, you can try to manually kill the processes.
# Determine the PID's of the processes
#* <code> ps -auxwww | grep vmware-hostd </code>
#* which should give you something like, in which case the PID's are 2807 and 2825...
#* <code> root 2807 0.0 0.3 4244 884 ? S Mar10 0:00 /bin/sh /usr/bin/vmware-watchdog -s hostd -u 60 -q 5 -c /usr/sbin/vmware-hostd-support /usr/sbin/vmware-hostd -u </code>
#* <code> root 2825 0.1 12.0 72304 32328 ? S Mar10 1:14 /usr/lib/vmware/hostd/vmware-hostd /etc/vmware/hostd/config.xml -u </code>
#* <code> root 13848 0.0 0.2 3696 556 pts/0 R 08:43 0:00 grep vmware-hostd </code>
# Kill the PID's using <code> kill -p pid </code>
#* So, for example, <code> kill -9 2807 </code> and <code> kill -9 2825 </code>
# Then reattempt the service restart

To also restart the Virtual Centre Agent, use
service vmware-vpxa restart

'''ESXi'''<br>
<code> services.sh restart </code>

== VMware Web Access Restart ==
<pre>
service vmware-webAccess restart
Stopping VMware ESX Server webAccess:
VMware ESX Server webAccess [FAILED]
Starting VMware ESX Server webAccess:
VMware ESX Server webAccess [ OK ]
</pre>

== VM Start ==
On the ESX that currently owns the VM...
# Get the VM's config file path
#* <code> vmware-cmd -l | grep VM_Name </code>
# Start the VM using the path found
#* <code> vmware-cmd \vm_path\VM_Name.vmx start </code>
# Wait for start-up to complete, if start-up fails check the VM's log
#* <code> less \vm_path\vmware.log </code>

== Maintenance Mode ==
To put the ESX into maintenance mode with no access from the Infrastructure Client (VCP) use the following commands - use with caution

Put esx into maintenance mode:
<pre>
vimsh -n -e /hostsvc/maintenance_mode_enter
</pre>

check the esx is in maintenance mode
<pre>
vimsh -n -e /hostsvc/runtimeinfo | grep inMaintenanceMode | awk ‘{print $3}’
</pre>

exit maintenance mode
<pre>
vimsh -n -e /hostsvc/maintenance_mode_exit
</pre>

== TCPDump Network Sniffer ==
Basic network sniffer available in Service Console

[http://www.tcpdump.org/tcpdump_man.html TCPDump instruction manual]

EG To sniff all traffic on the Service Console interface, vswif0, going to/from 159.104.227.40

<code> tcpdump -i vswif0 host 159.104.224.70 </code>

== Security ==
=== Password Complexity Override ===
In order to be able to change a user (or root) password to one that breaches password complexity checking

# Disable PAM module
#* <code> esxcfg-auth --usepamqc -1 -1 -1 -1 -1 -1 </code>
# Disable complexity checker
#* <code> esxcfg-auth --usecrack -1 -1 -1 -1 -1 -1 </code>
# Change password
# Re-enable PAM module
#* <code> esxcfg-auth --usepamqc=-1 -1 -1 -1 8 8 </code>

=== Regenerate Certificate ===
You might need to regenerate certificates if
* Change ESX host name
* Accidentally delete the certificates

To generate new Certificates for the ESX Server host...
# Change directories to /etc/vmware/ssl.
# Create backups of any existing certificates:
#* <code> mv rui.crt orig.rui.crt </code>
#* <code> mv rui.key orig.rui.key </code>
# Rstart the vmware-hostd process:
#* <code> service mgmt-vmware restart </code>
# Confirm that the ESX Server host generated new certificates by executing the following command comparing the time stamps of the new certificate files with orig.rui.crt and orig.rui.key
#* <code> ls -la </code>

== NIC Operations ==
=== Get NIC Firmware/Driver versions ===
* '''ESX4'''
** <code> ethtool -i vmnic<no> </code>
** Where <code><no></code> is your NIC no, eg <code> ethtool -i vmnic0 </code>
* '''ESX3i / ESX4i'''
** <code> vsish -e get net/pNics/vmnic<no>/properties</code>
** Where <code><no></code> is your NIC no, eg <code> vsish -e get net/pNics/vmnic1/properties </code>

== HBA and SAN Operations ==
=== VMFS / LUN Addition ===
The new LUN needs to be carved up and presented to all ESX's that should see it (normally all ESX's from a particular cluster). Once completed, follow the procedure below to add to the ESX's...
# Pick ESX in cluster with lowest load
# Go to '''Storage Adapters''', hit '''Rescan...''' and untick the ''Scan for New VMFS Volumes''
# Once scan has complete, go to '''Storage''', and hit '''Add Storage...'''
# Click '''Next >''' to select ''Disk/LUN'' storage
# Select the appropriate device and click '''Next >'''
# Check the current disk layout (ie its blank if its meant to be) and click '''Next >'''
# Give the datastore an appropriate name, and click '''Next >'''
# Select an approriate block size (this limits maximum VMDK size), and click '''Next >'''
# Review config and click '''Finish'''
# On the remaining ESX's, go to '''Storage Adapters''', hit '''Rescan...''' (leave both boxes checked)

=== SAN LUN ID ===
The SAN LUN ID is used by SAN admin's to identify LUN's. It's not readily available from the GUI and has to be extracted from the vml file...

So from the following...
* <code> /vmfs/devices/disks/vml.020006000060060160c6931100cc319eea7adddd11524149442035 </code>
you need to extract the mid characters from the vml name...
* <code> /vmfs/devices/disks/vml.0200060000'''60060160c6931100cc319eea7adddd11'''524149442035 </code>
So the SAN LUN ID is <code> 60060160c6931100cc319eea7adddd11 </code>

=== Emulex ===
==== Find Emulex HBA Driver and Firmware Version, and WWPN ====
Doesn't require Emulex HBA utility to be installed
# <code> cd /proc/scsi/lpfc </code>
# <code> more 1 </code> for HBA 1
# <code> more 2 </code> for HBA 2

The <code> Portname </code> number is the WWPN number used to identify the HBA's by the SAN.
<pre>
[root@uklonesxp2 lpfc]# more 1
Emulex LightPulse FC SCSI 7.1.14_vmw1
Emulex LightPulse LP1050 2 Gigabit PCI Fibre Channel Adapter on PCI bus 0f devic
e 20 irq 121
SerialNum: BG70569148
Firmware Version: 1.91A1 (M2F1.91A1)
Hdw: 1001206d
VendorId: 0xf0a510df
Portname: 10:00:00:00:c9:61:73:de Nodename: 20:00:00:00:c9:61:73:de

Link Up - Ready:
PortID 0x645213
Fabric
Current speed 2G
</pre>

==== Install Emulex HBA Utility ====
Can be found at [http://www.emulex.com/vmware/support/index.jsp Emulex Lputil].

To install lputil (uses example of lpfcutil-7.1.14;
# Put the downloaded tgz file on the ESX server
#* EG <code> mkdir /var/updates/Emulex-lpfcutil-7.1.14 </code>
# Go into folder and extract;
#* <code> cd /var/updates/Emulex-lpfcutil-7.1.14/ </code>
#* <code> tar -xvzf Emulex-lpfcutil-7.1.14.tgz </code>
# Install;
#* <code> ./Install.sh </code>
<pre>
[root@uklonesxp2 Emulex-lpfcutil-7.1.14]# ./Install.sh
Installing Emulex HBAAPI libraries and applications...
Installation of Emulex HBAAPI libraries and utilities is completed.
</pre>
* Start the utility (on startup it should detect one or more HBA's);
* <code> /usr/sbin/lpfc/lputil </code>
<pre>
LightPulse Common Utility for Linux. Version 1.6a10 (10/7/2004).
Copyright (c) 2004, Emulex Network Systems, Inc.

Emulex Fibre Channel Host Adapters Detected: 1
Host Adapter 0 (lpfc0) is an LP1050 (Ready Mode)
</pre>

==== HBAnywhere Installation ====
# Download the Driver and Application kit for VMware from [http://www.emulex.com/downloads/emulex/cnas-and-hbas/drivers/vmware/fc-74040-pkg.html Emulex's website].
#* At time of writing the current version of package was <code>elxvmwarecorekit-esx35-4.0a45-1.i386.rpm</code>
# Copy the package to the server
#* EG <code> pscp -pw [password] elxvmwarecorekit-esx35-4.0a45-1.i386.rpm platadmn@dtcp-esxsvce01a:/home/platadmn</code>
# Install the package
#* EG <code> rpm -ivh elxvmwarecorekit-2.1a42-1.i386.rpm </code>

==== Check Emulex HBA Firmware Version ====
Requires the HBA Utility to be installed 1st (see above)

# Start the utility (on startup it should detect one or more HBA's;
#* <code> /usr/sbin/lpfc/lputil </code>
# From the Main menu, enter 2, '''Adapter Revision Levels'''
#* Example shows version 1.91a5
<pre>
BIU: 1001206D
Sequence Manager: 00000000
Endec: 00000000
Operational Firmware: SLI-2 Overlay
Kernel: 1.40a3
Initial Firmware: Initial Load 1.91a5 (MS1.91A5 )
SLI-1: SLI-1 Overlay 1.91a5 (M1F1.91A5 )
SLI-2: SLI-2 Overlay 1.91a5 (M2F1.91A5 )
Highest FC-PH Version: 4.3
Lowest FC-PH Version: 4.3
</pre>

==== Update Emulex HBA Firmware ====
* '''Using HBA Utility''' (must be installed 1st - see above). See the Emulex website for the latest version, eg [http://www.emulex.com/ts/downloads/lp1050/lp1050ex.jsp Emulex LP1050Ex]

To update the firmware (example uses LP1050Ex-mf191a5)
# Put the downloaded zip file on the UKLONVCP1 NFS Share, and unzip to a folder, eg EmulexLP1050Ex-mf191a5
# Create folder in /var/updates;
#* <code> mkdir /var/updates/EmulexLP1050Ex-mf191a5 </code>
# Copy the firmware update onto the ESX
#* <code> cp /vmfs/volumes/UKLONVCP1\ NFS\ Share/EmulexLP1050Ex-mf191a5/mf191a5.all /var/updates/EmulexLP1050Ex-mf191a5/ </code>
# Start the utility (on startup it should detect one or more HBA's;
#* <code> /usr/sbin/lpfc/lputil </code>
# From the Main menu, enter 3, '''Firmware Maintenance'''.
# If prompted, choose the HBA that is being updated.
# Enter 1, '''Load Firmware Image'''.
# Enter the full path to the firmware file, upgrade will then complete, eg
<pre>
Enter Image Filename => /var/updates/EmulexLP1050Ex-mf191a5/mf191a5.all
Opening File...
End Of File
Checksum OK!!!
Reading AIF Header #1...
Validating Checksum...
Erasing Flash ROM Sectors...
100% complete
Loading Image...
First Download
100% complete
Image Successfully Downloaded...
Reading AIF Header #2...
Validating Checksum...
Erasing Flash ROM Sectors...
100% complete
Loading Image...
First Download
100% complete
Updating Wakeup Parameters...
Image Successfully Downloaded...
Reading AIF Header #3...
End Of File
Resetting Host Adapter...
Image Successfully Downloaded...
</pre>

* '''Using HBAnywhere''' (must be installed 1st - see above)
# Download the correct firmware version from Emulex's website
#* EG for [http://www.emulex.com/downloads/emulex/cnas-and-hbas/firmware-and-boot-code/lpe11002.html LPe11002's]
# Extract, and copy file to server
# Find adapter's WWPN's
#* EG <code>/usr/sbin/hbanyware/hbacmd ListHBAs</code>
# Download new firware version to each HBA
#* EG <code>/usr/sbin/hbanyware/hbacmd download 10:00:00:00:c9:82:97:9e zf280a4.all</code>

==== EMCgrab Collection ====
# Download correct verion from EMC's website
#* At time of writing the current version file was [ftp://ftp.emc.com/pub/emcgrab/ESX/Old_Releases/v1.1/ emcgrab_ESX_v1.1.tar]
# Copy to server
#* EG <code>pscp emcgrab_ESX_v1.1.tar platadmn@dtcp-esxsvce02a:/home/platadmn</code>
# Uncompress the file
#* EG <code>tar -xvf emcgrab_ESX_v1.1.tar</code>
# Run grab (can take a few minutes, best done out of hours)
#* EG <code>./emcgrab.sh</code>
# Results can be found in <code>\emcgrab\outputs</code> folder

=== QLogic ===
==== Find QLogic HBA Driver and Firmware Version ====
# <code> cd /proc/scsi/qla2300 </code>
# <code> more 1 </code> for HBA 1
<pre>
[root@uklonesxp1 qla2300]# more 1
QLogic PCI to Fibre Channel Host Adapter for QLA2340 :
Firmware version: 3.03.19, Driver version 7.07.04
Entry address = 0x7dc314
HBA: QLA2312 , Serial# E79916
Request Queue = 0x3f403000, Response Queue = 0x3f414000
...
</pre>

==== Install QLogic HBA Utility ====
Installation instructions for the SANsurfer utility
# Put the downloaded tgz file on the UKLONVCP1 NFS Share, eg scli-1.7.0-12.i386.rpm.gz
# Copy to folder /var/updates (create if it doesn't exist)
#* <code> cp /vmfs/volumes/UKLONVCP1\ NFS\ Share/scli-1.7.0-12.i386.rpm.gz /var/updates </code>
# Uncompress the file with the following command;
#* <code> gunzip scli-1.7.0-12.i386.rpm.gz </code>
# Enter the following commands to install the package, and then check its installed;
#* rpm -iv scli-1.7.0-12.i386.rpm
#* rpm -q scli
<pre>
[root@uklonesxp1 updates]# rpm -iv scli-1.7.0-12.i386.rpm
Preparing packages for installation...
scli-1.7.0-12
[root@uklonesxp1 updates]# rpm -q scli
scli-1.7.0-12
</pre>

==== Update QLogic HBA Firmware ====
See QLogic website for latest version, you must ensure the firmware version is compatible with the current running driver version. Requires SANsurfer to be installed 1st (see above)

# Put the downloaded tgz file on the UKLONVCP1 NFS Share, eg q231x_234x_bios147.zip, and unzip to folder
# Create a new folder for the update;
#* <code> mkdir /var/updates/q231x_234x_bios147
# Copy the firmware onto the ESX server;
#* <code> cp /vmfs/volumes/UKLONVCP1\ NFS\ Share/q231x_234x_bios147/QL23ROM.BIN /var/updates/q231x_234x_bios147/ </code>
# Move to the folder containing the update;
#* <code> cd /var/updates/q231x_234x_bios147/ </code>
# Start the SANsurfer utility
#* <code> scli </code>
# Go into the '''HBA Utilities''' option
# Select the '''Save Flash'' option
# Follow the prompts to save the flash to a backup file, eg BackupROM.bin
# Select the '''Update Flash''' option
# Follow the prompts to update the flash, using the file copied to the ESX, eg QL23ROM.BIN
<pre>
Enter a file name or Hit <RETURN> to abort: QL23ROM.BIN
Updating flash on HBA 0 - QLA2340 . Please wait...
Option ROM update complete. Changes have been saved to the HBA 0.
Please reboot the system for the changes to take effect.
Updating flash on HBA 1 - QLA2340 . Please wait...
Option ROM update complete. Changes have been saved to the HBA 1.
Please reboot the system for the changes to take effect.
</pre>

=== SAN Downtime ===
ESX's don't like to loose the SAN, to the extent that during the scheduled SAN downtime the following is recommended...
# Shutdown ESX's (and hosted VM's) connected to affected storage
# Perform SAN maintenance
# Restart ESX's (and hosted VM's)
If the above is not possible then its recommended that...
# Migrate away/shutdown VM's that are hosted on affected storage
# Un-present LUN's
# Resan LUN's from ESX and confirm they disappear (any VM's on extinct storage will become greyed-out)
# Perform SAN maintenance
# Re-present LUN's
# Re-scan LUN's from ESX and confirm that they re-appear (grey-ed out VM's should ''reconnect'')
# Restart / migrate VM's

== Netflow ==
'''Netflow is available on ESX v3 only, and is an experimental feature. Netflow v5 is sent.'''

* '''To start Netflow'''
*# Load the module
*#* <code> vmkload_mod netflow </code>
*# Configure monitoring of appropriate vSwitch's to Netflow collector IP and port
*#* <code> /usr/lib/vmware/bin/vmkload_app -S -i vmktcp /usr/lib/vmware/bin/net-netflow -e vSwitch0,vSwitch1 10.20.255.31:2055 </code>
** To reconfigure the Netflow module you must stop and restart the module

* '''To confirm running'''
*# Check the module is running...
*#* <code> [root@esx1 root]# vmkload_mod -l | grep netflow </code>
*#* <code> netflow 0x9b4000 0x3000 0x298b640 0x1000 16 Yes </code>
*# Check the correct config is running...
*#* <code> [root@esx1 root]# ps -ef | grep netflow </code>
*#* <code> root 2413 1 0 Feb05 ? 00:00:00 /usr/lib/vmware/bin/vmkload_app -S -i vmktcp /usr/lib/vmware/bin/net-netflow -e vSwitch0,vSwitch1 10.20.255.31:2055 </code>

* '''To stop Netflow'''
*# <code> ps -ef | grep netflow </code>
*# <code> kill <pid> </code>
*# <code> vmkload_mod -u netflow </code>

== Change Service Console IP Information ==
Logged in as root use the esxcfg-vswif command <code>esxcfg-vswif <options> [vswif] </code>

Description: Creates and updates service console network settings. This command is used if you cannot manage the ESX Server host through the VI Client because of network configuration issues.

Note that the -l command will display the names(s) of the virtual switches which must be specified on the other commands so the trailing [vswif] is not optional on most commands.

Options:

-a Add vswif, requires IP parameters. Automatically enables interface.
-d Delete vswif.
-l List configured vswifs.
-e Enable this vswif interface.
-s Disable this vswif interface.
-p Set the portgroup name of the vswif.
-i <x.x.x.x> or DHCP The IP address for this vswif or specify DHCP to use DHCP for this address.
-n <x.x.x.x> The IP netmask for this vswif.
-b <x.x.x.x> The IP broadcast address for this vswif. (not required if netmask and ip are set)
-c Check to see if a virtual NIC exists. Program outputs a 1 if the given vswif exists, 0 otherwise.
-D Disable all vswif interfaces. (WARNING: This may result in a loss of network connectivity to the Service Console)
-E Enable all vswif interfaces and bring them up.
-r Restore all vswifs from the configuration file. (Internal use only)
-h Displays command help.

Note: You set the Service Console default gateway by editing the /etc/sysconfig/network file or through the VI Client under Configuration, DNS & Routing.

Note: You set the Service Console VLAN (to 1234) using a similar command to: <code>esxcfg-vswitch -v1234 -p"Service Console" vSwitch0></code>

== Change Timezone ==
# Log into the ESX Server service console as root.
# Find the desired time zone under the directory /usr/share/zoneinfo
# Edit <code> /etc/sysconfig/clock </code> Edit this file to show the relative path to the file representing the new time zone, and ensure that UTC and ARC are set as shown:
#* <code> ZONE="Etc/GMT" </code>
#* <code> UTC=true </code>
#* <code> ARC=false </code>
# Copy the desired time zone file to /etc/localtime
#* <code> cp /usr/share/zoneinfo/GMT /etc/localtime </code>
# Confirm that /etc/localtime has been updated with the correct zoneinfo data using the following steps:
# Reference the zoneinfo file used in step 2 and compare it to /etc/localtime, if the files are identical, your prompt will return without any output.
#* <code> diff /etc/localtime /usr/share/zoneinfo/GMT </code>
# Confirm the system and hardware clocks are correct. Use the Linux date command to check and set the correct time if necessary.
#* Set the hardware clock to match the correct system time.
#* Set the system clock to the local date and time: \\\\ date MMDDhhmmYYYY
# Update the hardware clock with current time of the system clock;
#* <code> /sbin/hwclock --systohc </code>

[[Category:ESX]]

Procedures (ESX) - Revision history

Sstrutt: /* NIC Operations */ Added "Display ARP Cache"

Sstrutt: Minor reformatting, page needs major revision

Sstrutt: Export from original ESX page