So It may be related to the network side. So here are some resolution paths I taken to make it work.
Setting ARP to Manual:
Put the Desktop in Maintenance mode
Shutdown the VM
Change Mac Address to Manual: and enter in a static MAC address
Remove Desktop from Maintenance mode
IP Address should now be populated in VIC with new MAC address
Setting ARP back to Automatic:
Put the Desktop in Maintenance mode
Shutdown the VM
Change Mac Address to Automatic
Remove Desktop from Maintenance Mode
VM should now be back to Automatic
Also I used this site: http://rickardnobel.se/vswitch-notify-switches-setting/
Will have to further investigate the root cause.
Thanks for your help guys.