This turned out to be the issue:
http://kb.vmware.com/kb/2051801
While the workaround in the article was not 100% correct. I had to remove the VMWare USB Hub devices from the device manager and the drivers from the system32 location. Then run a repair on the 5.2 View Agent.
Then things seemed to be much happier.