I missed the parts about it being only the view administrator, and that there is a load balancer in there. The SANs for the certs might be a place to check also since the name is getting bounced around some. Is it possible to request/use a wildcard cert instead of a SAN cert?
Edit - Also can you check to be sure you are using the FQDN of the server in the view connection server settings?