Could be a few things:
DNS - Does it work properly? (This is the most common cause of failure, please verify even if you think it works)
Firewall - Can the desktops and connection broker talk to each other on the correct ports?
Windows Activation - How do you activate your desktops? (MAK or KMS) Are you sure its working correctly?
// Linjo