No. You can use a View Security Server even when Connection Server is configured for RSA SecurID. This is a very common configuration for access to a View environment from the Internet.
View Client users connect to the Security Server and will be prompted to enter their SecurID credentials (username and PIN/Tokencode).
Mark
