So no VRRP on the Brocade, right? If there is a VRRP on the Broacade, make sure that VRRP number does not match what is on the controller. If it does, use authentication on the VRRP instances on the controller so that they do not conflict with that on the Brocade. Turn it on, just in case another device is running the same VRRP instance to eliminate that unknown possibility, if you like.
On each controller can do do a "show VRRP statistics" to see if there is any inconsistency?