Also, if the APs from controller 4 connected to controller 1 in the past, they will show as Down when they swing back to controller 1. If you want to get rid of them from the DB, do "clear gap-db ap-name <name>".
If this is a master/local setup, the master should know the true status of all APs, whether they terminate on the master or the locals.
Sounds like these are all masters, though.