Are you referring to the source port of the RADIUS request or the source IP of the RADIUS request?
You can specify the port as to which the WLC sends the Auth Port/Acct Port/Radsec Port within the Configuration > Security > Authentication > Servers properties. This is a per authentication server properties.
You can also specify a NAS IP within this same location as well.
NOTE: If you define a local NAS IP using the Configuration > Security >
Authentication > Servers page and also define a global NAS IP using the
Configuration > Security > Authentication > Advanced page, the global
NAS IP address takes precedence.