Hello all!
Would appreciate your thoughts on the below before I raise a TAC.
Yesterday we experienced a weird issue with a controller in our 8.6.0.7 cluster (x3 in total). It started with wireless clients joining AP's primarily associated with the problem node failing to authenticate and existing clients being dropped. MM showed the node as offline, I attempted to SSH and whilst I did get a uname/pword prompt it would time out before having a chance to put in the username. Ping was fine with no drops. As a precaution I isolated it from the network to ensure the other two nodes would pick up the remaining AP's etc.
Several hours later I attempted to console onto the node locally but due to credential issues I was unable to. Reloading the device from the front panel started but then crashed and after 10mins a physical power-cycle was required. Came back up fine, network enabled and came back into the cluster with no issues and started taking on APs/clients.
On debugging the logs today to see if anything obvious occurred the only events that occur in the log at the same time the issue was reported (seen in Airwave) and are not present on the other nodes are a bunch of webserver SSL error's.
They repeat over the course of a 1.30min window, I then believe at the end of the window 09:13hrs, thats when the controller went belly up!
-
<ng-include src="ctrl.getInternalTemplateUrl()">
2022 CMP-7210-MC-01 httpd[7989]: <350008> <8024> <ERRS> <CMP-7210-MC-01 xx.xx.xx.xx> |webserver| SSL Library Error: error:1408A10B:SSL routines:SSL3_GET_CLIENT_HELLO:wrong version number
</ng-include>
-
<ng-include src="ctrl.getInternalTemplateUrl()">
2022 CMP-7210-MC-01 httpd[7989]: <350008> <8024> <ERRS> <CMP-7210-MC-01 <ng-include src="ctrl.getInternalTemplateUrl()">xx.xx.xx.xx</ng-include>> |webserver| SSL Library Error: error:140760FC:SSL routines:SSL23_GET_CLIENT_HELLO:unknown protocol speaking not SSL to HTTPS port!?
</ng-include>
-
<ng-include src="ctrl.getInternalTemplateUrl()">
2022 CMP-7210-MC-01 httpd[7989]: <350008> <8047> <ERRS> <CMP-7210-MC-01 <ng-include src="ctrl.getInternalTemplateUrl()">xx.xx.xx.xx</ng-include>> |webserver| SSL Library Error: error:1408A10B:SSL routines:SSL3_GET_CLIENT_HELLO:wrong version number
</ng-include>
-
<ng-include src="ctrl.getInternalTemplateUrl()">
2022 CMP-7210-MC-01 httpd[7989]: <350008> <8023> <ERRS> <CMP-7210-MC-01 <ng-include src="ctrl.getInternalTemplateUrl()">xx.xx.xx.xx</ng-include>> |webserver| SSL Library Error: error:140760FC:SSL routines:SSL23_GET_CLIENT_HELLO:unknown protocol speaking not SSL to HTTPS port!?
</ng-include>