Problem:
What to do when Airwave web interface is down with ap_get_server_version error
Diagnostics:
Below are couple of things we could check to further analyze this issue,
Run the below command to watch the daemons and see the httpd daemon failing,
# wd
Check the httpd error log under /var/log/httpd. We should be seeing the below error message in this case,
Tue Mar 1 01:09:21 2016] bootstrap.pl(22960): Starting...
ap_get_server_banner() not available until httpd/2.2.4 falling back to ap_get_server_version() at /opt/airwave/lib64/perl5/5.10.1/x86_64-linux-thread-multi/XSLoader.pm line 94.
ap_get_server_description() not available until httpd/2.2.4 falling back to ap_get_server_version() at /opt/airwave/lib64/perl5/5.10.1/x86_64-linux-thread-multi/XSLoader.pm line 94.
[Tue Mar 1 01:09:21 2016] bootstrap.pl(22960): Not the last run yet (PPID: 22959)
[Tue Mar 1 01:09:41 2016] bootstrap.pl(22982): Starting...
[Tue Mar 1 01:10:02 2016] bootstrap.pl(23012): Starting...
ap_get_server_banner() not available until httpd/2.2.4 falling back to ap_get_server_version() at /opt/airwave/lib64/perl5/5.10.1/x86_64-linux-thread-multi/XSLoader.pm line 94.
ap_get_server_description() not available until httpd/2.2.4 falling back to ap_get_server_version() at /opt/airwave/lib64/perl5/5.10.1/x86_64-linux-thread-multi/XSLoader.pm line 94.
[Tue Mar 1 01:10:02 2016] bootstrap.pl(23012): Not the last run yet (PPID: 23011)
[Tue Mar 1 01:10:22 2016] bootstrap.pl(23021): Starting...
[Tue Mar 1 01:10:42 2016] bootstrap.pl(23053): Starting...
Check the low_level_service watcher log and we would see the below message,
Mon May 13 10:01:34 2013: Couldn't find any apache processes; restarting.
Stopping httpd: [FAILED]
Starting httpd: [ OK ]
Stopping Pound: [FAILED]
Apache uptime (PID: 2997) appears to be negative (-32449 seconds), perhaps the system clock has jumped backwards at /usr/local/airwave/lib/perl/Mercury/Daemon/LowLevelServiceWatcher.pm line 151.
Mon May 13 10:02:13 2013: Couldn't find any apache processes; restarting.
Stopping httpd: [FAILED]
Starting httpd: [ OK ]
Stopping Pound: [FAILED]
Apache uptime (PID: 3022) appears to be negative (-32449 seconds), perhaps the system clock has jumped backwards at /usr/local/airwave/lib/perl/Mercury/Daemon/LowLevelServiceWatcher.pm line 151.
SolutionWe mainly see this issue when the time on the server is not correct. We can execute the below command on Airwave CLI to check the time,
# date
We can have the date and time updated on the server using the below commands,
# cd install
# ./time-setup
Set the right time and date. Once done we can also sync the server with the NTP server in the network using the below command,
Edit the /etc/ntp.conf file,
# vi /etc/ntp.conf
Add the ntp servers to the list and save. Restart the ntp services using the below command,
# service ntpd restart
Finally disable and enable to amp services using the below commands,
# amp_disable
# amp_enable -now
Wait for 5-6 minutes for the daemons to start up and you should be good to go.