Monitoring, Management & Location Tracking

Problem:

Sometimes we can come across issue where Airwave server is not booting up and we will see the below error during the boot.

The reason for this error is one of the partition would have corrupted blocks. Scenarios we would see this kind of behavior is when there was a power outage or if the instance was not shutdown properly, which would have lead to file corruption.

To fix this issue we would have to do a file system check on the server. If we are on a version prior to 8.2.4 we can do it from single user mode, else we have to do it from Linux rescue mode.

Doing the file system check as single user

• Reboot the server, when its booting up press press "e" to edit the boot configuration
• Move the cursor down to the second line that starts with 'kernel', and press "e" again to edit that line
• Make sure you're at the end of the line, give a space and add the word "single" (without quotes) to the string, then hit enter
• Type 'b' to continue the boot process; you'll boot quickly into a shell without having to enter a password
• From there umount / using below command and perform the below steps

umount /
fsck -f -y /dev/VolGroup00/LogVol00
reboot

Doing the file system check from Linux rescue

To do this first mount the ISO for Airwave or centos to the server. When it boots up with the ISO on the boot prompt type "Linux rescue"

boot: linux rescue

Once done run the below commands for doing an LVM scan if you have used Linux LVM to create your partition

lvm pvscan
lvm vgscan
lvm lvchange -ay VolGroup00
lvm lvscan

Once done we can umount "/" so that we can do the file system check

chroot /mnt/sysimage
umount /

We can execute the below command to do the file system check

fsck -f -y /dev/VolGroup00/LogVol00


Once done we can reboot the server using the below command,

reboot

Now the server should be booting up fine.