Network Management

last person joined: 2 days ago 

Keep an informative eye on your network with IMC and Airwave network management solutions.
Expand all | Collapse all

Ariwave behaviour!

Jump to Best Answer
  • 1.  Ariwave behaviour!

    Posted Apr 08, 2020 06:57 AM

    So. Today my Airwave (AirWave Management Platform 8.2.10.1) looks like this (PIC1)

     

    When checking the logs for troubleshooting (PIC2)

     

    When checking performance. I can see my /var/log i full (PIC3)

     

    Does the "down" services relates to the /var/log

    Where do i empty the /var/log? or increase the size?

     



  • 2.  RE: Ariwave behaviour!

    Posted Apr 08, 2020 07:12 AM

    Hi, it looks similar to what was already discussed here (at least looking at the complete filling of /var/log/ folder and also considering the Airwave version too). Generally services are affected by the saturation of such an important filesystem's mount point (/var/log/).



  • 3.  RE: Ariwave behaviour!
    Best Answer

    Posted Apr 08, 2020 08:55 AM

    Services are stopped due to either system performance or log directory is full.

     

    We have a known issue where kernal log grown in GB size which filled complete /var/log directory, not sure if your server hitting this, need to check all file sizes in that directory to confirm.

     

    You can login in to AMPCLI and go to Advanced > Enter commands > Cleanup 

     

    To clear log files which are older to  bring all services up for now.

     

     



  • 4.  RE: Ariwave behaviour!

    Posted Apr 08, 2020 09:17 AM

    so the cleanup actually worked! the services came up again! thank you for the tip!



  • 5.  RE: Ariwave behaviour!

    Posted Apr 08, 2020 09:24 AM

    It might be a temporary fix, if you noticed log directory growing quickly open TAC ticket.



  • 6.  RE: Ariwave behaviour!

    Posted Apr 08, 2020 09:26 AM

    Yeah. the TAC is already on. Thx



  • 7.  RE: Ariwave behaviour!

    Posted Jun 19, 2020 10:31 AM

    Has this been resolved in .11? 



  • 8.  RE: Ariwave behaviour!

    Posted Jun 21, 2020 05:28 AM

    This issue not noticed on all customer servers, to fix we have to comment line in iptable file.

     

    We have added new line in iptables related to packet limit in 8.2.10 which we can comment and their is no harm in it.

     

     



  • 9.  RE: Ariwave behaviour!

    Posted Jun 22, 2020 02:59 AM

    I do not think they fix it. we found a solution though.

     

    The partition for /var/log is 20GB.

    The problem show itself, as the Kernel file in /var/log was expanding out of proportions. i went from a couple of MB,to 18GB in a couple of weeks, and the rotation did now work.

     

    so what we did was:

     

    root@localhost CentOS7 /var/log # vi /etc/logrotate.d/kernel
    /var/log/kernel {
    su root root
    copytruncate
    missingok
    create 0600 root root
    maxsize 1M
    rotate 4
    compress
    }

    /var/log/kernel {
    su root root
    copytruncate
    missingok
    create 0600 root root
    "/etc/logrotate.d/kernel" 10L, 133C written

     

    and now it works like a smotth operator. 

     

    NB when the /var/log reach max capacity, it shut downs services