Network Management

last person joined: yesterday 

Keep an informative eye on your network with HPE Aruba Networking network management solutions
Back to discussions
Expand all | Collapse all

Airwave sticky clients

This thread has been viewed 6 times

  • 1.  Airwave sticky clients

    Posted Feb 16, 2017 05:35 AM
      |   view attached

    Hi,

     

    first post on airheads community.

    Im new to this aruba thing. I recently installed Aruba system with mobility controller 7205 and Airwave server.

     

    So far everything ran fine.

    This morning i noticed somethign weird while looking at the total client graph. 280 clients were supposedly connected all night long, which i'm afraid is not true. It seem to me that some clients "stick" in the db and are considered connected by airwave while they shouldnt.

    Did this happen to some of you? how can i fix that, so that my graph shows the real values.

     

    See attached screencap for screenshot of the graph.

     

    Thanks.



  • 2.  RE: Airwave sticky clients

    EMPLOYEE
    Posted Feb 16, 2017 08:28 AM

    Do you have a Captive Portal?  Those could be clients that are associated but not logged in.



  • 3.  RE: Airwave sticky clients

    Posted Feb 16, 2017 08:35 AM

    Hi Joseph,

     

    we do not have a captive portal on the wireless network those clients are supposedly connected on.



  • 4.  RE: Airwave sticky clients

    EMPLOYEE
    Posted Feb 16, 2017 08:43 AM

    In airwave you should run a Daily Client Session Report for that specific period of time with details to see what devices Airwave considers still connected to your network.



  • 5.  RE: Airwave sticky clients

    Posted Feb 16, 2017 09:27 AM

    Thanks Colin

    I did run a Daily client session report, but it just list clients which are still considered connected indeed on that specific time period. It doesnt help resolving the issue though.



  • 6.  RE: Airwave sticky clients

    EMPLOYEE
    Posted Feb 16, 2017 09:37 AM

    Did you edit the user idle timeout on the controller?  What is the output of "show aaa timers"?



  • 7.  RE: Airwave sticky clients

    Posted Feb 16, 2017 04:21 PM

    the results of show aaa timers is 

    Global User idle timeout = 300 seconds
Auth Server dead time = 10 minutes
Logon user lifetime = 5 minutes
User Interim stats frequency = 600 seconds

    i changed the user idle timeout only in my captive portal settings (authentication / L3 auth / captive portal auth / portal), but those portal are not used on this wireless.

     

    If i connect to the controller interface the dashboard shows the correct number of clients.



  • 8.  RE: Airwave sticky clients

    EMPLOYEE
    Posted Feb 16, 2017 06:33 PM
    I am out of guesses. You should open a TAC case to find out why.


  • 9.  RE: Airwave sticky clients

    EMPLOYEE
    Posted Feb 17, 2017 12:33 PM

    How is AirWave getting data from the controller?  If it's SNMP, it's possible that we never saw the client de-auth.  If it's AMON (this is the preferred way of collecting data from Aruba controllers), then need to make sure the AMP is preferring AMON over SNMP on AMP Setup, and then verify that the proper message types are configured:

     

    from controller:

    show mgmt-servers

    show mgmt-server profile (profile of the server entry from above command output)

    at minimum, should have stats-enable, sessions-enable, monitored-info-enable, and misc-enable



  • 10.  RE: Airwave sticky clients

    Posted Feb 17, 2017 01:12 PM

    AMON is enabled and prefered over SNMP.

     

    show mgmt-server 

     

     

    List of Management Servers
--------------------------
Type     Primary Server  Profile
----     --------------  -------
AirWave  xxx.xxx.xxx.xxx  MYPROFILE   
Num Rows:1

    all is correct there.

     

     

    show mgmt-server profile MYPROFILE

     

    Mgmt Config profile "MYPROFILE"
--------------------------------
Parameter          Value
---------          -----
Stats              Enabled
Tag                Enabled
Sessions           Enabled
Monitored Info     Enabled
Misc               Enabled
Location           Enabled
UCC Monitoring     Enabled
AirGroup Info      Enabled
Inline DHCP stats  Enabled
Inline AP stats    Enabled
Inline Auth stats  Enabled
Inline DNS stats   Enabled


  • 11.  RE: Airwave sticky clients

    EMPLOYEE
    Posted Feb 17, 2017 01:31 PM

    That all seems good, are we seeing any processes restarting a lot?  This would be shown in /var/log/service_watcher.  Also, check for any errors in /var/log/httpd/error_log, /var/log/async_logger_client, /var/log/papi_handler.  If there's no crashes, then next step would be to open a support case for some live debugging session.



  • 12.  RE: Airwave sticky clients

    Posted Feb 18, 2017 04:44 PM

    no processes restarting a lot.

    no errors in papi_handler

    in async_logger_client bunch of this

    Spoiler
    Sat Feb 18 04:02:11 2017: Callback died: Topic:channel_utilization , Payload:$VAR1 = { msg_timestamp => 1487386931, node_id => '00:00:00:00:00:00', rows => [ { CL_AP_MAC_ADDRESS => '00:00:00:00:00:00', CL_CHANNEL => 0, CL_NOISE_FLOOR => 0, CL_RADIO_NUMBER => 0, CL_RX_CLEAR => 0, CL_RX_DATA_BYTES => 0, CL_RX_TIME => 0, CL_RX_TIME_DATA => 0, CL_RX_TIME_ME => 0, CL_TX_DATA_BYTES_TRANSMITTED => 0, CL_TX_TIME => 0, CL_TX_TIME_DATA => 0 }, { CL_AP_MAC_ADDRESS => '00:00:00:00:00:00', CL_CHANNEL => 0, CL_NOISE_FLOOR => 0, CL_RADIO_NUMBER => 0, CL_RX_CLEAR => 0, CL_RX_DATA_BYTES => 0, CL_RX_TIME => 0, CL_RX_TIME_DATA => 0, CL_RX_TIME_ME => 0, CL_TX_DATA_BYTES_TRANSMITTED => 0, CL_TX_TIME => 0, CL_TX_TIME_DATA => 0 } ], src_ip => '172.20.1.11', timestamp => 1487386931, topic => 'channel_utilization' }; , Error:ERROR: invalid input syntax for integer: "00:00:00:00:00:00": select version from ap where id =? (00:00:00:00:00:00) at /usr/local/airwave/lib/perl/Mercury/Role/GoodputMixin.pm line 68 Mercury::Role::GoodputMixin::needs_fixing('Mercury::Daemon::Monitoring::AMONRadioStats=HASH(0x7fea441c2178)', '00:00:00:00:00:00') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Monitoring/AMONRadioStats.pm line 136 Mercury::Daemon::Monitoring::AMONRadioStats::handle_event('Mercury::Daemon::Monitoring::AMONRadioStats=HASH(0x7fea441c2178)', 'HASH(0x7fea452d18e0)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/AsyncLoggerClient.pm line 157 Mercury::Daemon::AsyncLoggerClient::__ANON__('HASH(0x7fea452d18e0)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/AsyncLoggerClient.pm line 540 Mercury::Daemon::AsyncLoggerClient::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Utility.pm line 175 eval {...} called at /usr/local/airwave/lib/perl/Mercury/Utility.pm line 175 Mercury::Utility::safe_eval('CODE(0x7fea44e72dc8)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/AsyncLoggerClient.pm line 540 Mercury::Daemon::AsyncLoggerClient::main('Mercury::Daemon::AsyncLoggerClient=HASH(0x7fea43c9af88)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Base.pm line 171 Mercury::Daemon::Base::go('Mercury::Daemon::AsyncLoggerClient=HASH(0x7fea43c9af88)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/Forkable.pm line 51 Mercury::Daemon::Service::Forkable::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Utility/Processes.pm line 127 Mercury::Utility::Processes::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Utility/Processes.pm line 83 Mercury::Utility::Processes::fork_and_run('CODE(0x7fea43cd7418)') called at /usr/local/airwave/lib/perl/Mercury/Utility/Processes.pm line 129 Mercury::Utility::Processes::fork_and_run_detached('CODE(0x7fea43a06f08)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/Forkable.pm line 53 Mercury::Daemon::Service::Forkable::_restart('Mercury::Daemon::Service::AsyncLoggerClient=HASH(0x7fe9e1a6ee78)', 1) called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/MultiForkable.pm line 27 Mercury::Daemon::Service::MultiForkable::_restart('Mercury::Daemon::Service::AsyncLoggerClient=HASH(0x7fe9e1a6ee78)', 1) called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/AsyncLoggerClient.pm line 115 Mercury::Daemon::Service::AsyncLoggerClient::_restart('Mercury::Daemon::Service::AsyncLoggerClient=HASH(0x7fe9e1a6ee78)', 2) called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service.pm line 90 Mercury::Daemon::Service::restart('Mercury::Daemon::Service::AsyncLoggerClient=HASH(0x7fe9e1a6ee78)', 2) called at /usr/local/airwave/lib/perl/Mercury/Daemon/ServiceWatcher.pm line 275 Mercury::Daemon::ServiceWatcher::check_services('Mercury::Daemon::ServiceWatcher=HASH(0x7fea438d30b0)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/ServiceWatcher.pm line 184 Mercury::Daemon::ServiceWatcher::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Utility.pm line 175 eval {...} called at /usr/local/airwave/lib/perl/Mercury/Utility.pm line 175 Mercury::Utility::safe_eval('CODE(0x7fea43b96cf8)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/ServiceWatcher.pm line 185 Mercury::Daemon::ServiceWatcher::main('Mercury::Daemon::ServiceWatcher=HASH(0x7fea438d30b0)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Base.pm line 171 Mercury::Daemon::Base::go('Mercury::Daemon::AsyncLoggerClient=HASH(0x7fea43c9af88)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/Forkable.pm line 51 Mercury::Daemon::Service::Forkable::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Utility/Processes.pm line 127 Mercury::Utility::Processes::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Utility/Processes.pm line 83 Mercury::Utility::Processes::fork_and_run('CODE(0x7fea43cd7418)') called at /usr/local/airwave/lib/perl/Mercury/Utility/Processes.pm line 129 Mercury::Utility::Processes::fork_and_run_detached('CODE(0x7fea43a06f08)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/Forkable.pm line 53 Mercury::Daemon::Service::Forkable::_restart('Mercury::Daemon::Service::AsyncLoggerClient=HASH(0x7fe9e1a6ee78)', 1) called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/MultiForkable.pm line 27 Mercury::Daemon::Service::MultiForkable::_restart('Mercury::Daemon::Service::AsyncLoggerClient=HASH(0x7fe9e1a6ee78)', 1) called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/AsyncLoggerClient.pm line 115 Mercury::Daemon::Service::AsyncLoggerClient::_restart('Mercury::Daemon::Service::AsyncLoggerClient=HASH(0x7fe9e1a6ee78)', 2) called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service.pm line 90 Mercury::Daemon::Service::restart('Mercury::Daemon::Service::AsyncLoggerClient=HASH(0x7fe9e1a6ee78)', 2) called at /usr/local/airwave/lib/perl/Mercury/Daemon/ServiceWatcher.pm line 275 Mercury::Daemon::ServiceWatcher::check_services('Mercury::Daemon::ServiceWatcher=HASH(0x7fea438d30b0)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/ServiceWatcher.pm line 184 Mercury::Daemon::ServiceWatcher::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Utility.pm line 175 eval {...} called at /usr/local/airwave/lib/perl/Mercury/Utility.pm line 175 Mercury::Utility::safe_eval('CODE(0x7fea43b96cf8)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/ServiceWatcher.pm line 185 Mercury::Daemon::ServiceWatcher::main('Mercury::Daemon::ServiceWatcher=HASH(0x7fea438d30b0)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Base.pm line 171 Mercury::Daemon::Base::go('Mercury::Daemon::ServiceWatcher=HASH(0x7fea438d30b0)') called at /etc/httpd/conf/bootstrap.pl line 102 eval {...} called at /etc/httpd/conf/bootstrap.pl line 101 main::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Utility/Processes.pm line 83 Mercury::Utility::Processes::fork_and_run('CODE(0x7fe9e0d918d8)') called at /etc/httpd/conf/bootstrap.pl line 111 require /etc/httpd/conf/bootstrap.pl called at (eval 2) line 1 eval 'require q^@/etc/httpd/conf/bootstrap.pl^@ ;' called at /etc/httpd/conf/bootstrap.pl line 0

    in httpd

     

    few of those 

     

    Spoiler
    /bin/df: `/var/lib/pgsql/pg_stats_temp': Permission denied QPixmap: Cannot create a QPixmap when no GUI is being used

     

    and many more permision related errors

     

    Spoiler
    cannot unlink file for /var/airwave/graphs/87/channel_busy_combined_9.png: Permission denied at /opt/airwave/lib/perl5/5.10.1/File/Path.pm line 57
    File::Path::_error('HASH(0x7fea468f5528)', 'cannot unlink file', '/var/airwave/graphs/87/channel_busy_combined_9.png') called at /opt/airwave/lib/perl5/5.10.1/File/Path.pm line 395
    File::Path::_rmtree('HASH(0x7fea468f5528)', 'ARRAY(0x7fe9d044c910)') called at /opt/airwave/lib/perl5/5.10.1/File/Path.pm line 322
    File::Path::_rmtree('HASH(0x7fea468f5468)', 'ARRAY(0x7fea46021318)') called at /opt/airwave/lib/perl5/5.10.1/File/Path.pm line 220
    File::Path::rmtree('/var/airwave/graphs/87/') called at /usr/local/airwave/lib/perl/Mercury/Reports/RFHealth.pm line 325
    Mercury::Reports::RFHealth::clean_up_pickled_data('Mercury::Reports::RFHealth=HASH(0x7fea46021378)') called at /usr/local/airwave/lib/perl/Mercury/Reports/CustomBase.pm line 76
    Mercury::Reports::CustomBase::__ANON__('Mercury::Reports::RFHealth=HASH(0x7fea46021378)') called at /usr/local/airwave/lib/perl/Mercury/DB/Report.pm line 168
    Mercury::DB::Report::delegate_to_report_obj('Mercury::Reports::Custom=HASH(0x7fea45ff3d60)', 'Mercury::Reports::RFHealth', 'CODE(0x7fea32e2cd60)') called at /usr/local/airwave/lib/perl/Mercury/Reports/CustomBase.pm line 77
    Mercury::Reports::CustomBase::clean_up_pickled_data('Mercury::Reports::Custom=HASH(0x7fea45ff3d60)') called at /usr/local/airwave/lib/perl/Mercury/DB/Report.pm line 510
    Mercury::DB::Report::delete('Mercury::Reports::Custom=HASH(0x7fea45ff3d60)') called at /usr/local/airwave/lib/perl/Mercury/DB/Report.pm line 493
    Mercury::DB::Report::delete_for_handler('Mercury::Reports::Custom=HASH(0x7fea45ff3d60)') called at /usr/local/airwave/lib/perl/Mercury/DB/NewConfig.pm line 766
    Mercury::DB::NewConfig::__ANON__('post_perl') called at /usr/local/airwave/lib/perl/Mercury/DB/NewConfig.pm line 801
    Mercury::DB::NewConfig::execute('Mercury::DB::NewConfig=HASH(0x7fea4413ce20)') called at /usr/local/airwave/lib/perl/Mercury/APConfig.pm line 34
    Mercury::APConfig::apply('Mercury::APConfig', 'ARRAY(0x7fe9eb4afe00)', 'Mercury::DB::NewConfig=HASH(0x7fea4413ce20)', 'HASH(0x7fe9eb4af038)') called at /usr/local/airwave/lib/perl/Mercury/ScheduledEvent/Edit.pm line 99
    Mercury::ScheduledEvent::Edit::_execute('Mercury::ScheduledEvent::Edit=HASH(0x7fea4413d090)') called at /usr/local/airwave/lib/perl/Mercury/ScheduledEvent/Base.pm line 33
    eval {...} called at /usr/local/airwave/lib/perl/Mercury/ScheduledEvent/Base.pm line 33
    Mercury::ScheduledEvent::Base::execute('Mercury::ScheduledEvent::Edit=HASH(0x7fea4413d090)') called at /usr/local/airwave/lib/perl/Mercury/ScheduledEvent.pm line 92
    Mercury::ScheduledEvent::execute_now('Mercury::ScheduledEvent', 'type', 13, 'target_id', 15248) called at /usr/local/airwave/lib/perl/Mercury/Handler/ChangeSetConfirm.pm line 279
    Mercury::Handler::ChangeSetConfirm::execute_new_configs('Mercury::Handler::ChangeSetConfirm=HASH(0x7fea46568da8)', 'Mercury::DB::NewConfig=HASH(0x7fea4668e590)') called at /usr/local/airwave/lib/perl/Mercury/Handler/ChangeSetConfirm.pm line 201
    Mercury::Handler::ChangeSetConfirm::_execute('Mercury::Handler::ChangeSetConfirm=HASH(0x7fea46568da8)', 'Mercury::Apache::Request=HASH(0x7fea45d6a860)') called at /usr/local/airwave/lib/perl/Mercury/Handler/View.pm line 373
    Mercury::Handler::View::execute('Mercury::Handler::ChangeSetConfirm=HASH(0x7fea46568da8)', 'Mercury::Apache::Request=HASH(0x7fea45d6a860)') called at /usr/local/airwave/lib/perl/Mercury/Handler/View.pm line 69
    Mercury::Handler::View::build_output('Mercury::Handler::ChangeSetConfirm=HASH(0x7fea46568da8)', 'Mercury::Apache::Request=HASH(0x7fea45d6a860)') called at /usr/local/airwave/lib/perl/Mercury/Handler/Dispatcher.pm line 172
    Mercury::Handler::Dispatcher::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Handler/Dispatcher.pm line 178
    Mercury::Handler::Dispatcher::call_handler('Mercury::Handler::Dispatcher', 'Mercury::Handler::ChangeSetConfirm=HASH(0x7fea46568da8)', 'Mercury::Apache::Request=HASH(0x7fea45d6a860)') called at /usr/local/airwave/lib/perl/Mercury/Handler/Dispatcher.pm line 76
    Mercury::Handler::Dispatcher::handler('Mercury::Handler::Dispatcher', 'Apache2::RequestRec=SCALAR(0x7fea45fe54d0)') called at -e line 0
    eval {...} called at -e line 0