Wireless Access

 View Only
Expand all | Collapse all

hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

This thread has been viewed 808 times
  • 1.  hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 19, 2024 05:07 PM

    Really scratching my head here and wondering if it is me who lost it completely. Not sure yet if the issue is also showing in AOS10 but I will find that out in a couple of days.

    I notice intermittent hiccups in teams calling, SSH sessions (Linux guys), etc. since we upgraded to the latest AOS8 release. And I am really wondering why the internet is not on fire. No mentions in Airheads, a few in Reddit but not related to the AP505's we have, only in the 6xx series. So it must be me....  ?

    We have around 400 AP's running on different sites. A lot of them are AOS10. But we also have around 150 AOS8 AP's spread over multiple sites. All running fine until last week.

    Due to the CVS that came out, we decided to upgrade to 8.10.0.14, latest LSR. Next day we received some strange notifications. Teams audio and video freeze for around 3 seconds every couple of minutes. Really annoying. We first thought the issues were firewall or Teams related but that was not the case. We patched a laptop directly in the client VLAN which is also used by the SSID and the laptop didn't have any issues. 

    We started a teams call with our internal network team to do some sniffing, checking, etc and every time we yelled "Freeze" the Linux guys shouted the same. They are using ssh to their Linux servers and when we have frozen screens, they didn't get any character echo on their screen. After a 3 sec freeze period, the characters appeared (probably TCP retransmit) and the Teams video came back.

    We had this on different sites. Upgrading to the last SSR software version gave the same result. It was solved after we went back to an older software version.

    We are running mostly on 505's. What am I missing here.... what is going on... why does it look that I am the only one having this issue (ok, this morning I college of another company mentioned he had the same issue but that is only one.....)

    I have tried the search button in this forum. Tried reddit as well. Really can't find anything related to this issue. You really notice a 3 second freeze... why is it only me.... :-)

    Cheers,

    Dennis



  • 2.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 20, 2024 11:26 AM

    Have you opened a case with TAC?



    ------------------------------
    Carson Hulcher, ACEX#110
    ------------------------------



  • 3.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 22, 2024 08:45 AM

    Hi Chulchur,

    Thanks for your reply. And ofcource it is best path to follow. Yet, our experience with Aruba TAC hasn't been that great compared to the answers I sometimes get from Reddit or the airheads community. I will sure open a TAC case soon. Wednesday, I noticed the exact same issue with AOS10 on our 505's.  Even after a reboot, the issues were very visible. So I went back to 10.4.1.4. and my customer was very happy. I am trying to build a case here with reproducable findings. 

    Again, you are 100% right with your answer but I am very afraid the case might end with up me spending hours with TAC on wireshark and Ekahau sniffing.... on the other hand, already doing that... :-)




  • 4.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 21, 2024 09:22 AM

    I can just say that we are running on 8.12.0.3 for two weeks now, and are facing no issues like you describe.

    We are using 515 and 635 APs.




  • 5.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 22, 2024 08:53 AM

    Hi MPieter, Thanks for your reply. I really can't put the finger on the problem. I have lot's of 505's and a view 515's. All with the same issue. Meanwhile, I found others having the same issue with 515's. So I am not the only one. Yet, why is it that you have no issues at all. What is the difference between your configuration and mine. Do you use airslice or other fancy stuff because that is what I find in three year old postings. Do I have a combination of confguration options that might cause this bug to appear this way and not on your site becasue you haven't enabled a certain option  :-)

    I am trying a clean install in my lab now and will enable/disable some options. hopefully I find the spark that creates my fire.... 

    Again, thanks for your reply. Everything helps.




  • 6.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 21, 2024 02:56 PM

    We are experiencing the same issue. We upgraded  from 8.10.0.12 to 8.10.0.14 because of a CVE. We have clients getting pingdrops to their gateway and skype audio / video freezes. 




  • 7.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 21, 2024 04:48 PM

    just note that 8.10.0.15 is now available. check the release notes.



    ------------------------------
    If my post was useful accept solution and/or give kudos.
    Any opinions expressed here are solely my own and not necessarily that of HPE or Aruba.
    ------------------------------



  • 8.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 22, 2024 08:28 AM

    Thanks Ariyab, Will do that and also upgrade the lab environment. 

    Thanks for the notification! Most appriciated.




  • 9.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 29, 2024 02:49 AM

    Hi Dennis,

    We have been experiencing the same issue on our 515's ever since upgrading from 8.10.0.12 to 8.10.0.13. It was noticeable in Zoom/Teams meetings, SSH connections and RDP sessions. I was running some pings and could see latency go through the roof for short periods of time. Its enough for the user to notice a pause in Zoom/Teams meeting.


    I tried upgrading to 8.10.0.14 but it didn't resolve it. I also had a TAC case open about it but didn't have a great experience with them. So I downgraded to 8.10.0.12 last night and it is looking stable again. 

    Does anyone know if 8.10.0.15 resolves this? I had a quick look at the release notes but not sure which bug ID addresses this issue. 

    Thanks,
    James




  • 10.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Nov 29, 2024 04:01 AM

    8.10.0.15 did not solve the issue in our case. 




  • 11.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 02, 2024 10:31 AM

    Asking again, has a case been opened on this issue by anyone?  If you aren't getting traction with TAC, request escalation.  Please share your case number here if you have one.



    ------------------------------
    Carson Hulcher, ACEX#110
    ------------------------------



  • 12.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 02, 2024 10:53 AM

    we have the same issue in the UK - Teams freezing 1-2 secs after upgrade to 8.10.0.14 on AP505. We have a TAC open 5386398850. 

    U/G to 8.10.0.15 did not work. Trying a couple of other suggestions this evening. Our Nordic division is also experiencing this issue. They rolled a site back to 13 and this has been positive, but not what we should have to do.




  • 13.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 03, 2024 05:56 PM

    Our TAC case number is 5386541009




  • 14.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 23, 2024 11:55 AM

    Experiencing the exact symptoms as others. Our case has been open for over a month. Best workarounds offered by TAC have been to disable Mimo/HE and Airslice, and try upgrading to 8.10.0.15. None of these have resolved the issue. Escalation does not seem to improve internal team response.

    Case #: 5385919186




  • 15.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 03, 2024 05:04 AM

    I´m seeing similar latency peeks (running 8.12.0.3 on AP-53x, AP-55x, AP-6xx). We started rebooting the access points nightly which helps.




  • 16.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 05, 2024 08:55 AM

    We have a very long (1,5years) history with massive issues on the 8.10.X releases with our 51X AP's and we are therefore still using 8.6.X because 8.10 is unusable for us. The issue (basically OFDMA related) should be fixed with the .14 release but we still had similar but no similar issues after trying that. Our 635 AP's however were always rock solid in comparison. We even disabled OFDMA entirely without success. 

    Weird to say but we would be happy if this is another issue that will be fixed soon(tm).

    @chulcher Our case: 5385512561




  • 17.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 09, 2024 06:14 PM

    I've had an update on my case and Aruba seem to be tracking this under bug ID AOS-260495. The status is still 'Unresolved' but hopefully they release a fix soon.




  • 18.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 14, 2025 09:33 AM

    "I've had an update on my case and Aruba seem to be tracking this under bug ID AOS-260495. The status is still 'Unresolved' but hopefully they release a fix soon"

    Hi James

    Can you tell me if you resolved this and if so how (upgrade to 8.10.0.16?)?

    Thank you

    Jeff Johnston



    ------------------------------
    Jeff Johnston
    ------------------------------



  • 19.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 12, 2024 08:24 AM

    Anyone experiencing the issue care to mention if they have CPSec enabled?



    ------------------------------
    Thomas G - ACCX#1172
    ------------------------------



  • 20.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 16, 2024 03:24 AM
    Edited by dvdwulp1970 Dec 16, 2024 03:24 AM

    Both my AOS8 and AOS10 Access Points are managed by Central. I am not using any physical controller. Only the VC on AOS8 and Aruba Central on AOS10. 

    Dennis




  • 21.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 23, 2024 11:55 AM

    Holy cow, I wish I would have checked the airheads community a month ago when all this started. If anything to just alleviate the notion that I was going crazy. 
    Case: 5385919186

    Having the exact same issue here. Swarm with 505s and 515s. Behavior that seems like teams (and other video calls) drop out for 2-5 seconds at a time only to reconnect like nothing happened. I have had a TAC case opened for this for over a month. The best they've asked us to do is 
    1.) Disable Mimo and HE
    2.) Disable Airslice
    Neither of these fixed the issue.

    Last contact with TAC had us upgrade to 8.10.0.15. This also did not fix the issue based on preliminary testing.

    I have been able to reproduce the issue with some small measure of reliability. (not 100%). Below is what I can glean.

    The issue only affects users who are on the same AP, on the same SSID, and the same Channel. The issue seems to occur when a host roams or connects to the AP, and affects all clients who share the above criteria. I have been able to set up a monitor host constantly pinging and a "test host" to keep disconnecting and reconnecting. I forced them onto 2.4 via driver selection to reduce some risk of the host connecting to 5Ghz and negating my testing. I still have to fight with the host roaming to nearby APs. However, when I disconnect the host, then clear it from the virtual controllers client list (disconnect-user mac [mac address]) and then reconnect, I can frequently trigger the issue to occur. Again, it's not every time, but with enough reliability to surmise that client association is related. 

    Has anyone found a solution, or do we just need to jump tracks to 8.12 ?
    I'm going to send this thread to my Aruba technician. Maybe the other TAC case numbers here will help them consolidate some efforts. However, I agree @dvdwulp1970. How is the internet not on fire with this? While the issue is at least annoying, when experienced at scale it is enormously disruptive. Especially to executives and sales departments when trying to conduct presentations or business meetings where you can't keep saying "Oh sorry, can you repeat that? I lost you for 5 seconds there."




  • 22.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Dec 27, 2024 02:48 AM

    Meanwhile, more and more companies seem to suffer from this issue. What puzzles me most is that this issue occurred on all new releases. Latest LSR on AOS8 and AOS10. Latest SSR on AOS8 and AOS10. On Dec the 19th Aruba released a new AOS10 version that I immediately uploaded to my lab environment in the office. I only had a few teams calls and the utilisation of the wifi was very low due to Christmas. I didn't notice any hickup but I am not 100% convinced as I was the only person connected to the lab. And the Release notes do not give me any sign that this issue is recognized and solved.  My best advice at the moment is to downgrade to your previous release and make sure you have some workaround for the CVE. 

    All the best to you all for 2025!!!!




  • 23.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 11, 2025 12:25 PM

    Adding my experience with this issue.  Aruba TAC Case: 5386828346 

    I have several Aruba Instant controllerless networks. All APs are 325s and 515s. All are on the 8.10 branch of ArubaInstant firmware and managed locally with a Virtual Controller.

    What I have found in my testing about behavior during the issue/hiccup/freeze/stutter/lag/stun

    • Wireless clients receive no traffic for period of time (up to about 5 seconds). Packet captures on wireless clients show this.
    • Traffic to all clients on an AP are affected at the same time.
    • Traffic from wired source does reach the AP but does not get delivered to the wireless client.  Packet captures on the AP uplink port show this.
    • Traffic from wireless client to wired destination does reach the wire. However, the return traffic is affected. Packet captures on the AP uplink port show this.
    • Traffic from wireless client to wireless client is affected.
    • Traffic to AP mgmt IP is not affected.
    • 1 AP has the issue at a time.
    • Only affects our 515 APs.
    • Happens in multiple locations where 515s are deployed.
    • The issue is triggered for all clients on an AP when a device connects to the AP. But not every time a device connects to the AP. It is unknown why some times this triggers the issue.

    The issue is believed to have started for us with 8.10.0.14 and continued with 8.10.0.15.  Downgrading to 8.10.0.13 has fixed the issue, but I don't consider that a permanent solution.




  • 24.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Feb 05, 2025 10:06 AM

    I got this update from TAC.  The "TAF_PSQ_PULL" feature was introduced in version 8.10.0.14 and is suspected as the cause of the problem.  The feature is not clear from the name, but my guess is this is some sort of QoS feature.




  • 25.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Feb 05, 2025 10:18 AM

    The feature is actually related to handling of packets for clients using power save and was enabled to resolve a different issue that was observed.



    ------------------------------
    Carson Hulcher, ACEX#110
    ------------------------------



  • 26.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 13, 2025 09:56 AM
    Edited by fetict Jan 13, 2025 09:57 AM

    I can also confirm i see this on 503/ 515 / 635 running 8.12.0.2. gone back to 8.10.0.7 (8 - 12 have miracast issues)




  • 27.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 28, 2025 03:22 PM

    Bumping for visibility but also an update

    Can Confirm that Central managed 505 and 515 APs rolled back to 8.10.0.13 do NOT exhibit the issue. We have been running this version for a week and have experienced significant improvement. I haven't heard a single report of the issue since we moved back. NOTE: There are vulnerabilities associated with this version that require remediation. Act accordingly.

    Lastly, I've been speaking with our TAC engineer and it does not seem like they have been able to isolate, identify, or seemingly reproduce the issue. They have asked me on several occasions to reproduce the issue and submit logs repeatedly. I've provided as much support as I can. Frankly it concerns me that the internal team has seemingly been unable to reproduce the issue. It almost feels like a lack of effort, honestly.

    -Mux




  • 28.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 28, 2025 03:44 PM

    I can state that TAC, Engineering, and QA are all working on identifying the root issue for what is happening, but those efforts aren't always straightforward or quick.  If you feel that your particular case isn't being handled appropriately, please escalate with TAC and make sure that your account team is aware (point them at this thread) of the issues you are facing.



    ------------------------------
    Carson Hulcher, ACEX#110
    ------------------------------



  • 29.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 29, 2025 03:39 AM

    Hi Carson,

    Thanks for the heads up. What bothers me most is that not everybody has this problem. This gives me the feeling that it only happens when certain configuration items are configured. I have been enabling/diaabling some configuration features without any improvement. Note that the issue also occurs in 10.4.1.6_91521. I was the only user connected with my lab and my Teams video calling was a very bad quality. It really looks like buffering issues. My AP was not high utilised. 

    My AP's are connected with Aruba 2930F switches. But somehow I doubt that the issue is on the wired site.

    As soon as I have more info I will share that immediately. 

    Dennis




  • 30.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 29, 2025 04:06 AM

    Hey Dennis,

    Are you experiencing this issue on a Tunnel-SSID (controller) or Bridge-SSID (IAP/standalone) deployment?

    BR

    Thomas



    ------------------------------
    Thomas G - ACCX#1172
    ------------------------------



  • 31.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 29, 2025 04:56 AM

    Hi Thomas,

     

    Bridge-SSID. 😊

     

    AOS8 and AOS10, both managed via Central (MSP).

     

    Best regards,

    Dennis

     

     






  • 32.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 29, 2025 01:08 PM

    I see this listed as neither a Known nor Resolved issue in the release notes for 8.12.0.4.  Has anyone documented this as happening on 8.12.0.3?  It's mentioned in the thread title, but not discussed in the body.

    I've kept my Instant cluster on 8.6.0.9 after problems with later firmware when this was deployed in 2021, and that build is reliable and drama-free.  I will not be rolling the dice on "my Teams call freezes for 10 seconds" tickets because we changed out reliable firmware.




  • 33.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 31, 2025 05:58 AM

    Hi Dennis,

    we face this issue only on 635ap with 8.12.0.3 (central) and 8.10.0.15 (controller). Other APs (515) do not have this kind of hickups with same global config.

    Any downgrade has not helped. 

    TAC is clueless. 

    Best regards,

    Sebastian




  • 34.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Jan 30, 2025 12:26 AM

    Can you confirm what version of firmware you are running on your 2930F. There were a number of performance issues with versions less than WC.16.11.0016 plus a number of security problems.




  • 35.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 10, 2025 11:00 AM

    Version 8.10.0.16 was released a few days ago and should include the fix even though it's not mentioned anywhere in the release notes. Did anyone already install this version and can report if the fix is working properly?
    We plan to install it next week.




  • 36.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 10, 2025 11:11 AM

    Covered under bug AOS-262403.

    https://arubanetworking.hpe.com/techdocs/ArubaOS/Consolidated_8.x_RN/Content/8.10/16/resolved_8.10.0.16.htm



    ------------------------------
    Carson Hulcher, ACEX#110
    ------------------------------



  • 37.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 10, 2025 11:24 AM

    There's no mention of AOS-262403 or AOS-260495 (previously mentioned in this thread) in the "Aruba Instant 8.10.0.16 Release Notes".  Is that a concern for Instant users?




  • 38.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 10, 2025 11:42 AM

    Still trying to figure out what the status is on IAP.



    ------------------------------
    Carson Hulcher, ACEX#110
    ------------------------------



  • 39.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 10, 2025 02:50 PM

    Confirmed, this was a miss on the release notes and is being resolved.  8.10.0.16 includes the fix on IAP.



    ------------------------------
    Carson Hulcher, ACEX#110
    ------------------------------



  • 40.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 10, 2025 03:24 PM

    My Aruba Instant wants to auto update to "New Version available 8.12.0.4-8.12.0.4_91755"

    Is this traffic dropping fix confirmed to be present in the latest of the 8.12 family?




  • 41.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 10, 2025 03:39 PM

    No, available with 8.12.0.5.

    8.12.0.4 was released in January.



    ------------------------------
    Carson Hulcher, ACEX#110
    ------------------------------



  • 42.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 14, 2025 04:03 AM

    We have updated one of our locations Aruba 515 to 8.10.0.16. I'm not sure yet if this solved our meeting issues. Can anyone confirm that after updating to 8.10.0.16 those meeting issues have been resolved?

    best regards,

    Michael




  • 43.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 28, 2025 05:59 AM

    Hi, we experience the same problems in 8.10.0.16 as in 8.10.0.14




  • 44.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 28, 2025 05:59 AM

    So glad I stumbled on this forum post. I've been troubleshooting this for over a month, with upper management breathing down my neck every day to get this fixed. I just updated to 8.10.0.16 and restarted monitoring. Exact same issues the rest of you described. Teams hiccups and ping loss of 1-5 requests, followed by a single latency spike, then it works fine for 5-20 minutes. Not isolated to a single AP (all AP-515). Randomly drops across APs. 

    In my 1-hour initial testing on 8.10.0.16, I'm still seeing request timeouts both to our core switch and the AP direct. Testing on two different laptops to two different APs. Active ticket 5388759123. I haven't seen anything more than a single ping timeout yet - it's the 3-5 timeouts in a row that really affect everyone. So far, it appears improved, but a 24-hour test will reveal the truth. 

    Side note, we've also been experiencing EAP issues, and I see there's some resolution there. Will test this as well. 




  • 45.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 17, 2025 05:55 AM

    I just updated the firmware in our lab to 10.4.1.7. After reading the release notes, I noticed a lot of WPA3 improvements and also the bug-id AOS-262403 looks resolved. Our team of 10 people are always connected to our lab environment so we can test the new release.

    Regarding the WPA3 issues, I had other open tickets at Tac regarding the roaming with WPA3-Personal clients where Central reported a lot of PMKID errors. 

    fingers crossed! Keep you posted!

    Dennis



    ------------------------------
    dvdwulp1970
    Netherlands
    ------------------------------



  • 46.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 17, 2025 06:19 AM

    Hi Dennis,

    We have upgraded our 515 APs to 8.10.0.16. The first tests look good. 

    Michael




  • 47.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 17, 2025 06:27 AM

    Thanks for sharing! I thought we had all customers running on AOS10 but we still have one running on AOS8.

    I'll inform the team about your findings.

    Dennis



    ------------------------------
    dvdwulp1970
    Netherlands
    ------------------------------



  • 48.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 24, 2025 09:58 AM

    We installed 8.10.0.16 one week ago and calls etc. are stable on our 51X again. There were holidays in Germany last week so we will continue to verify this week with higher/regular load on the AP's. But we are confident that all issues are resolved now.




  • 49.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 24, 2025 10:48 AM

    Thanks for the feedback. We are still testing the 10.4.1.7 (AOS10) version and that also looks great.



    ------------------------------
    dvdwulp1970
    Netherlands
    ------------------------------



  • 50.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 28, 2025 08:23 PM
    Edited by Pretty_Fly_for_a _WiFi Mar 28, 2025 08:23 PM

    Dennis,

    What's the final verdict on 10.4.1.7 in your environment?  Any sporadic issues?




  • 51.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 04, 2025 01:50 AM

    Hi Dennis - whats your experience with 10.4.1.7 after testing it for 10 days?

    One of our customers have the same issue with 10.4.1.6 (Teams Meetings timeouts for 5-6 seconds) - now after update to 10.4.1.7 the timeouts are shorter (1-3 seconds) but they are still there.

    Thanks for your feedback.




  • 52.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 07, 2025 04:13 AM
    Well, to be honest, I don't know. My own experience is pretty well but a colleage still had issues like you described.
    My AX201 drivers are up2date and his are a little outdated.
    I am running a constant ping right now during teams calls and that looks much better than the previous AOS version when I opened this thread.

    I have a customer who is really very cooperative in this investigation, and he also had, besides the hickup, roaming issues on a WPA3-Personal  based network. Advised by TAC, we upgraded  to AOS10.6.0.3_90581. (Other TAC case). And that gives him a stable environment. No hickup's, good roaming. 

    I just checked central and noticed that my AOS10.4.1.7 AP's in my lab are advised to upgrade to 10.6.0.3... What surprises me as this version is not LSR...
    I will test that later this week.... 









  • 53.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 27, 2025 05:55 AM

    We did the upgrade last night to  8.10.0.16 but it is still very buggy. Same as the old bug: Remote desktop sessions disconnect every 10/15 minutes on all clients. 

    Go back to 8.12.0.2 what was a lot more stable.




  • 54.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 27, 2025 09:04 AM

    Do you have any other problems besides your Remote Desktop issue after you upgraded?  



    ------------------------------
    Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.

    HPE Design and Deploy Guides: https://community.arubanetworks.com/support/migrated-knowledge-base?attachments=&communitykey=dcc83c62-1a3a-4dd8-94dc-92968ea6fff1&pageindex=0&pagesize=12&search=&sort=most_recent&viewtype=card
    ------------------------------



  • 55.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 27, 2025 09:53 AM

    Sorry, we downgraded very fast to keep the customer happy. After reverting back to 8.12.0.2 everything was stable again. 




  • 56.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 27, 2025 04:00 PM

    Hi! I saw that you installed version 8.10.0.16 and initially everything seemed stable on the 51X. After a week of regular load, have the issues been fully resolved?

    I'm asking because I upgraded an environment from 8.10.0.14 to 8.10.0.16, but we are still experiencing issues with MS Teams on Aruba 50X APs. Have you or your team noticed anything similar?




  • 57.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 27, 2025 04:25 PM

    I have to admin that it does not run as perfect as the old version we used. Because of other issues with OFDMA (starting with 8.10) we are comparing version 8.6.0.24 to 8.10.0.16 (all other 8.10 versions were unusable). 
    We currently see very, very few issues with Teams calls etc. but they are still there. Like 1-2 times a day we still see very high latency spikes (>1000ms) which sometimes causes real hickups during calls. Never had a single problem with the mentioned 8.6 release. We may try to do a real stress next week test to validate if we can reproduce the issue with load or not. If yes, we will tell Aruba that the case is not resolved and probably never will (we have around 1,5 years of trouble with the 51X AP's). If we can't reproduce it we will probably live with it and hope we can replace the AP's this year as this is clearly a hardware issue (no problems with 635 AP's)

    Will post an update if there is anything new.




  • 58.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 27, 2025 04:57 PM

    s, actually, as mentioned in a previous comment, at some point the station would stop receiving data over the radio for about 5 seconds. However, in terms of AP management and LAN network, everything is fine-it continues to receive data.

    Now, with version 8.10.0.16, it is possible that this issue is still not fully resolved, and we may have to revert to 8.10.0.13.

    For this reason, I raised the question above to understand how the operation is in other environments and whether the issue has truly been fixed.

    Thank you!




  • 59.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 27, 2025 05:34 PM

    @gramallama,

    Two questions:

    Do you have a case open currently?

    Do you have client-side QOS configured for Ms Teams in your environment? https://learn.microsoft.com/en-us/microsoftteams/qos-in-teams



    ------------------------------
    Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.

    HPE Design and Deploy Guides: https://community.arubanetworks.com/support/migrated-knowledge-base?attachments=&communitykey=dcc83c62-1a3a-4dd8-94dc-92968ea6fff1&pageindex=0&pagesize=12&search=&sort=most_recent&viewtype=card
    ------------------------------



  • 60.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 27, 2025 06:01 PM

    Well, the case is not open anymore...was closed once we got an ETA on 8.10.0.16 - here is the case number 5385512561
    Regarding QoS: Nothing special on the client side. Together with Aruba we however enabled the DPI feature a while ago which should help quite a bit according to different engineers.

    We are also in close contact with our SE and sales representative. As said, we will try to do some sort of stress test next week. We have the update for 1,5 weeks now without needing to do a rollback so...yeah. But still something is ****** with the hardware/chipset I guess.




  • 61.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 30, 2025 03:00 PM

    Hello all!

    Me too with Teams/Zoom/Webex etc being impacted after .14 version and in my case is a dropof packets to the client device up to 4 seconds (04 time outs icmp). Updated the dozens of 505 APs last friday and waiting the users came to office to see the outcome and get back to the TAC.




  • 62.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 30, 2025 03:25 PM

    Do you have a tac case #?



    ------------------------------
    Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.

    HPE Design and Deploy Guides: https://community.arubanetworks.com/support/migrated-knowledge-base?attachments=&communitykey=dcc83c62-1a3a-4dd8-94dc-92968ea6fff1&pageindex=0&pagesize=12&search=&sort=most_recent&viewtype=card
    ------------------------------



  • 63.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Mar 30, 2025 03:28 PM

    Yes, the case is: 5388720806




  • 64.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 01, 2025 08:22 AM

    We have also enable DPI. Still i get issues with google meet specially on macbooks.




  • 65.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 01, 2025 08:26 AM

    @Miru,

    Do you have a TAC case open?



    ------------------------------
    Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.

    HPE Design and Deploy Guides: https://community.arubanetworks.com/support/migrated-knowledge-base?attachments=&communitykey=dcc83c62-1a3a-4dd8-94dc-92968ea6fff1&pageindex=0&pagesize=12&search=&sort=most_recent&viewtype=card
    ------------------------------



  • 66.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 01, 2025 08:38 AM

    Yes CASE 5388930093




  • 67.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 01, 2025 08:49 AM

    @Miru,

    I see the case has been opened.  Please continue to work with TAC so they can obtain your information to determine if your issues are general or specific.

    I will say that DPI can help classify and possibly prioritize from the access point to the client, but it is not a silver bullet.  Let us see what TAC can find out.



    ------------------------------
    Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.

    HPE Design and Deploy Guides: https://community.arubanetworks.com/support/migrated-knowledge-base?attachments=&communitykey=dcc83c62-1a3a-4dd8-94dc-92968ea6fff1&pageindex=0&pagesize=12&search=&sort=most_recent&viewtype=card
    ------------------------------



  • 68.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 02, 2025 07:53 AM

    I'm planning to go from 8.12.0.2 to 8.10.0.16 to check whether the situation is more stable than on 8.10.0.14. Is there anything special I have to care about when downgrading to 8.10.0.16 on a Mobility Cluster?




  • 69.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 03, 2025 05:55 AM

    I've downgraded to 8.10.0.16, it seems more stable but still hickups in teams. If i only remember what the firmware version was b4 all the unstableness :)




  • 70.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 03, 2025 10:06 AM

    @Dennis From watching this thread, I upgraded our Aruba Instant cluster to 8.10.0.12, and have had zero reports of the latency spikes that interrupt pings and Teams calls.  It's a safe harbor in my experience; 8 500 series running .ax, and a straggler 303H




  • 71.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 03, 2025 10:25 AM
    Edited by wgalway Apr 03, 2025 10:26 AM

    I know this version has some security issues, but after reading the release notes of some of the later versions I decided to risk it for the biscuit. This thread confirms my concerns with the later changes. We do lots of Zoom and Teams here and no widespread complaints.
    Aruba Operating System Software.
    ArubaMM-VA
    8.10.0.10 LSR




  • 72.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 03, 2025 10:35 AM

    If I have to choose between an endless stream of user frustration and tickets because videoconferencing is commonly interrupted vs the very small possibility of someone qualified, motivated and in proximity leveraging the security flaws to their advantage, I'll take my risks with the security holes.  Teams and Zoom video while mobile isn't a luxury or edge case, it's baseline.




  • 73.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 03, 2025 02:42 AM

    Infra: 330 Aruba AP-505  - Current firmware: 8.10.0.16

    Hello,

    I'm adding my experience here along with a workaround I discovered yesterday. For some time now, I've noticed Wi-Fi instability, which manifests as poor-quality Teams calls. My baseline observation involves running a continuous ping to a local resource. I sometimes notice that the ping suddenly becomes unstable, regularly exceeding 100ms, sometimes even reaching 2 seconds, with occasional timeouts. This situation resolves itself after a while or by roaming to another Wi-Fi access point, or by disconnecting and reconnecting to the Wi-Fi.

    However, yesterday I noticed that if I forced my machine to use Wi-Fi "ac" instead of the default "ax," when the bad ping occurred on other laptops, the clients using Wi-Fi AC had no issues. (My 3 test machines-Dell and HP-have an Intel AX211 Wi-Fi adapter.)

    I have a ticket opened for several weeks with HP, to analyse this issue. They informed me yesterday they will try to reproduce it in lab.

    Regards

    LG




  • 74.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 03, 2025 03:00 AM

    Your response about your Intel cards AX211 cards got me to wondering if your network card drivers needed patching. A couple of year back, Intel were experience enormous problems with their WiFi6 cards. This issue stopped a good number of people to be unable to access full WiFi6 services. It's always worth patching with Intel drivers for wireless cards (they seem to patch regularly). I'm not a fan of the standard Windows driver - Microsoft seems to use elderly and sometimes out of date drivers) so it's worth investigating the device driver avenue first before determining it really is an Aruba firmware issue.




  • 75.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 03, 2025 03:31 AM

    I had also explored this workaround previously. My initial driver (adapter intel AX211) was version 23.90 -> Wi-Fi issues were observed with this version. I installed the latest driver available from Intel (23.120) on 2 Dell laptops, while one of my colleagues remained on version 23.100 on his laptop (HP laptop, but also ax211 adapter). The issue persists on the "ax" Wi-Fi on those 3 laptops  (Test have been performed on 2 AP, same result, and at the end, last AP has been installed on my desk to avoid any interferences, but trouble persisted) 




  • 76.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 03, 2025 05:25 AM

    I don't know if the 505 use the same chipset as the 515 but this sound like bug AOS-246234 to me https://networkingsupport.hpe.com/defectsearch/AOS8GW-246234

    But this issue was always resolved by disabling AX or OFDMA specifically on the Access Points. This was the issue that was holding us back 1,5 years...and TAC was never able to clearly reproduce it in their lab according to my knowledge. If that's still the same issue would be very bad news. It clearly isn't as bad anymore but we still need to do load tests as this was always easy to reproduce with load in the past. 
    As I'm ill this week I can only try to test this next week. 




  • 77.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted Apr 03, 2025 11:16 AM

    We also observed that the problems reported here are related to Intel 6E AX211 NIC's running on firmware code 23.xxx. Downgrading the driver to any of the 22.xxx firmware releases fixed the problem in our case.




  • 78.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted 28 days ago

    95% of our devices are using AX211 NICs, so you may be onto something here. Hundreds of them. I'll have to see if I can find a device that doesn't use the AX211 card and test with that. Downgrading the driver for everyone isn't a realistic option. I was hoping there'd be a newer driver, but I tested on the latest version (23.120.0) released March 4th and the issue persists. 

    Anybody else find any resolution here? We upgraded to 8.10.16 and things seemed to get a little better for a while, but the issue has re-appeared with a vengeance affecting users across our campus. I see 8.10.0.17 is in the AOS-8 Release Notes site, but it's not active yet. Hopefully .17 brings some resolution. 

    Are any of the 10.x firmware stable and reliable with this issue? 




  • 79.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted 28 days ago

    Unfortunately we are experiencing problems again after the update to 8.10.0.16, mainly random spikes in meetings with both AX211 NIC and macbooks




  • 80.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted 28 days ago

    Hi Mike, is your environment an IAP cluster or controller managed?

    We face this issues also in both cases. even a change to 10.7.1.1 on the IAP cluster did not help.




  • 81.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted 27 days ago

    After upgrading the cluster to 8.10.0.16 on AP-535, the problems with google meet and performance in general have gotten much worse, both for windows and macOS devices. Tech support says it's my configuration issues..... I have no strength to prove anything to them. Rolled back to 8.10.0.12, everything became stable and good.




  • 82.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted 24 days ago

    Just adding our experience with this issue. We have a case open as well (5387846479), we have APP RF with QoS set for Teams packets and all the other recommendations. We did downgrade our IAPs to 8.10.0.13 (as per TACs request) and it was a lot better but still experienced the issue. We had hope that 8.12.0.5 would fix the issues as it mentioned "Some clients connected to 500 Series access points experienced latency and performance issue. " but unfortunatley its worse. Teams will hang for 5-10 sec and then will catch backup. Then it will display a poor network quality message in teams. I just want to note we have only experienced issues within Teams and no other video/audio platforms (ie Zoom, google meet, etc). 




  • 83.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted 22 days ago

    Throwing my hat in to provide our own update. Don't get excited, we haven't found a workaround.

     We're still running 8.10.0.13 for stability. Our issue is that as more security advisories get released and 8.10.0.13 becomes more and more vulnerable there will almost inevitably be a vulnerability that we won't be able to reasonable mitigate. Kind of hope that either a fix comes out or we can hop to another non-impacted LSR.

    Does anyone have a recommendation or maybe more up to date information on this guy? Sad thing is, I can't find AOS-260495 even listed in any of the newer version "Known Issues". My old TAC case mentioned that 8.10.0.16 was supposed to address the issue. It has since been released and users (in this thread) have reported even worse symptoms.

    Looking for some official Aruba Response here. Is this low visibility? Has the Bug ID Changed? Am I missing something? Why has there been no communication about this?




  • 84.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted 21 days ago

    I just ran across this thread while investigating another issue and while I haven't heard any real complaints, that doesnt mean its not happening.  I am running 10.6.0.2 (at locations that support that), has anyone had this issue on that code?




  • 85.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted 21 days ago

    We have been experiencing the same problem since last year.
    The AP we use is 505 (8.10.0.16) and we have configured an IAP cluster.
    We are not sure what triggers it, but sometimes extreme latency occurs.
    Roaming or reconnecting improves the situation.
    We have also tried 8.11.x and 8.12.x, but there has been no improvement.
    We would be grateful if you could provide any information that could lead to a solution...




  • 86.  RE: hickups with latest LSR and SSR releases of AOS8 (8.12.0.3 en 8.10.0.14)

    Posted 21 days ago