Wireless Access

 View Only
last person joined: yesterday 

Access network design for branch, remote, outdoor, and campus locations with HPE Aruba Networking access points and mobility controllers.
Expand all | Collapse all

How to free up: 100% flash used

This thread has been viewed 157 times
  • 1.  How to free up: 100% flash used

    Posted Nov 11, 2022 08:12 AM
    In a 2*2, MD[7210]/MM, no more space:
    [Running: 8.10.0.4 ]

    Total Switches:4

    (Aruba) [md] (config) #write m
    Saving Configuration...
    Not enough space in flash to save configuration. Config commit aborted.

    (ArubaMM01v-osl) [md] #show storage
    Filesystem    Size       Used       Available Use%    Mounted on
    none                3.0G      373.9M     2.6G          12%      /tmp
    /dev/sdb1       7.7G      7.6G                        100%     /flash
    /dev/sda5       1.4G      418.0M   985.0M         30%     /mnt/disk1
    /dev/sda6       1.4G     418.3M    984.7M         30%     /mnt/disk2

    Please  ..


  • 2.  RE: How to free up: 100% flash used

    EMPLOYEE
    Posted Nov 11, 2022 08:40 AM
    tar crash, delete flashbackups and logs.tar.gz from the directory.

    ------------------------------
    Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.

    HPE Design and Deploy Guides: https://community.arubanetworks.com/support/migrated-knowledge-base?attachments=&communitykey=dcc83c62-1a3a-4dd8-94dc-92968ea6fff1&pageindex=0&pagesize=12&search=&sort=most_recent&viewtype=card
    ------------------------------



  • 3.  RE: How to free up: 100% flash used

    EMPLOYEE
    Posted Nov 11, 2022 08:58 AM
    You can check with the 'dir' command if there are large files that you could delete with the 'delete filename <filename>' command.

    However, this looks like some software issue as the flash should not fill up. Please open a TAC support case to get this investigated, cleaned up, and resolved.

    ------------------------------
    Herman Robers
    ------------------------
    If you have urgent issues, always contact your Aruba partner, distributor, or Aruba TAC Support. Check https://www.arubanetworks.com/support-services/contact-support/ for how to contact Aruba TAC. Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.

    In case your problem is solved, please invest the time to post a follow-up with the information on how you solved it. Others can benefit from that.
    ------------------------------



  • 4.  RE: How to free up: 100% flash used

    MVP EXPERT
    Posted Nov 14, 2022 03:27 PM
    I had the same last week where i delete a large file the storage is still 100%.  We solved it with support of Aruba TAC Support.

    ------------------------------
    Marcel Koedijk | MVP Expert 2022 | ACEP | ACMP | ACCP | ACDP | Ekahau ECSE | Not an HPE Employee | Opinions are my own
    ------------------------------



  • 5.  RE: How to free up: 100% flash used

    Posted Nov 16, 2022 07:59 AM

    Thank you all,

    Following the Release Notes sections: Low Free Flash Memory.

    I have performed:

    tar crash

    tar clean crash

    tar clean logs

    tar clean traces

    With no changes.

    This step changed nothing:

    "Copy the flashbackup.tar.gz and configbackup.tar.gz files out of the controller. Then delete the

    flashbackup.tar.gz and configbackup.tar.gz files from the flash memory of the controller."
    Which I presume is on root


    show storage; still show 100%

    Have listed flash (dir flash), showing hundreds of files..

     

    Anyone ?




  • 6.  RE: How to free up: 100% flash used

    EMPLOYEE
    Posted Nov 16, 2022 08:04 AM
    Technical Support case

    ------------------------------
    Any opinions expressed here are solely my own and not necessarily that of Hewlett Packard Enterprise or Aruba Networks.

    HPE Design and Deploy Guides: https://community.arubanetworks.com/support/migrated-knowledge-base?attachments=&communitykey=dcc83c62-1a3a-4dd8-94dc-92968ea6fff1&pageindex=0&pagesize=12&search=&sort=most_recent&viewtype=card
    ------------------------------



  • 7.  RE: How to free up: 100% flash used

    Posted Nov 16, 2022 08:26 AM

    Yes, but that takes time, I really should have done some config changes J




  • 8.  RE: How to free up: 100% flash used

    Posted Nov 17, 2022 10:34 AM
    TAC managed to release space,
    and issue is reported and to be fixed in next release (8.10.0.6)

    Known Issues in ArubaOS
    New Bug ID Description Reported Version AOS-238218
    The mongo database takes up a lot of flash space. This issue is
    observed in Mobility Conductors running ArubaOS 8.9.0.3 or later versions.






  • 9.  RE: How to free up: 100% flash used

    Posted Aug 04, 2023 12:44 PM

    Hi All

    I am getting same error on an existing MM infrastructure running 8.10.05

    "
    Not enough space in flash to save configuration. Config commit aborted."

    (vmamm1) ^[/] #show storage 

    Filesystem                Size      Used Available Use% Mounted on
    none                      3.0G    126.7M      2.9G   4% /tmp
    /dev/sdb1                 5.8G      5.5G         0 100% /flash
    /dev/sda5                 1.4G    418.4M    984.6M  30% /mnt/disk1
    /dev/sda6                 1.4G    422.2M    980.8M  30% /mnt/disk2

    Only Tac can solve it?

    Regards and thanks




  • 10.  RE: How to free up: 100% flash used

    Posted Aug 05, 2023 02:34 AM

    HI.

    You can delete logs and trace files. There are detailed instructions on how to do it in the Conductor Release notes.

    You can also increase the disk drive size on VM. Check the instructions in the VA Installation Guide.

    Short instructions for increasing the flash size.

    • Power off the VM
    • Add a new bigger disk drive to VM
    • Boot the VM
    • VM will automatically migrate the data to a new disk
    • Finish

    Best, Gorazd



    ------------------------------
    Gorazd Kikelj
    MVP Expert 2023
    ------------------------------



  • 11.  RE: How to free up: 100% flash used

    Posted Aug 05, 2023 04:20 AM
    Hi All

    Seems that the error is not on the controllers  storage. Only the flash is 100% , not the disks

    Only arises on the MM cli. These flash is on the MM or am I missing something?

    Regards

     Sent from my Iphone

    Bruno Costa

    IT Support Specialist

     

    CONNECTing Projectos e Consultoria Lda.

    Rua Diogo de Silves, 33C

    1400-107 Lisboa

    Tlm: +351 916 158 228

    Email: baraujo@connecting.pt









  • 12.  RE: How to free up: 100% flash used

    Posted Aug 05, 2023 05:30 AM

    Flash is a partition on the virtual disk you present to the VM.

    Look into Virtual Appliance Installation Guide for the detailed instructions how to increase the flash size,

    Best, Gorazd



    ------------------------------
    Gorazd Kikelj
    MVP Expert 2023
    ------------------------------



  • 13.  RE: How to free up: 100% flash used

    Posted Aug 07, 2023 09:51 AM
    Can you please explain this a bit more:
     
    • VM will automatically migrate the data to a new disk


    ------------------------------
    Steinar
    ------------------------------



  • 14.  RE: How to free up: 100% flash used

    Posted Aug 07, 2023 10:04 AM

    @Steinar Grande also my doubt there.. 

    For my  leaning of the guide  we need to power off the VM that hosts the MM and then wait for the old flash , that in my case as 5,8 GB, to be migrated to the new disk.

    But I am not sure of any impact in the production environment

    Also I see that VM already as 3 disks. Could tha me an issue for a failure in the "flash disk" migration?

    Regards




  • 15.  RE: How to free up: 100% flash used
    Best Answer

    Posted Aug 07, 2023 10:25 AM

    From VM Installation Guide:

    ArubaOS enables you to increase the size of your flash to ensure that the flash is hosted on a separate
    disk. By doing this you can move to a hard disk with higher storage capacity for flash with minimal
    impact. Follow the steps below to increase the size of the flash on the Mobility Conductor Virtual
    Appliance.

    • Power down the VM
    • Add a new hard drive as per virtualization platform you are using
    • Power on the VM
    • ArubaOS will migrate data to the new disk during the boot process. Usually very uneventful and boring process and will take just a few minutes.
    • Confirm if the newly added Hard disk 3 is used by ArubaOS. The Hard disk 3 will be listed as
      /dev/sdc1 and if old hard disk is in use, it will be listed as /dev/sdb1. If the OVF file only contains a
      single hard disk it be listed as /dev/sda3. (use show storage to check)
    • If the new Hard disk 3 is working as expected, the older hard disk can be removed from the VM
      and deleted from disk of your virtualization server.

    There is no other explanation of how the mechanism works, but it does work. 

    There is no impact on production except expected MM down limitations.

    Best, Gorazd



    ------------------------------
    Gorazd Kikelj
    MVP Expert 2023
    ------------------------------



  • 16.  RE: How to free up: 100% flash used

    Posted Aug 07, 2023 10:51 AM

    Exciting, is there any max or other practical file size to prefer ?

    (I have had several cases where the disk/flash has been full)

    Filesystem                Size      Used Available Use% Mounted on
    none                      3.0G     89.5M      2.9G   3% /tmp
    /dev/sdb1                 7.7G      4.6G      2.8G  62% /flash
    /dev/sda5                 1.4G    418.9M    984.1M  30% /mnt/disk1
    /dev/sda6                 1.4G    419.4M    983.6M  30% /mnt/disk2

    i assume the 7.7G /dev/sdb1 is the 8 GB Hard disk 2 in the VM ?



    ------------------------------
    Steinar
    ------------------------------



  • 17.  RE: How to free up: 100% flash used

    Posted Aug 07, 2023 11:01 AM

    Really depend on your situation and specifics. But if you go with 12 or 16 GB you should be fine for a very long time.

    Best, Gorazd



    ------------------------------
    Gorazd Kikelj
    MVP Expert 2023
    ------------------------------



  • 18.  RE: How to free up: 100% flash used

    Posted Aug 09, 2023 02:46 PM

    Hi All

    Just to keep you informed

    Issue was solved by TAC.

    We had to delete some hidden files , since there is a known issue with MongoDB that impacts with the flash storage

    Flash is now 80% and we already can write mem.

    See https://www.arubanetworks.com/techdocs/ArubaOS-8.x-Books/Release-Notes/810/ArubaOS-8.10.0.5-Release-Notes.pdf

    After that I updated to 8.10.0.6 ,  that fixes that "aos" bug

    Regards




  • 19.  RE: How to free up: 100% flash used

    Posted Aug 10, 2023 03:33 AM

    Magic J

    Before


    After adding new large disk


    After removing "old", small disk




    ------------------------------
    Steinar
    ------------------------------



  • 20.  RE: How to free up: 100% flash used

    Posted Aug 10, 2023 03:38 AM

    :-) Glad it worked as expected.

    Best, Gorazd



    ------------------------------
    Gorazd Kikelj
    MVP Expert 2023
    ------------------------------



  • 21.  RE: How to free up: 100% flash used

    Posted Aug 10, 2023 03:41 AM

    Thank you again..



    ------------------------------
    Steinar
    ------------------------------



  • 22.  RE: How to free up: 100% flash used

    Posted Aug 10, 2023 03:51 AM
    Great!