Network Management

I have an Airwave 8.2.0.3 server, which I would like to move to a new host.

I installed the appropriate version of Airwave on the new host (from an ISO), and got it configured to the point it was serving web pages, then attempted to restore a nightly backup from my old host.

The restore failed as follows, any ideas?

[root@airwave scripts]# ./amp_restore -d /var/airwave-backup/nightly_data_restore.tar.gz
cpu_chip_info: Unable to find /var/airwave/csv_db/cpu_db.csv on disk!
[Fri Jul 22 16:51:05 BST 2016] Verifying completeness of /var/airwave-backup/nightly_data_restore.tar.gz ...
[Fri Jul 22 16:56:26 BST 2016] Skipping version check
cpu_chip_info: Unable to find /var/airwave/csv_db/cpu_db.csv on disk!
Stopping httpd:                                            [  OK  ]
cpu_chip_info: Unable to find /var/airwave/csv_db/cpu_db.csv on disk!
Fri Jul 22 16:56:51 2016: Last PID not available VisualRF Engine...
DB::Q->scalar must return exactly one value: got 0 rows, N/A cols at /usr/local/airwave/lib/perl/Mercury/Utility/Assert.pm line 59
        eval {...} called at /usr/local/airwave/lib/perl/Mercury/Utility/Assert.pm line 59
        Mercury::Utility::Assert::assert_quickly('', 'DB::Q->scalar must return exactly one value: got 0 rows, N/A ...') called at /usr/local/airwave/lib/perl/Mercury/DB/Q.pm line 211
        Mercury::DB::Q::scalar('Mercury::DB::Q', 'SELECT license_grace_expiration FROM seas_config\x{a}') called at /usr/local/airwave/lib/perl/Mercury/Licensing/Grace.pm line 80
        Mercury::Licensing::Grace::expires('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at /usr/local/airwave/lib/perl/Mercury/Licensing/Single.pm line 207
        Mercury::Licensing::Single::days_remaining('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at /usr/local/airwave/lib/perl/Mercury/Licensing/Grace.pm line 70
        Mercury::Licensing::Grace::is_active('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at /usr/local/airwave/lib/perl/Mercury/Licensing/Single.pm line 119
        Mercury::Licensing::Single::is_valid_schemeless('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at /usr/local/airwave/lib/perl/Mercury/Licensing/Single.pm line 126
        Mercury::Licensing::Single::is_valid('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at /usr/local/airwave/lib/perl/Mercury/Licensing.pm line 216
        Mercury::Licensing::_filter_singles_we_care_about('Mercury::Licensing=HASH(0x100a9318)', 'Mercury::Licensing::Single=HASH(0xf0006f0)', 'Mercury::Licensing::Single=HASH(0xfdadab0)', 'Mercury::Licensing::Single=HASH(0xfda0c90)', 'Mercury::Licensing::Single=HASH(0xff07f00)', 'Mercury::Licensing::Single=HASH(0xff07fa8)') called at /usr/local/airwave/lib/perl/Mercury/Licensing.pm line 227
        Mercury::Licensing::_aggregate_singles('Mercury::Licensing=HASH(0x100a9318)', 'Mercury::Licensing::Single=HASH(0xf0006f0)', 'Mercury::Licensing::Single=HASH(0xfdadab0)', 'Mercury::Licensing::Single=HASH(0xfda0c90)', 'Mercury::Licensing::Single=HASH(0xff07f00)', 'Mercury::Licensing::Single=HASH(0xff07fa8)') called at /usr/local/airwave/lib/perl/Mercury/Licensing.pm line 273
        Mercury::Licensing::process_additive_licenses('Mercury::Licensing=HASH(0x100a9318)') called at /usr/local/airwave/lib/perl/Mercury/Licensing.pm line 112
        Mercury::Licensing::init('Mercury::Licensing=HASH(0x100a9318)') called at /usr/local/airwave/lib/perl/Mercury/Base.pm line 40
        Mercury::Base::new_from_hashref('Mercury::Licensing', 'Mercury::Licensing=HASH(0x100a9318)') called at /usr/local/airwave/lib/perl/Mercury/Base.pm line 17
        Mercury::Base::new('Mercury::Licensing') called at /usr/local/airwave/lib/perl/Mercury/Licensing.pm line 44
        Mercury::Licensing::hard_get('Mercury::Licensing') called at /usr/local/airwave/lib/perl/Mercury/Licensing.pm line 55
        Mercury::Licensing::get('Mercury::Licensing') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service.pm line 75
        Mercury::Daemon::Service::should_be_running('Mercury::Daemon::Service::InstantGUIConfig=HASH(0xf000588)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/InstantGUIConfig.pm line 37
        Mercury::Daemon::Service::InstantGUIConfig::should_be_running('Mercury::Daemon::Service::InstantGUIConfig=HASH(0xf000588)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/UpdatePids.pm line 61
        Mercury::Daemon::Service::UpdatePids::_is_running('Mercury::Daemon::Service::InstantGUIConfig=HASH(0xf000588)') called at /usr/local/airwave/lib/perl/Mercury/Daemon/Service/UpdatePids.pm line 73
        Mercury::Daemon::Service::UpdatePids::is_running('Mercury::Daemon::Service::InstantGUIConfig=HASH(0xf000588)') called at /usr/local/airwave/bin/restart_daemons.pl line 49
DB::Q->scalar must return exactly one value: got 0 rows, N/A cols at Mercury/Utility/Assert.pm line 59
        Mercury::Utility::Assert::assert_quickly([arg list truncated]) called at Mercury/DB/Q.pm line 211
        Mercury::DB::Q::scalar([arg list truncated]) called at Mercury/Licensing/Grace.pm line 80
        Mercury::Licensing::Grace::expires('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at Mercury/Licensing/Single.pm line 207
        Mercury::Licensing::Single::days_remaining('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at Mercury/Licensing/Grace.pm line 70
        Mercury::Licensing::Grace::is_active('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at Mercury/Licensing/Single.pm line 119
        Mercury::Licensing::Single::is_valid_schemeless('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at Mercury/Licensing/Single.pm line 126
        Mercury::Licensing::Single::is_valid('Mercury::Licensing::Grace=HASH(0xfaa3748)') called at Mercury/Licensing.pm line 216
        Mercury::Licensing::_filter_singles_we_care_about([arg list truncated]) called at Mercury/Licensing.pm line 227
        Mercury::Licensing::_aggregate_singles([arg list truncated]) called at Mercury/Licensing.pm line 273
        Mercury::Licensing::process_additive_licenses('Mercury::Licensing=HASH(0x100a9318)') called at Mercury/Licensing.pm line 112
        Mercury::Licensing::init('Mercury::Licensing=HASH(0x100a9318)') called at Mercury/Base.pm line 40
        Mercury::Base::new_from_hashref('Mercury::Licensing', 'Mercury::Licensing=HASH(0x100a9318)') called at Mercury/Base.pm line 17
        Mercury::Base::new('Mercury::Licensing') called at Mercury/Licensing.pm line 44
        Mercury::Licensing::hard_get('Mercury::Licensing') called at Mercury/Licensing.pm line 55
        Mercury::Licensing::get('Mercury::Licensing') called at Mercury/Daemon/Service.pm line 75
        Mercury::Daemon::Service::should_be_running('Mercury::Daemon::Service::InstantGUIConfig=HASH(0xf000588)') called at Mercury/Daemon/Service/InstantGUIConfig.pm line 37
        Mercury::Daemon::Service::InstantGUIConfig::should_be_running('Mercury::Daemon::Service::InstantGUIConfig=HASH(0xf000588)') called at Mercury/Daemon/Service/UpdatePids.pm line 61
        Mercury::Daemon::Service::UpdatePids::_is_running('Mercury::Daemon::Service::InstantGUIConfig=HASH(0xf000588)') called at Mercury/Daemon/Service/UpdatePids.pm line 73
        Mercury::Daemon::Service::UpdatePids::is_running('Mercury::Daemon::Service::InstantGUIConfig=HASH(0xf000588)') called at /usr/local/airwave/bin/restart_daemons.pl line 49

[Fri Jul 22 16:56:51 BST 2016] Restoring AMP from file /var/airwave-backup/nightly_data_restore.tar.gz
+ print '/bin/tar --use-compress-program=/usr/bin/pigz -xf "/var/airwave-backup/nightly_data_restore.tar.gz" -C / alternative/postgres_dump_31621 var/airwave/data var/airwave/sites var/airwave/temp var/airwave/snapshot var/airwave/device-backup'
++ date
+ printf -v MSG '[%s] %s' 'Fri Jul 22 16:56:51 BST 2016' '/bin/tar --use-compress-program=/usr/bin/pigz -xf "/var/airwave-backup/nightly_data_restore.tar.gz" -C / alternative/postgres_dump_31621 var/airwave/data var/airwave/sites var/airwave/temp var/airwave/snapshot var/airwave/device-backup'
+ echo '[Fri' Jul 22 16:56:51 BST '2016]' /bin/tar --use-compress-program=/usr/bin/pigz -xf '"/var/airwave-backup/nightly_data_restore.tar.gz"' -C / alternative/postgres_dump_31621 var/airwave/data var/airwave/sites var/airwave/temp var/airwave/snapshot var/airwave/device-backup
[Fri Jul 22 16:56:51 BST 2016] /bin/tar --use-compress-program=/usr/bin/pigz -xf "/var/airwave-backup/nightly_data_restore.tar.gz" -C / alternative/postgres_dump_31621 var/airwave/data var/airwave/sites var/airwave/temp var/airwave/snapshot var/airwave/device-backup
+ echo '[Fri' Jul 22 16:56:51 BST '2016]' /bin/tar --use-compress-program=/usr/bin/pigz -xf '"/var/airwave-backup/nightly_data_restore.tar.gz"' -C / alternative/postgres_dump_31621 var/airwave/data var/airwave/sites var/airwave/temp var/airwave/snapshot var/airwave/device-backup
+ /bin/tar --use-compress-program=/usr/bin/pigz -xf /var/airwave-backup/nightly_data_restore.tar.gz -C / alternative/postgres_dump_31621 var/airwave/data var/airwave/sites var/airwave/temp var/airwave/snapshot var/airwave/device-backup
/bin/tar: var/airwave/snapshot: Not found in archive
/bin/tar: Exiting with failure status due to previous errors
+ set +x
Fri Jul 22 17:02:15 BST 2016
[Fri Jul 22 17:02:15 BST 2016] (finished /bin/tar)
[Fri Jul 22 17:02:15 BST 2016] tsdb backup path []
stop_postgresql_hard: stop postgres via service
Stopping postgresql service:                               [  OK  ]
postmaster is stopped
stop_postgresql_hard: done
server starting
LOG:  00000: ending log output to stderr
HINT:  Future log output will go to log destination "syslog".
LOCATION:  PostmasterMain, postmaster.c:1214
Database is not yet started, sleeping...
[Fri Jul 22 17:02:23 BST 2016] Restoring database from alternative/postgres_dump_31621
stop_postgresql_hard: stop postgres via service
Stopping postgresql service:                               [  OK  ]
postmaster (pid  6001) is running...
stop_postgresql_hard: still running; wait five and try stop again ...
Stopping postgresql service:                               [  OK  ]
postmaster (pid  6001) is running...
stop_postgresql_hard: still running; wait ninety and try stop again ...
Stopping postgresql service:                               [  OK  ]
stop_postgresql_hard: done
Stopping postgresql service:                               [  OK  ]
Starting postgresql service:                               [  OK  ]
make: Nothing to be done for `/root/.pgpass'.
cpu_chip_info: Unable to find /var/airwave/csv_db/cpu_db.csv on disk!
DB::Q->scalar must return exactly one value: got 0 rows, N/A cols at /usr/local/airwave/lib/perl/Mercury/Utility/Assert.pm line 59
        eval {...} called at /usr/local/airwave/lib/perl/Mercury/Utility/Assert.pm line 59
        Mercury::Utility::Assert::assert_quickly('', 'DB::Q->scalar must return exactly one value: got 0 rows, N/A ...') called at /usr/local/airwave/lib/perl/Mercury/DB/Q.pm line 211
        Mercury::DB::Q::scalar('Mercury::DB::Q', 'select nightly_maintenance_time from seas_config where id = ?', 1) called at /usr/local/airwave/lib/perl/Mercury/DB/SeasConfig.pm line 2065
        Mercury::DB::SeasConfig::field('Mercury::DB::SeasConfig', 'nightly_maintenance_time') called at /usr/local/airwave/lib/perl/Mercury/DB/SeasConfig/Wrapper.pm line 37
        Mercury::DB::SeasConfig::Wrapper::AUTOLOAD('Mercury::DB::SeasConfig::Wrapper=HASH(0x122e788)') called at /usr/local/airwave/lib/perl/Mercury/Utility/File/RootCrontabEditor.pm line 16
        Mercury::Utility::File::RootCrontabEditor::rewrite_crontab('Mercury::Utility::File::RootCrontabEditor=HASH(0x4385bd8)') called at /usr/local/airwave/setuid-bin/root_crontab_helper line 20
DB::Q->scalar must return exactly one value: got 0 rows, N/A cols at Mercury/Utility/Assert.pm line 59
        Mercury::Utility::Assert::assert_quickly([arg list truncated]) called at Mercury/DB/Q.pm line 211
        Mercury::DB::Q::scalar([arg list truncated]) called at Mercury/DB/SeasConfig.pm line 2065
        Mercury::DB::SeasConfig::field('Mercury::DB::SeasConfig', 'nightly_maintenance_time') called at Mercury/DB/SeasConfig/Wrapper.pm line 37
        Mercury::DB::SeasConfig::Wrapper::AUTOLOAD('Mercury::DB::SeasConfig::Wrapper=HASH(0x122e788)') called at Mercury/Utility/File/RootCrontabEditor.pm line 16
        Mercury::Utility::File::RootCrontabEditor::rewrite_crontab('Mercury::Utility::File::RootCrontabEditor=HASH(0x4385bd8)') called at /usr/local/airwave/setuid-bin/root_crontab_helper line 20

DISABLED - 1!!
[root@airwave scripts]#

Hi rwhb2,

Looks like the restore is failing as its not able to find "cpu_db.csv" file under the directory "/var/airwave/csv_db". This is happening as this file is not backed up in the backup file.

Could we enable the amp using the below command and recompile the script once so that we could get this file created again?

To enable amp

# amp_enable

To recompile the script

# screen

# root

# make

Let me know how it goes or you need any further help.

Regards,

Vishnu

Thanks for the suggestion.

Make failed.

A large amount of output was produced, the last few lines of which include information about the failure:

...
[Tue Jul 26 10:50:33 2016] BEGIN creating client_historical_username_reverse_lowercase_idx
[Tue Jul 26 10:50:33 2016]   END creating client_historical_username_reverse_lowercase_idx
[Tue Jul 26 10:50:33 2016]   END rebuilding client_historical_username_reverse_lowercase_idx
[Tue Jul 26 10:50:33 2016] BEGIN rebuilding client_ip_normalized_ip_address_idx
[Tue Jul 26 10:50:33 2016]  DROP index (if it exists) client_ip_normalized_ip_address_idx
[Tue Jul 26 10:50:33 2016] BEGIN creating client_ip_normalized_ip_address_idx
[Tue Jul 26 10:50:33 2016]   END creating client_ip_normalized_ip_address_idx
[Tue Jul 26 10:50:33 2016]   END rebuilding client_ip_normalized_ip_address_idx
UpdateFS: Running 'Remove all fastmmap caches for move to 64-bit capability'
UpdateFS: Running 'Remove obsolete /var/lib/airwave/cache/fastmmap/awrrdtool_write_cache.lock file'
UpdateFS: Running 'Remove SignalQuality RRDs which we stopped using in 8.0'
UpdateFS: Running 'Move UI exposed logs to /var/log/system to put on GlusterFS'
UpdateFS: Running 'Clear older telnet_cmds logs to avoid clear text password'
/usr/bin/truncate: cannot open `/var/log/system/ap/*/config.log*' for writing: No such file or directory
UpdateFS: Running 'Clear older config_verifier, httpd_performance logs to avoid clear text password'
/root/svn/mercury/bin/update_db_all_subsys.sh
Upgrading database (update_db.pl)
DB::Q->scalar must return exactly one value: got 0 rows, N/A cols at /usr/local/airwave/lib/perl/Mercury/Utility/Assert.pm line 59
        eval {...} called at /usr/local/airwave/lib/perl/Mercury/Utility/Assert.pm line 59
        Mercury::Utility::Assert::assert_quickly('', 'DB::Q->scalar must return exactly one value: got 0 rows, N/A ...') called at /usr/local/airwave/lib/perl/Mercury/DB/Q.pm line 211
        Mercury::DB::Q::scalar('Mercury::DB::Q', 'select version from seas_config;') called at /root/svn/mercury/bin/update_db.pl line 69
        update_db::__ANON__() called at /usr/local/airwave/lib/perl/Mercury/Utility.pm line 175
        eval {...} called at /usr/local/airwave/lib/perl/Mercury/Utility.pm line 175
        Mercury::Utility::safe_eval('CODE(0x8810c8)') called at /root/svn/mercury/bin/update_db.pl line 70
        update_db::go('update_db') called at /root/svn/mercury/bin/update_db.pl line 235
Unable to run update_db because Postgres is down:
DB::Q->scalar must return exactly one value: got 0 rows, N/A cols at Mercury/Utility/Assert.pm line 59
        Mercury::Utility::Assert::assert_quickly([arg list truncated]) called at Mercury/DB/Q.pm line 211
        Mercury::DB::Q::scalar('Mercury::DB::Q', 'select version from seas_config;') called at /root/svn/mercury/bin/update_db.pl line 69
        update_db::__ANON__() called at Mercury/Utility.pm line 175
        eval {...} called at Mercury/Utility.pm line 175
        Mercury::Utility::safe_eval('CODE(0x8810c8)') called at /root/svn/mercury/bin/update_db.pl line 70
        update_db::go('update_db') called at /root/svn/mercury/bin/update_db.pl line 235

make[1]: *** [updatedb] Error 1
make[1]: Leaving directory `/root/svn/mercury'
make: *** [upgrade] Error 2
DISABLED - 1!!
[root@airwave mercury]#

Hi rwhb2,

Could you email me on mannil@hpe.com? We can work on this over a remote session.

Regards,

Vishnu

Hi Vishnu

I see the same error in the restore, but I´m restoring in an AMP virtualized.

Could you tell me how solved this issue?

Apparently, the AMP restore was succesfull but with this errors:

/bin/tar: var/airwave/snapshot: Not found in archive
/bin/tar: Exiting with failure status due to previous errors

I can´t see the data in real time, attached the picture (no data). Is this a normal behavior?

Should I have the data before of the restore or before of the change box?

Regards

David