Commit Graph

55 Commits

Author SHA1 Message Date
Joshua Boniface fef97f0b04 Adjust name of pvcapid-worker to pvcworkerd 2023-11-15 20:32:23 -05:00
Joshua Boniface 677287fd2e Add additional wait after stopping OSDs
Allows the Ceph cluster to properly reconcile first.
2023-10-24 10:42:15 -04:00
Joshua Boniface d0bcbf123f Move kernel cleanup to after reboot
Otherwise, modules might fail etc. when the kernel package is purged
before reboot causing odd failures.
2023-10-24 10:41:47 -04:00
Joshua Boniface 7fe682aa60 Handle freshness for all 3 types separately
If microcode was missing, checking the other two would be UNKN and thus
not restart. But, if microcode *is* present, we want to restart for
either of the other two as well.

So separate into 3 distinct checks and restart if any one is changed.
2023-10-24 10:41:47 -04:00
Joshua Boniface 6d05f40242 Fix import for newer Ansible versions 2023-09-18 09:42:01 -04:00
Joshua Boniface 6908f7070c Properly disable autoscaling PGs 2023-09-01 15:42:30 -04:00
Joshua Boniface b267db8474 Loop over pvcnoded restart 2023-09-01 15:42:30 -04:00
Joshua Boniface 1f4cd92d63 Fix bad calls to node primary 2023-09-01 15:42:30 -04:00
Joshua Boniface c9d1edf63d Disable PG autoscaling after upgrade 2023-09-01 15:42:30 -04:00
Joshua Boniface 5b98e03f5a Fix bad delegate_to 2023-09-01 15:42:30 -04:00
Joshua Boniface b88b79fa30 Update minimum PVC version 2023-09-01 15:42:30 -04:00
Joshua Boniface 0c28d3b42f Ensure confold force during install 2023-09-01 15:42:30 -04:00
Joshua Boniface 3fc90c90a7 Add comments to script steps 2023-09-01 15:42:30 -04:00
Joshua Boniface d92acb7e6f Make D10->D12 upgrade steps noninteractive 2023-09-01 15:42:30 -04:00
Joshua Boniface 1e497413e8 Remove extra whitespace 2023-09-01 15:42:30 -04:00
Joshua Boniface 37ebdaac9c Add PVC upgrade to Debian 12 playbook 2023-09-01 15:42:30 -04:00
Joshua Boniface 25ab984c9b Revert "Disallow Deb10 -> Deb12 upgrades"
This reverts commit 6e56dd3e4a.
2023-09-01 15:42:30 -04:00
Joshua Boniface 1dac151f2f Disallow Deb10 -> Deb12 upgrades
It doesn't work properly, errors in libc6/perl.
2023-09-01 15:42:30 -04:00
Joshua Boniface 7a2d5ac0c4 Ensure PVC daemons are updated before reboots 2023-09-01 15:42:30 -04:00
Joshua Boniface d3391aa080 Move to new maintenance mode and check legacy first 2023-09-01 15:42:29 -04:00
Joshua Boniface 1f9a74301f Alter deb12 upgrade 2023-09-01 15:42:29 -04:00
Joshua Boniface 642813e4e3 Remove obsolete cset configurations 2023-09-01 15:42:29 -04:00
Joshua Boniface e3c1d28674 Add upgrade to Debian 12 playbook 2023-09-01 15:42:29 -04:00
Joshua Boniface 7e829f04ae Restore unknown state as not-reboot 2023-09-01 15:42:29 -04:00
Joshua Boniface 2c63500011 Split upgrade stage and add dpkg cleanup
Avoid problems if one or more nodes are upgrading libvirt/QEMU and live
migrations fail.
2023-09-01 15:42:29 -04:00
Joshua Boniface 7a0c596281 Add node daemon confirmation before continue 2023-09-01 15:42:29 -04:00
Joshua Boniface 3d4e66471e Trigger restart even with rc=3 2023-09-01 15:42:29 -04:00
Joshua Boniface cbae685b45 Ignore needrestart unknown case 2023-09-01 15:42:29 -04:00
Joshua Boniface 7cac7b26ce Ensure freshness check is proper 2023-09-01 15:42:28 -04:00
Joshua Boniface be091f66d4 Remove pvc-flush references
This service causes more problems than it solves usually, so it is being
removed in the next PVC version.
2023-09-01 15:42:28 -04:00
Joshua Boniface 5aeca53212 Add PostgreSQL cleanup to upgrade 2023-09-01 15:42:28 -04:00
Joshua Boniface d8cad85e91 Add oneshot playbook to reboot cluster 2023-09-01 15:42:28 -04:00
Joshua Boniface 9e20e47903 Update freshness checks 2023-09-01 15:42:28 -04:00
Joshua Boniface 5de3ab0c3a Move pvc maintenance to separate plays
This ensures that the maintenance on/off happens before all tasks and
after all tasks and not intermittently.
2023-09-01 15:42:28 -04:00
Joshua Boniface 94e9bf9133 Ignore errors during flush commands
These might inexplicably fail, but that is fine.
2023-09-01 15:42:27 -04:00
Joshua Boniface 197000a48d Revert "Add symlink for Ceph file pickup"
This reverts commit 3ac946bf2e.
2023-09-01 15:42:27 -04:00
Joshua Boniface 94c019f960 Add symlink for Ceph file pickup 2023-09-01 15:42:27 -04:00
Joshua Boniface 3161708593 Include another upgrade in deb11 playbook
Ensures that the system is fully updated after re-enabling the security
repository during the base run.
2023-09-01 15:42:27 -04:00
Joshua Boniface 593599c148 Add Debian 10 -> Debian 11 upgrade playbook 2023-09-01 15:42:27 -04:00
Joshua Boniface ec2fd99eb6 Avoid errors if noout fails 2023-09-01 15:42:27 -04:00
Joshua Boniface b9f00e3faf Increase flush/unflush wait timeout
Bump this from 10 minutes (60 * 10 seconds) to 30 minutes (180 * 10
seconds) to ensure there is sufficient time for (relatively) large VMs
to migrate with (relatively) slow networking.
2023-09-01 15:42:26 -04:00
Joshua Boniface 4fe6204dfb Use wait on secondary and delay for 15 seconds 2023-09-01 15:42:26 -04:00
Joshua Boniface 43d4f69608 Rename Daemon upgrade playbook to match 2023-09-01 15:42:26 -04:00
Joshua Boniface e55f465034 Reduce timeouts in upgrade playbook 2023-09-01 15:42:26 -04:00
Joshua Boniface 822e39b325 Fix name to be more clear 2023-09-01 15:42:26 -04:00
Joshua Boniface 2d9a5a9d31 Adjust ordering of flush task 2023-09-01 15:42:26 -04:00
Joshua Boniface 1cfbc25f37 Add norestart policy for apt updates 2023-09-01 15:42:25 -04:00
Joshua Boniface ccc6489512 Add README and daemon upgrade playbook, cleanups 2023-09-01 15:42:25 -04:00
Joshua Boniface f34b2a5f7e Add cleanup to update oneshot playbook 2023-09-01 15:42:25 -04:00
Joshua Boniface 0ddd11844e Reorder Ceph stop and lower some waits 2023-09-01 15:42:25 -04:00