Joshua Boniface
5c3ce358df
Update responses for Celery tasks
2024-09-13 11:47:04 -04:00
Joshua Boniface
cf5ee23a18
Fix incorrect default value typos
2024-09-13 11:09:00 -04:00
Joshua Boniface
c766648ed0
Add "mirror" VM state
2024-09-11 10:12:29 -04:00
Joshua Boniface
6960513bbd
Add Ceph block receive (initial)
2024-09-11 00:51:07 -04:00
Joshua Boniface
a2e5df9f6d
Add support for Gunicorn execution
...
Modifies pvcapid to run under Gunicorn when in non-debug mode, instead
of the Flask development server. This is proper practice for one, and
also helps increase performance slightly in some workloads (file uploads
mainly).
2024-09-09 13:20:03 -04:00
Joshua Boniface
73c0834f85
Remove headers and add util to short output
2024-09-06 11:40:39 -04:00
Joshua Boniface
2de999c700
Add total cluster utilization stats
...
Useful for evaluating the cluster resources as a whole.
2024-09-05 16:05:33 -04:00
Joshua Boniface
7543eb839d
Add dedicated volume scan endpoint
...
Allows an imported volume to be scanned for stats independently.
Designed to be used as part of a snapshot import via API, to allow the
"create" to happen before the real import (to check for available space,
etc.) and then run this import after when the RBD volume actually
exists.
2024-09-03 20:32:27 -04:00
Joshua Boniface
8cb44c0c5d
Bump version to 0.9.100
2024-08-30 11:03:33 -04:00
Joshua Boniface
c55021f30c
Update information about detect strings in CLI
2024-08-30 11:02:44 -04:00
Joshua Boniface
783c9e46c2
Only add packages to bookworm repo
...
Deprecates Debian 10 (Buster) and 11 (Bullseye); those versions will not
receive PVC 0.9.100 or newer.
2024-08-30 10:56:24 -04:00
Joshua Boniface
b7f33c1fcb
Update deprecation warning
...
Hotfixes throw a wrench in this, so just make them generic.
2024-08-30 10:55:24 -04:00
Joshua Boniface
0f578d7c7d
Ensure decimals are captured from size regex
2024-08-30 10:51:41 -04:00
Joshua Boniface
f87b96887c
Add detect string parser with nvme
...
Some newer servers do not report NVMe device paths properly using
`lsscsi` as expected. To work around this, add an `nvme`-based detect
parser that is called if the `lsscsi` parser returns a `-` (or None).
2024-08-30 10:41:56 -04:00
Joshua Boniface
02a775c99b
Bump version to 0.9.99
2024-08-28 11:15:55 -04:00
Joshua Boniface
8177d5f8b7
Use absolute path for ZK schema
2024-08-27 09:40:24 -04:00
Joshua Boniface
26d0d08873
Add is-primary command
...
Used by the cron to check if the node firing an autobackup is the
primary node or not, so it will not multi-fire from all coordinators.
2024-08-25 22:09:03 -04:00
Joshua Boniface
f57b8d4a15
Simplify Celery event handling
...
It was far too cumbersome to report every possible stage here in a
consistent way. Realistically, this command will be run silently from
cron 99.95% of the time, so all this overcomplexity to handle individual
Celery state updates just isn't worth it.
2024-08-25 21:59:12 -04:00
Joshua Boniface
10de85cce3
Allow API-only builds and deploy
2024-08-25 20:45:52 -04:00
Joshua Boniface
e938140414
Refactor autobackups to make more sense
2024-08-25 19:21:00 -04:00
Joshua Boniface
fd87a28eb3
Fix bug in API parameters
2024-08-25 19:13:31 -04:00
Joshua Boniface
4ef5fbdbe8
Restore previous autobackup continue behaviour
...
With the original system, the failure of one VM's backups would not
trigger a total fault, thus allowing other backups to complete.
Restore that behaviour.
2024-08-25 17:04:43 -04:00
Joshua Boniface
8fa6bed736
Ensure cron flag triggers truly silent output
2024-08-25 16:35:24 -04:00
Joshua Boniface
f7926726f2
Adjust snapshot name again
2024-08-25 16:20:59 -04:00
Joshua Boniface
de58efdaa9
Ensure email_recipients is always a list
2024-08-25 16:18:19 -04:00
Joshua Boniface
8ca6976892
Re-add cron flag for autobackups
2024-08-25 16:17:41 -04:00
Joshua Boniface
a957218976
Fix staging for summary report
2024-08-25 16:11:35 -04:00
Joshua Boniface
61365e6e01
Adjust autobackup snap name and output messages
2024-08-25 16:09:52 -04:00
Joshua Boniface
35fe16ce75
Revert "Adjust stage naming to reflect autobackup stages"
...
This reverts commit c1f320ede2
2024-08-25 15:58:25 -04:00
Joshua Boniface
c45e488958
Improve output of build-and-deploy
2024-08-25 15:57:07 -04:00
Joshua Boniface
c1f320ede2
Adjust stage naming to reflect autobackup stages
2024-08-25 15:55:16 -04:00
Joshua Boniface
03db9604e1
Ensure recipients is a proper list
2024-08-25 15:55:00 -04:00
Joshua Boniface
f1668bffcc
Refactor autobackups to implement vm.worker defs
...
Avoid trying to subcall other Celery worker tasks, as this just gets
very screwy with the stages. Instead reimplement what is needed directly
here. While this does cause a fair bit of code duplication, I believe
the resulting clarity is worthwhile.
2024-08-25 15:54:03 -04:00
Joshua Boniface
c0686fc5c7
Remove stage overrides
...
These aren't needed after pending refactor.
2024-08-25 15:17:46 -04:00
Joshua Boniface
7ecc05b413
Restart worker after becoming primary
2024-08-25 14:18:18 -04:00
Joshua Boniface
4b37c4fea3
Fix assignment bug
2024-08-25 14:10:59 -04:00
Joshua Boniface
0d918d66fe
Port VM autobackups into pvcworkerd with snaps
...
Moves VM autobackups from being in-CLI to being handled by the
pvcworkerd system on the primary coordinator. Turns the CLI autobackup
command into an actual API client endpoint rather than having its logic
in the CLI.
In addition, modifies the new autobackup to leverage the new "pvc vm
snapshot" function set, just with special snapshot names. This helps
automate this within the new snapshot scaffolding.
2024-08-23 17:23:06 -04:00
Joshua Boniface
fd199f405b
Add deprection warning to pvc vm backup commands
2024-08-23 17:04:15 -04:00
Joshua Boniface
f6c009beac
Allow overriding stages in some commands
...
This allows them to be called by autobackup commands while still
preserving the current Celery report flow.
2024-08-23 11:21:02 -04:00
Joshua Boniface
fc89f4f2f5
Fix error message contents
2024-08-23 10:23:51 -04:00
Joshua Boniface
565011b277
Set snapshot name before start
2024-08-20 23:01:52 -04:00
Joshua Boniface
0bf9cc6b06
Improve stage handling
...
Run start() at the beginning, and leverage the new tweaks to the CLI to
update the total steps later. Allows errors to be handled gracefully
2024-08-20 17:50:27 -04:00
Joshua Boniface
f2dfada73e
Improve return handling for snapshot tasks
2024-08-20 17:40:44 -04:00
Joshua Boniface
f63c392ba6
Show primary status in node run_on
2024-08-20 17:32:33 -04:00
Joshua Boniface
7663ad72c5
Update length of progress bar each update
...
Allows us to start with a lower length, and increase it later.
2024-08-20 17:22:15 -04:00
Joshua Boniface
9b3075be18
Add UUID check and fix wording
...
Don't suggest renaming any more as it's not enough.
2024-08-20 17:05:27 -04:00
Joshua Boniface
9a661d0173
Convert VM snapshots to worker tasks
...
Improves manageability and offloads these from the API context.
2024-08-20 16:50:41 -04:00
Joshua Boniface
4a0680b27f
Fix issues with snapshot imports
2024-08-20 13:59:05 -04:00
Joshua Boniface
6597f7aef6
Fix bad function call
2024-08-20 12:58:17 -04:00
Joshua Boniface
f42a1bad0e
Allow passing zk_only into VM snapshot creation
2024-08-20 12:57:53 -04:00
Joshua Boniface