Joshua Boniface
fb8561cc5d
Actually fix incremental sending
2024-09-30 17:00:18 -04:00
Joshua Boniface
5f7aa0b2d6
Improve incremental send speed
2024-09-30 04:15:17 -04:00
Joshua Boniface
7fac7a62cf
Clean up debug print statements
2024-09-30 03:51:39 -04:00
Joshua Boniface
b19642aa2e
Fix bug where snapshot rollback was never called
2024-09-30 03:04:35 -04:00
Joshua Boniface
974e0d6ac2
Shorten progress bars to 20 characters
...
They were needlessly long and this limited the message size.
2024-09-30 03:04:10 -04:00
Joshua Boniface
7785166a7e
Finish working implementation of send/receive
...
Required some significant refactoring due to issues with the diff send,
but it works.
2024-09-30 02:53:23 -04:00
Joshua Boniface
34f0a2f388
Add mostly complete implementation of VM send
2024-09-29 01:31:13 -04:00
Joshua Boniface
8fa37d21c0
Fix handling of invalid network lengths
2024-09-29 00:39:53 -04:00
Joshua Boniface
f462ebbc6b
Add VM snapshot send (initial)
2024-09-28 10:49:35 -04:00
Joshua Boniface
0d533f3658
Rework task output bar operation
...
Allows sending constant updates including changes to the message within
the same task.
2024-09-28 10:48:39 -04:00
Joshua Boniface
792d135950
Update responses for Celery tasks
2024-09-28 02:01:56 -04:00
Joshua Boniface
a64e0c1985
Fix incorrect default value typos
2024-09-28 02:01:56 -04:00
Joshua Boniface
1cbadb1172
Add "mirror" VM state
2024-09-28 02:01:56 -04:00
Joshua Boniface
b1c4b2e928
Add Ceph block receive (initial)
2024-09-28 02:01:56 -04:00
Joshua Boniface
7fe1262887
Fix indentation in faults
2024-09-28 02:01:33 -04:00
Joshua Boniface
0e389ba1f4
Fix bug when setting split count = 1
...
Would set the OSD as split in Zookeeper, even though it wasn't.
2024-09-23 13:06:05 -04:00
Joshua Boniface
41cd34ba4d
Allow specifying job names for benchmarks
2024-09-18 14:55:12 -04:00
Joshua Boniface
736762901c
Update benchmarks to include resource utilization
...
Adds additional polled information on node cpu, memory, and network
bandwidth for the node running the test. This should provide additional
useful information about the results of the test.
Also bumps the test format to 2 to ensure clients can handle the changes
properly.
2024-09-18 14:32:03 -04:00
Joshua Boniface
ecb812ccac
Update linting for pvcapid recent changes
2024-09-18 10:18:50 -04:00
Joshua Boniface
a2e5df9f6d
Add support for Gunicorn execution
...
Modifies pvcapid to run under Gunicorn when in non-debug mode, instead
of the Flask development server. This is proper practice for one, and
also helps increase performance slightly in some workloads (file uploads
mainly).
2024-09-09 13:20:03 -04:00
Joshua Boniface
73c0834f85
Remove headers and add util to short output
2024-09-06 11:40:39 -04:00
Joshua Boniface
2de999c700
Add total cluster utilization stats
...
Useful for evaluating the cluster resources as a whole.
2024-09-05 16:05:33 -04:00
Joshua Boniface
7543eb839d
Add dedicated volume scan endpoint
...
Allows an imported volume to be scanned for stats independently.
Designed to be used as part of a snapshot import via API, to allow the
"create" to happen before the real import (to check for available space,
etc.) and then run this import after when the RBD volume actually
exists.
2024-09-03 20:32:27 -04:00
Joshua Boniface
8cb44c0c5d
Bump version to 0.9.100
2024-08-30 11:03:33 -04:00
Joshua Boniface
c55021f30c
Update information about detect strings in CLI
2024-08-30 11:02:44 -04:00
Joshua Boniface
783c9e46c2
Only add packages to bookworm repo
...
Deprecates Debian 10 (Buster) and 11 (Bullseye); those versions will not
receive PVC 0.9.100 or newer.
2024-08-30 10:56:24 -04:00
Joshua Boniface
b7f33c1fcb
Update deprecation warning
...
Hotfixes throw a wrench in this, so just make them generic.
2024-08-30 10:55:24 -04:00
Joshua Boniface
0f578d7c7d
Ensure decimals are captured from size regex
2024-08-30 10:51:41 -04:00
Joshua Boniface
f87b96887c
Add detect string parser with nvme
...
Some newer servers do not report NVMe device paths properly using
`lsscsi` as expected. To work around this, add an `nvme`-based detect
parser that is called if the `lsscsi` parser returns a `-` (or None).
2024-08-30 10:41:56 -04:00
Joshua Boniface
02a775c99b
Bump version to 0.9.99
2024-08-28 11:15:55 -04:00
Joshua Boniface
8177d5f8b7
Use absolute path for ZK schema
2024-08-27 09:40:24 -04:00
Joshua Boniface
26d0d08873
Add is-primary command
...
Used by the cron to check if the node firing an autobackup is the
primary node or not, so it will not multi-fire from all coordinators.
2024-08-25 22:09:03 -04:00
Joshua Boniface
f57b8d4a15
Simplify Celery event handling
...
It was far too cumbersome to report every possible stage here in a
consistent way. Realistically, this command will be run silently from
cron 99.95% of the time, so all this overcomplexity to handle individual
Celery state updates just isn't worth it.
2024-08-25 21:59:12 -04:00
Joshua Boniface
10de85cce3
Allow API-only builds and deploy
2024-08-25 20:45:52 -04:00
Joshua Boniface
e938140414
Refactor autobackups to make more sense
2024-08-25 19:21:00 -04:00
Joshua Boniface
fd87a28eb3
Fix bug in API parameters
2024-08-25 19:13:31 -04:00
Joshua Boniface
4ef5fbdbe8
Restore previous autobackup continue behaviour
...
With the original system, the failure of one VM's backups would not
trigger a total fault, thus allowing other backups to complete.
Restore that behaviour.
2024-08-25 17:04:43 -04:00
Joshua Boniface
8fa6bed736
Ensure cron flag triggers truly silent output
2024-08-25 16:35:24 -04:00
Joshua Boniface
f7926726f2
Adjust snapshot name again
2024-08-25 16:20:59 -04:00
Joshua Boniface
de58efdaa9
Ensure email_recipients is always a list
2024-08-25 16:18:19 -04:00
Joshua Boniface
8ca6976892
Re-add cron flag for autobackups
2024-08-25 16:17:41 -04:00
Joshua Boniface
a957218976
Fix staging for summary report
2024-08-25 16:11:35 -04:00
Joshua Boniface
61365e6e01
Adjust autobackup snap name and output messages
2024-08-25 16:09:52 -04:00
Joshua Boniface
35fe16ce75
Revert "Adjust stage naming to reflect autobackup stages"
...
This reverts commit c1f320ede2
2024-08-25 15:58:25 -04:00
Joshua Boniface
c45e488958
Improve output of build-and-deploy
2024-08-25 15:57:07 -04:00
Joshua Boniface
c1f320ede2
Adjust stage naming to reflect autobackup stages
2024-08-25 15:55:16 -04:00
Joshua Boniface
03db9604e1
Ensure recipients is a proper list
2024-08-25 15:55:00 -04:00
Joshua Boniface
f1668bffcc
Refactor autobackups to implement vm.worker defs
...
Avoid trying to subcall other Celery worker tasks, as this just gets
very screwy with the stages. Instead reimplement what is needed directly
here. While this does cause a fair bit of code duplication, I believe
the resulting clarity is worthwhile.
2024-08-25 15:54:03 -04:00
Joshua Boniface
c0686fc5c7
Remove stage overrides
...
These aren't needed after pending refactor.
2024-08-25 15:17:46 -04:00
Joshua Boniface
7ecc05b413
Restart worker after becoming primary
2024-08-25 14:18:18 -04:00
Joshua Boniface