366 Commits

Author SHA1 Message Date
a6caac1b78 Add Celery queue routing for tasks
By default, tasks will continue to run as they did, on the primary
coordinator's task runner. However this opens the possibility for
defining more tasks that will run on other nodes or coordinators.
2023-11-04 14:29:59 -04:00
ab629f6b51 Use per-host hostname and queues in worker
Opens up the ability to direct tasks to specific workers.
2023-11-04 13:02:30 -04:00
54215bab6c Switch to ZK+PG over Redis for Celery queue
Redis did not provide a distributed solution for the worker, which
precluded several important planned functions. So instead, move to using
Zookeeper + PostgreSQL as the broker and result backend respectively.

Should be a seamless drop-in change but for future uses requires the
database host to be the primary coordinator IP rather than localhost, so
that writes can occur to the database from non-primary hosts.
2023-11-04 12:46:34 -04:00
64e37ae963 Update OSD replacement functionality
1. Simplify this by leveraging the existing remove_osd/add_osd
functions, since its task was functionally identical to those two in
sequential order.
2. Add support for split OSDs within the command (replacing all OSDs on
the block device(s) as required).
3. Add additional configurability and flexibility around the old device,
weight, and external DB LVs.
2023-11-03 01:45:49 -04:00
980ea6a9e9 Adjust handling of ext_db and _count options
Avoid the use of superfluous flag options, default them to none, and add
support for fixed-size DB LVs.
2023-11-02 13:29:47 -04:00
526a5f4a74 Add support for split OSD adds
Allows creating multiple OSDs on a single (NVMe) block device,
leveraging the "ceph-volume lvm batch" command. Replaces the previous
method of creating OSDs.

Also adds a new ZK item for each OSD indicating if it is split or not.
2023-11-01 21:31:35 -04:00
5b4dd61754 Bump version to 0.9.80 2023-10-27 09:56:31 -04:00
221af3f241 Bump version to 0.9.79 2023-10-24 02:10:24 -04:00
c87736eb0a Use consistent path name and format 2023-10-24 01:20:44 -04:00
63d0a85e29 Add backup deletion command 2023-10-24 01:18:27 -04:00
55ca131c2c Handle snapshots on restore and provide options
Also rename the retain option to remove superfluous plural.
2023-10-24 00:25:06 -04:00
8d256a1737 Complete VM restore functionality 2023-10-23 22:23:17 -04:00
4fc9b15652 Fix bad function name 2023-10-17 10:56:32 -04:00
b997c6f31e Add support for full VM backups
Adds support for exporting full VM backups, including configuration,
metainfo, and RBD disk images, with incremental support.
2023-10-17 10:15:06 -04:00
522da3fd95 Adjust wording for volume create too 2023-10-03 09:42:23 -04:00
3a1bf0724e Mention file_size as bytes 2023-10-03 09:39:19 -04:00
c6c44bf775 Bump version to 0.9.78 2023-09-30 12:57:55 -04:00
bbb940da65 Remove spurious comments 2023-09-30 12:37:58 -04:00
35e27f79ef Fix uploading of non-raw image files
Adds a new API query parameter to define the file size, which is then
used for the temporary image. This is required for, at least VMDK, files
to work properly in qemu-img convert.
2023-09-29 16:19:22 -04:00
7c0f12750e Bump version to 0.9.77 2023-09-19 11:05:55 -04:00
51e78480fa Bump version to 0.9.76 2023-09-18 10:15:52 -04:00
f46bfc962f Bump version to 0.9.75 2023-09-16 23:06:38 -04:00
1a906b589e Bump version to 0.9.74 2023-09-16 00:18:13 -04:00
311bb69785 Format based on updated Black 2023-09-12 16:41:02 -04:00
a8115cafd1 Bump version to 0.9.73 2023-09-02 02:16:19 -04:00
fdda47e8a2 Bump version to 0.9.72 2023-09-01 16:34:45 -04:00
bb2aac145d Bump version to 0.9.71 2023-09-01 00:36:38 -04:00
ec6d3351b2 [Bookworm] Correct Celery invocation 2023-09-01 00:30:01 -04:00
22faaa9bbc [Bookworm] Correct Flask DB migration process
Move the old manage script to _legacy, and add a new _flask version with
modern Flask tooling. Decide which one to call via pvc-api-db-migrate
using /etc/debian_version call.
2023-09-01 00:29:17 -04:00
6c407d54c3 Bump version to 0.9.70 2023-08-31 14:15:54 -04:00
9ba7aa5b08 [Bookworm] Remove obsolete package 2023-08-31 14:13:05 -04:00
83b8ce7b62 Bump version to 0.9.69 (nice) 2023-08-29 22:02:13 -04:00
83d475bd15 Bump version to 0.9.68 2023-08-27 20:59:23 -04:00
705ec802a3 Bump version to 0.9.67 2023-08-27 14:47:20 -04:00
0b90f37518 Bump version to 0.9.66 2023-08-27 11:41:22 -04:00
1e083d7652 Bump version to 0.9.65 2023-08-23 01:56:57 -04:00
075dbe7cc9 Bump version to 0.9.64 2023-08-18 12:34:27 -04:00
e298d10561 Ensure ACPI is included in Deb VMs 2023-08-17 11:16:08 -04:00
fc8cf9ed44 Ensure consistency in variable names and fix bug 2023-08-17 11:09:51 -04:00
3a90fda109 Bump version to 0.9.63 2023-04-28 14:47:04 -04:00
45ad3b9a17 Bump version to 0.9.62 2023-02-22 18:13:45 -05:00
e773211293 Add PVC version to cluster status output 2023-02-22 16:09:24 -05:00
96defebd0b Add last item to swagger doc 2023-02-22 00:25:27 -05:00
e9aa545e9b Update API specification 2023-02-22 00:06:52 -05:00
aeb238f43c Bump version to 0.9.61 2023-02-08 10:08:05 -05:00
e945fd8590 Remove bad casting to int in string compare 2023-01-01 13:55:10 -05:00
a49510ecc8 Bump version to 0.9.60 2022-12-06 15:42:55 -05:00
6d7730ab52 Disable RBD caching by default
Results in a massive (~2x) performance boost for random block I/O inside
VMs, and thus a worthwhile default change.
2022-12-05 17:56:59 -05:00
8135426973 Fix bad ref in example scripts 2022-11-18 12:54:28 -05:00
20d436a745 Update description 2022-11-16 22:48:40 -05:00