Joshua Boniface joshuaboniface
  • Joined on 2021-10-28
joshuaboniface pushed to master at parallelvirtualcl…/pvc 2023-11-09 15:26:15 -05:00
08d7e24571 Clean up dangling references to cmd pipes
9dce4ec09d Port OSD on-node tasks to Celery worker system
Compare 2 commits »
joshuaboniface pushed to master at parallelvirtualcl…/pvc 2023-11-09 15:24:58 -05:00
5692aab928 Clean up dangling references to cmd pipes
76e389d342 Port OSD on-node tasks to Celery worker system
Compare 2 commits »
joshuaboniface pushed to master at parallelvirtualcl…/pvc 2023-11-09 15:16:26 -05:00
5e90547f28 Clean up dangling references to cmd pipes
d974819cce Port OSD on-node tasks to Celery worker system
Compare 2 commits »
joshuaboniface pushed to master at parallelvirtualcl…/pvc 2023-11-09 14:50:18 -05:00
a618d218e9 Clean up dangling references to cmd pipes
37b671fae4 Port OSD on-node tasks to Celery worker system
Compare 2 commits »
joshuaboniface commented on issue parallelvirtualcl…/pvc#166 2023-11-08 12:35:19 -05:00
Move to Celery jobs for per-node tasks

VM tasks are implemented; next up are OSD tasks.

joshuaboniface opened issue parallelvirtualcl…/pvc#167 2023-11-08 12:30:32 -05:00
Add more configurable settings for VMs
joshuaboniface pushed to master at parallelvirtualcl…/pvc 2023-11-06 20:41:10 -05:00
89681d54b9 Port VM on-node tasks to Celery worker system
f0c2e9d295 Don't start pvcapid-worker on primary
Compare 2 commits »
joshuaboniface pushed to master at parallelvirtualcl…/pvc-ansible 2023-11-05 23:38:05 -05:00
c8764159f6 Readd queue configuration with updated options
joshuaboniface pushed to master at parallelvirtualcl…/pvc-ansible 2023-11-05 22:53:23 -05:00
523f7da71e Add KeyDB (Redis clone) to configuration
joshuaboniface pushed to master at parallelvirtualcl…/pvc 2023-11-05 19:27:24 -05:00
2c15036f86 Add KeyDB to node startup services
42ed6f6420 Remove redis as a dependency
3dc1f57de2 Revert "Switch to ZK+PG over Redis for Celery queue"
b99b4e64b2 Ensure store path is passed properly
Compare 4 commits »
joshuaboniface commented on issue parallelvirtualcl…/pvc#165 2023-11-04 15:29:59 -04:00
Move to Zookeeper as API worker broker

Code written and merged. Can use a custom kwarg in the function calls (likely always run_on in combination with the `@celery.task(..., routing_key='run_on'), to set the delegation for tasks that…

joshuaboniface commented on issue parallelvirtualcl…/pvc#166 2023-11-04 15:24:44 -04:00
Move to Celery jobs for per-node tasks

VM tasks are easier to test, so going to do those first.

joshuaboniface pushed to master at parallelvirtualcl…/pvc 2023-11-04 15:18:21 -04:00
91af1175ef Fix missing CLI_CONFIG in echo()
af8a8d969e Ensure queues are set up for non-coordinator nodes
a6caac1b78 Add Celery queue routing for tasks
30d7e49401 Start API worker with node daemon on coordinators
ab629f6b51 Use per-host hostname and queues in worker
Compare 43 commits »
joshuaboniface opened issue parallelvirtualcl…/pvc#166 2023-11-04 15:15:41 -04:00
Move to Celery jobs for per-node tasks
joshuaboniface commented on issue parallelvirtualcl…/pvc#165 2023-11-04 12:56:55 -04:00
Move to Zookeeper as API worker broker

Was able to get this to work with Zookeeper as the message transport and PostgreSQL as the results backend, and it seems to work fine.

joshuaboniface closed issue parallelvirtualcl…/pvc#165 2023-11-04 12:56:55 -04:00
Move to Zookeeper as API worker broker
joshuaboniface pushed to master at parallelvirtualcl…/pvc-ansible 2023-11-04 12:55:57 -04:00
2f9603c82f Adjust pvcapid.yaml for 0.9.81 worker queue config
e15e2dfaab Remove erroneous netmask from floating IP defaults
Compare 2 commits »
joshuaboniface commented on issue parallelvirtualcl…/pvc#165 2023-11-04 03:47:33 -04:00
Move to Zookeeper as API worker broker

Well, that's impossible, because the Redis devs are lazy. Support every random-ass thing under the sun but not ETCd or Zookeeper (i.e. sensible KV stores).

I guess the only option is to hack in…

joshuaboniface opened issue parallelvirtualcl…/pvc#165 2023-11-04 03:26:52 -04:00
Move to Zookeeper as API worker broker
joshuaboniface pushed to master at parallelvirtualcl…/pvc-ansible 2023-11-03 14:26:04 -04:00
103e9fe147 Add restart overrides for ceph-mgr