Joshua Boniface
b03ecf0125
Add -XX:+AlwaysPreTouch option for Zookeeper
2023-09-01 15:42:26 -04:00
Joshua Boniface
b842276002
Lower keep count for Zookeeper vacuum to 3
...
Required to keep disk space growth down when using zookeeper_logging
functionality.
2023-09-01 15:42:26 -04:00
Joshua Boniface
2d31e6c8ea
Fix memory tuning issues
2023-09-01 15:42:26 -04:00
Joshua Boniface
a52d4cbf37
Add Zookeeper logging configs
2023-09-01 15:42:26 -04:00
Joshua Boniface
31a677b444
Fix Patroni ACL to use subnet mask
2023-09-01 15:42:26 -04:00
Joshua Boniface
a2ed38b459
Add generic SR-IOV configuration
2023-09-01 15:42:26 -04:00
Joshua Boniface
388db6ad1d
Use IPs for Patroni configuration
2023-09-01 15:42:26 -04:00
Joshua Boniface
d455b31905
Bump max connections in Zookeeper to 200
2023-09-01 15:42:26 -04:00
Joshua Boniface
f105f0497c
Configure Zookeeper only on Cluster address
2023-09-01 15:42:26 -04:00
Joshua Boniface
0bbb91fc8b
Add override custom libvirtd.service unit
...
This has no functional change on Buster, but on Bullseye this overrides
the stupid socket-based activation shenanigans that the default unit
tries to do, as well as the breaking replacement of the
/etc/default/libvirt variable names.
2023-09-01 15:42:26 -04:00
Joshua Boniface
a77e41bf7c
Remove invalid timezone entries in postgres conf
2023-09-01 15:42:25 -04:00
Joshua Boniface
be94bc134f
Add configurable ZK memory limits
2023-09-01 15:42:24 -04:00
Joshua Boniface
2bd5cc5a25
Tune Zookeeper memory usage
...
Use Xms and Xmx=128M to reduce overall Zookeeper memory usage.
2023-09-01 15:42:24 -04:00
Joshua Boniface
24764fe704
Don't use libjemalloc for Ceph daemons
...
This was an artifact of a much, much older Ceph configuration I ran, and
is not relevant with newer Ceph versions like those used in PVC.
Performance testing with Nautilus and Bluestore reveals a minimal
performance hit, and using `jemalloc` prevents cache autotuning from
being effective, so remove it.
2023-09-01 15:42:24 -04:00
Joshua Boniface
bcb5962353
Add jute.maxbuffer to Zookeeper environment ops
...
Adds this option based on the findings of
https://github.com/python-zk/kazoo/issues/630 , whereby restores of >1MB
in size would fail. This is considered an unsafe option, but given our
usecase no actual znode should ever exceed this limit; this is purely
for the large transactions that come from a `pvc task restore` action to
an empty Zookeeper instance.
2023-09-01 15:42:24 -04:00
Joshua Boniface
f79fb605de
Support using existing SSL certs on system
...
Add the additional pvc_api_ssl_cert_path and pvc_api_ssl_key_path
group_vars options, which can be used to set the SSL details to existing
files on the filesystem if desired. If these are empty (or nonexistent),
the original pvc_api_ssl_cert and pvc_api_ssl_key raw format options
will be used as they were.
Allows the administrator to use outside methods (such as Let's Encrypt)
to obtain the certs locally on the system, avoiding changes to the
group_vars and redeployment to manage SSL keys.
2023-09-01 15:42:24 -04:00
Joshua Boniface
2caed2ae12
Rename remaining "pvc_prov" items to pvc_api
2023-09-01 15:42:24 -04:00
Joshua Boniface
2a2d318dbc
Change name of default API database
...
From pvcprov to pvcapi to reflect the changing use of this database.
2023-09-01 15:42:24 -04:00
Joshua Boniface
8109f13386
Add additional configuration to group_vars
...
Also include defaults and the new pvc_vm_shutdown_timeout option.
2023-09-01 15:42:24 -04:00
Joshua Boniface
72df058684
Ensure ZK prioritizes IPv4
2023-09-01 15:42:24 -04:00
Joshua Boniface
457e18a850
Use FQDN for Zookeeper server entries
2023-09-01 15:42:24 -04:00
Joshua Boniface
e3ad750412
Add storage components to default pvcnoded.yaml
2023-09-01 15:42:23 -04:00
Joshua Boniface
92ccc0a737
Use consistent naming in patroni.yml
2023-09-01 15:42:23 -04:00
Joshua Boniface
c35c58389d
Use short names in PVC configs
2023-09-01 15:42:23 -04:00
Joshua Boniface
157c56fd46
Use shortname for Zookeeper
2023-09-01 15:42:23 -04:00
Joshua Boniface
52862f9daf
Fix conditional checks with inventory_hostname
2023-09-01 15:42:23 -04:00
Joshua Boniface
0e5cb688dc
Use new package and file names
...
References parallelvirtualclient/pvc#79
2023-09-01 15:42:23 -04:00
Joshua Boniface
f68ba7a735
Add bridge_device entry to config
...
Used to properly allow bridged networks to be formed.
Ref parallelvirtualcluster/pvc#64
2023-09-01 15:42:22 -04:00
Joshua Boniface
15768130e2
Change ordering of networks in file
2023-09-01 15:42:22 -04:00
Joshua Boniface
4a17a9918a
Correct bad address in pvcd.yaml
2023-09-01 15:42:22 -04:00
Joshua Boniface
744e3d0988
Set provisioner database in pvcd.yaml
2023-09-01 15:42:22 -04:00
Joshua Boniface
45185c5a16
Change Patroni scope to just pvc
2023-09-01 15:42:22 -04:00
Joshua Boniface
21c9aa3e6a
Move netmask to separate config
2023-09-01 15:42:22 -04:00
Joshua Boniface
f1e31ed169
Add additional API configuration
2023-09-01 15:42:22 -04:00
Joshua Boniface
6ce036f61e
Improve script to run ZK cleanup on all hosts
2023-09-01 15:42:22 -04:00
Joshua Boniface
7689e659fe
Make vacuum script more comprehensive
2023-09-01 15:42:21 -04:00
Joshua Boniface
8163769183
Add check_mk check for PVC status
2023-09-01 15:42:21 -04:00
Joshua Boniface
2e0d5c9d44
Improve daily vacuum script
2023-09-01 15:42:21 -04:00
Joshua Boniface
94ef3490ab
Add daily Zookeeper data cleanup
2023-09-01 15:42:21 -04:00
Joshua Boniface
15a2bf1418
Add custom systemd unit for Zookeeper
...
We're 100% systemd here, and the lack of control/information that the
old-school ZK initscript provides is frustrating. Replace it with our
own simple unit file.
2023-09-01 15:42:21 -04:00
Joshua Boniface
f98a2ee433
Add logrotate configuration
2023-09-01 15:42:21 -04:00
Joshua Boniface
c0acd3e994
Add daily Postgres vacuum script
2023-09-01 15:42:21 -04:00
Joshua Boniface
2cee9f08a0
Add Zookeeper autopurge @72h
2023-09-01 15:42:21 -04:00
Joshua Boniface
c83995ff1d
Update config template with recent changes
...
1) Add debug flag
2) Move intervals config up one level
2023-09-01 15:42:21 -04:00
Joshua Boniface
41c2dcd330
Set debug value in API config
2023-09-01 15:42:21 -04:00
Joshua Boniface
1e562a58da
Support new log flags and update default log conf
...
Tweak the defaults a bit; pvc-ansible assumes we're running under
systemd, so set a log format that's better for it (no colour or date).
2023-09-01 15:42:21 -04:00
Joshua Boniface
035aef7c47
Replace tabs with spaces
2023-09-01 15:42:21 -04:00
Joshua Boniface
72d22a9c3c
Remove bad content from pvc-api.yml
2023-09-01 15:42:21 -04:00
Joshua Boniface
36657e28f9
Add quote around ZK nodes in Patroni
2023-09-01 15:42:21 -04:00
Joshua Boniface
5d3de3ece2
Complete configuration of API via Ansible
2023-09-01 15:42:21 -04:00
Joshua Boniface
32bcbbeca0
Enable client API in Daemon config
2023-09-01 15:42:21 -04:00
Joshua Boniface
d5516d891c
Add client API to configuration
2023-09-01 15:42:21 -04:00
Joshua Boniface
c5b07fcdad
Add only coordinators in Patroni config
2023-09-01 15:42:21 -04:00
Joshua Boniface
c4382eb208
Make libvirt listen only on cluster IP
2023-09-01 15:42:20 -04:00
Joshua Boniface
e118267843
Set nicer default Patroni values re: replication
2023-09-01 15:42:20 -04:00
Joshua Boniface
c4825e6de6
Support for detailed keepalive logging
2023-09-01 15:42:20 -04:00
Joshua Boniface
d277d18c35
Support configurable logging settings
2023-09-01 15:42:20 -04:00
Joshua Boniface
87f5fc527d
Enable storage support
2023-09-01 15:42:20 -04:00
Joshua Boniface
f1cca0e22f
Add MTU configuration and update for new layout
2023-09-01 15:42:20 -04:00
Joshua Boniface
fbd0ed9390
Improve handling around loop var and correct pvcd
2023-09-01 15:42:19 -04:00
Joshua Boniface
8fbbce3d16
Make things even nicer
2023-09-01 15:42:19 -04:00
Joshua Boniface
a22203c887
Define secret key properly
2023-09-01 15:42:19 -04:00
Joshua Boniface
54321b5fb4
Load jemalloc 2
2023-09-01 15:42:19 -04:00
Joshua Boniface
6dfaf433dc
Initial commit of PVC Ansible role
2023-09-01 15:42:19 -04:00