Commit Graph

52 Commits

Author SHA1 Message Date
Joshua Boniface 8e104113d7 Tune Zookeeper memory usage
Use Xms and Xmx=128M to reduce overall Zookeeper memory usage.
2020-12-21 00:20:45 -05:00
Joshua Boniface 28c86d170f Don't use libjemalloc for Ceph daemons
This was an artifact of a much, much older Ceph configuration I ran, and
is not relevant with newer Ceph versions like those used in PVC.
Performance testing with Nautilus and Bluestore reveals a minimal
performance hit, and using `jemalloc` prevents cache autotuning from
being effective, so remove it.
2020-12-21 00:20:45 -05:00
Joshua Boniface 3c0c3e8e56 Add jute.maxbuffer to Zookeeper environment ops
Adds this option based on the findings of
https://github.com/python-zk/kazoo/issues/630, whereby restores of >1MB
in size would fail. This is considered an unsafe option, but given our
usecase no actual znode should ever exceed this limit; this is purely
for the large transactions that come from a `pvc task restore` action to
an empty Zookeeper instance.
2020-11-24 12:20:25 -05:00
Joshua Boniface 934f73af0f Support using existing SSL certs on system
Add the additional pvc_api_ssl_cert_path and pvc_api_ssl_key_path
group_vars options, which can be used to set the SSL details to existing
files on the filesystem if desired. If these are empty (or nonexistent),
the original pvc_api_ssl_cert and pvc_api_ssl_key raw format options
will be used as they were.

Allows the administrator to use outside methods (such as Let's Encrypt)
to obtain the certs locally on the system, avoiding changes to the
group_vars and redeployment to manage SSL keys.
2020-08-26 14:11:14 -04:00
Joshua Boniface 2f2123b70e Rename remaining "pvc_prov" items to pvc_api 2020-08-25 13:01:48 -04:00
Joshua Boniface d79c587384 Change name of default API database
From pvcprov to pvcapi to reflect the changing use of this database.
2020-08-25 02:00:29 -04:00
Joshua Boniface e32dfe6200 Add additional configuration to group_vars
Also include defaults and the new pvc_vm_shutdown_timeout option.
2020-08-20 21:39:44 -04:00
Joshua Boniface 774595cdb7 Ensure ZK prioritizes IPv4 2020-08-19 13:10:03 -04:00
Joshua Boniface c9b487f5e6 Use FQDN for Zookeeper server entries 2020-08-19 12:47:06 -04:00
Joshua Boniface 69b0590b54 Add storage components to default pvcnoded.yaml 2020-06-06 21:15:10 -04:00
Joshua Boniface af1927e384 Use consistent naming in patroni.yml 2020-04-06 14:33:13 -04:00
Joshua Boniface f90f8f33da Use short names in PVC configs 2020-04-06 13:54:39 -04:00
Joshua Boniface f560f55010 Use shortname for Zookeeper 2020-04-06 13:45:29 -04:00
Joshua Boniface fe40811f2b Fix conditional checks with inventory_hostname 2020-04-06 13:36:38 -04:00
Joshua Boniface 67d1f6761a Use new package and file names
References parallelvirtualclient/pvc#79
2020-02-08 19:47:47 -05:00
Joshua Boniface cd7cdf2719 Add bridge_device entry to config
Used to properly allow bridged networks to be formed.

Ref parallelvirtualcluster/pvc#64
2020-01-06 14:35:25 -05:00
Joshua Boniface af606ac49c Change ordering of networks in file 2019-12-25 13:31:02 -05:00
Joshua Boniface bf4de842d8 Correct bad address in pvcd.yaml 2019-12-25 12:57:51 -05:00
Joshua Boniface c5da6381c9 Set provisioner database in pvcd.yaml 2019-12-25 12:37:32 -05:00
Joshua Boniface 73617fa1a6 Change Patroni scope to just pvc 2019-12-24 14:15:39 -05:00
Joshua Boniface a10fc7eb3f Move netmask to separate config 2019-12-24 14:15:14 -05:00
Joshua Boniface 93f44dd9dc Add additional API configuration 2019-12-23 23:25:27 -05:00
Joshua Boniface 80fdc88235 Improve script to run ZK cleanup on all hosts 2019-12-01 20:29:47 -05:00
Joshua Boniface 6a29400525 Make vacuum script more comprehensive 2019-12-01 20:24:18 -05:00
Joshua Boniface 273c048e6a Add check_mk check for PVC status 2019-10-24 09:46:10 -04:00
Joshua Boniface 0336cd998f Improve daily vacuum script 2019-10-24 09:43:24 -04:00
Joshua Boniface 7f5a7e48f8 Add daily Zookeeper data cleanup 2019-08-26 11:09:23 -04:00
Joshua Boniface ef9673de02 Add custom systemd unit for Zookeeper
We're 100% systemd here, and the lack of control/information that the
old-school ZK initscript provides is frustrating. Replace it with our
own simple unit file.
2019-08-26 11:06:30 -04:00
Joshua Boniface b75e84a124 Add logrotate configuration 2019-08-11 15:41:10 -04:00
Joshua Boniface 030a3ded99 Add daily Postgres vacuum script 2019-08-11 15:29:00 -04:00
Joshua Boniface 91509720ac Add Zookeeper autopurge @72h 2019-08-05 13:16:09 -04:00
Joshua Boniface 005ba71fc8 Update config template with recent changes
1) Add debug flag
2) Move intervals config up one level
2019-08-01 13:21:12 -04:00
Joshua Boniface ada3cb1d87 Set debug value in API config 2019-07-26 11:44:08 -04:00
Joshua Boniface db2c77d330 Support new log flags and update default log conf
Tweak the defaults a bit; pvc-ansible assumes we're running under
systemd, so set a log format that's better for it (no colour or date).
2019-07-10 21:49:38 -04:00
Joshua Boniface 0d562b829c Replace tabs with spaces 2019-07-08 19:24:59 -04:00
Joshua Boniface 6319241df9 Remove bad content from pvc-api.yml 2019-07-08 19:03:08 -04:00
Joshua Boniface e98649c417 Add quote around ZK nodes in Patroni 2019-07-08 16:59:12 -04:00
Joshua Boniface 75182b1570 Complete configuration of API via Ansible 2019-07-08 11:33:14 -04:00
Joshua Boniface d19e006f28 Enable client API in Daemon config 2019-07-06 02:50:05 -04:00
Joshua Boniface c438d2c9cd Add client API to configuration 2019-07-06 02:49:25 -04:00
Joshua Boniface 12d30acf90 Add only coordinators in Patroni config 2019-07-06 02:49:05 -04:00
Joshua Boniface 140e044e96 Make libvirt listen only on cluster IP 2019-06-25 22:12:44 -04:00
Joshua Boniface 9711a31580 Set nicer default Patroni values re: replication 2019-06-23 21:03:24 -04:00
Joshua Boniface 4b5237ac5e Support for detailed keepalive logging 2019-06-18 19:56:46 -04:00
Joshua Boniface a5ebc95427 Support configurable logging settings 2019-06-18 12:51:08 -04:00
Joshua Boniface 2ccabb7a2f Enable storage support 2019-06-18 11:12:18 -04:00
Joshua Boniface c288111c2f Add MTU configuration and update for new layout 2019-06-17 23:46:35 -04:00
Joshua Boniface 2320f50621 Improve handling around loop var and correct pvcd 2019-06-12 23:24:27 -04:00
Joshua Boniface 1c1d2b95fc Make things even nicer 2019-06-11 16:32:16 -04:00
Joshua Boniface 586cec72ee Define secret key properly 2019-06-11 13:38:10 -04:00