Commit Graph

198 Commits

Author SHA1 Message Date
Joshua Boniface f5cd8a94c2 Handle creation and collection on bootstrap better 2020-02-15 23:01:32 -05:00
Joshua Boniface b922d47458 Use new in-built database migrations in API 2020-02-15 22:49:48 -05:00
Joshua Boniface 67d1f6761a Use new package and file names
References parallelvirtualclient/pvc#79
2020-02-08 19:47:47 -05:00
Joshua Boniface 94f2cd5c86 Don't mess with upstream at all during bootstrap
This caused some major breakage and is not required.
2020-01-13 15:12:54 -05:00
Joshua Boniface 7d6052f9cb Modify add_cluster_ips to support new bridges 2020-01-12 19:46:27 -05:00
Joshua Boniface 00315e01c3 Enable and start vhostmd service 2020-01-07 10:45:12 -05:00
Joshua Boniface d9b3f15381 Add source_volume column to storage table 2020-01-06 23:54:48 -05:00
Joshua Boniface 03779056c7 Add new empty script entry 2020-01-06 23:54:48 -05:00
Joshua Boniface cd7cdf2719 Add bridge_device entry to config
Used to properly allow bridged networks to be formed.

Ref parallelvirtualcluster/pvc#64
2020-01-06 14:35:25 -05:00
Joshua Boniface a1efa2f01a Fix additional reference to userdata_template 2020-01-04 13:41:03 -05:00
Joshua Boniface 761715d015 Adjust provisioner database schema 2020-01-04 12:13:11 -05:00
Joshua Boniface dcd3194432 Set msgr2 mode on Ceph monitors 2019-12-30 09:13:50 -05:00
Joshua Boniface a66d17252f Apply fix with some tweaks to other serial handlers 2019-12-25 13:45:29 -05:00
Joshua Boniface af606ac49c Change ordering of networks in file 2019-12-25 13:31:02 -05:00
Joshua Boniface a30edbfa54 Replace broken "serial" restarts with a new method 2019-12-25 13:30:37 -05:00
Joshua Boniface bf4de842d8 Correct bad address in pvcd.yaml 2019-12-25 12:57:51 -05:00
Joshua Boniface c5da6381c9 Set provisioner database in pvcd.yaml 2019-12-25 12:37:32 -05:00
Joshua Boniface 1dda60d301 Add and remove floating IP during cluster bootstrap 2019-12-25 12:12:53 -05:00
Joshua Boniface ee948cb91c Move netmask to separate config part 3 2019-12-24 14:27:31 -05:00
Joshua Boniface 79dd0cd4bc Ensure the Patroni ZK is clean for bootstrap 2019-12-24 14:17:41 -05:00
Joshua Boniface 06467b64ea Move netmask to separate config part 2 2019-12-24 14:16:20 -05:00
Joshua Boniface 22c6c13f0f Don't try to do crazy restart ordering, it fails 2019-12-24 14:15:52 -05:00
Joshua Boniface 73617fa1a6 Change Patroni scope to just pvc 2019-12-24 14:15:39 -05:00
Joshua Boniface a10fc7eb3f Move netmask to separate config 2019-12-24 14:15:14 -05:00
Joshua Boniface ebee10747c Use API endpoint to bootstrap PVC cluster 2019-12-24 09:08:21 -05:00
Joshua Boniface 93f44dd9dc Add additional API configuration 2019-12-23 23:25:27 -05:00
Joshua Boniface a37f511241 Install Provisioner schema to database 2019-12-23 23:19:09 -05:00
Joshua Boniface e08e19ee64 Add provisioner database schema 2019-12-23 12:58:03 -05:00
Joshua Boniface 4d2ef3b622 Remove empty newline 2019-12-23 12:57:46 -05:00
Joshua Boniface 64157e8c89 Remove invalid flag to ceph-authtool 2019-12-14 14:10:35 -05:00
Joshua Boniface 6bfc83e8f3 Don't become for uuidgen 2019-12-14 13:51:43 -05:00
Joshua Boniface 1c2f972e93 Move Ceph access to storage network 2019-12-14 13:14:21 -05:00
Joshua Boniface 80fdc88235 Improve script to run ZK cleanup on all hosts 2019-12-01 20:29:47 -05:00
Joshua Boniface d78d682fe5 Add jq dependency 2019-12-01 20:26:08 -05:00
Joshua Boniface 6a29400525 Make vacuum script more comprehensive 2019-12-01 20:24:18 -05:00
Joshua Boniface 273c048e6a Add check_mk check for PVC status 2019-10-24 09:46:10 -04:00
Joshua Boniface 0336cd998f Improve daily vacuum script 2019-10-24 09:43:24 -04:00
Joshua Boniface 7f5a7e48f8 Add daily Zookeeper data cleanup 2019-08-26 11:09:23 -04:00
Joshua Boniface ef9673de02 Add custom systemd unit for Zookeeper
We're 100% systemd here, and the lack of control/information that the
old-school ZK initscript provides is frustrating. Replace it with our
own simple unit file.
2019-08-26 11:06:30 -04:00
Joshua Boniface b75e84a124 Add logrotate configuration 2019-08-11 15:41:10 -04:00
Joshua Boniface 030a3ded99 Add daily Postgres vacuum script 2019-08-11 15:29:00 -04:00
Joshua Boniface 91509720ac Add Zookeeper autopurge @72h 2019-08-05 13:16:09 -04:00
Joshua Boniface 005ba71fc8 Update config template with recent changes
1) Add debug flag
2) Move intervals config up one level
2019-08-01 13:21:12 -04:00
Joshua Boniface ada3cb1d87 Set debug value in API config 2019-07-26 11:44:08 -04:00
Joshua Boniface dc27564157 Limit database tasks to coordinators only
Non-coordinators don't need these configurations as they shouldn't run
there.
2019-07-11 19:58:56 -04:00
Joshua Boniface db2c77d330 Support new log flags and update default log conf
Tweak the defaults a bit; pvc-ansible assumes we're running under
systemd, so set a log format that's better for it (no colour or date).
2019-07-10 21:49:38 -04:00
Joshua Boniface 0d562b829c Replace tabs with spaces 2019-07-08 19:24:59 -04:00
Joshua Boniface 6319241df9 Remove bad content from pvc-api.yml 2019-07-08 19:03:08 -04:00
Joshua Boniface e98649c417 Add quote around ZK nodes in Patroni 2019-07-08 16:59:12 -04:00
Joshua Boniface 7d3ba8bbc3 Bring up underlying interfaces 2019-07-08 14:40:02 -04:00
Joshua Boniface 75182b1570 Complete configuration of API via Ansible 2019-07-08 11:33:14 -04:00
Joshua Boniface d19e006f28 Enable client API in Daemon config 2019-07-06 02:50:05 -04:00
Joshua Boniface c438d2c9cd Add client API to configuration 2019-07-06 02:49:25 -04:00
Joshua Boniface 12d30acf90 Add only coordinators in Patroni config 2019-07-06 02:49:05 -04:00
Joshua Boniface 9b9234eeb1 Install ethtool 2019-06-25 22:13:16 -04:00
Joshua Boniface 140e044e96 Make libvirt listen only on cluster IP 2019-06-25 22:12:44 -04:00
Joshua Boniface 5dbb48abc4 Add debootstrap to package list 2019-06-24 12:22:24 -04:00
Joshua Boniface fc6475b872 Don't try to set pool limits on libvirt key
I figured a * wildcard would work, but no it doesn't. Libvirt needs
the ability to talk to any pool arbitrarily since PVC can create and
remove them at will.
2019-06-24 10:49:35 -04:00
Joshua Boniface 6031053716 Create mgr after starting monitors 2019-06-24 09:53:04 -04:00
Joshua Boniface 9711a31580 Set nicer default Patroni values re: replication 2019-06-23 21:03:24 -04:00
Joshua Boniface 86d4579c82 Split PVC bootstrap into separate task 2019-06-21 14:18:26 -04:00
Joshua Boniface eed7339578 Correct bug with libvirt permissions 2019-06-21 14:18:26 -04:00
Joshua Boniface f5ec3968c3 Handle restarting ceph-mon/mgr sequentially 2019-06-21 14:18:26 -04:00
Joshua Boniface 34ba09a1c7 Enable pool deletion in ceph.conf 2019-06-21 14:18:26 -04:00
Joshua Boniface 4b5237ac5e Support for detailed keepalive logging 2019-06-18 19:56:46 -04:00
Joshua Boniface 7c503d20a2 Create manager auth keyring 2019-06-18 19:43:30 -04:00
Joshua Boniface 6e51b23e86 Make restart hander for pvcd sequential 2019-06-18 13:07:53 -04:00
Joshua Boniface 9c2afcae54 Remove per-host pvc.yml for good 2019-06-18 13:07:46 -04:00
Joshua Boniface a5ebc95427 Support configurable logging settings 2019-06-18 12:51:08 -04:00
Joshua Boniface 2ccabb7a2f Enable storage support 2019-06-18 11:12:18 -04:00
Joshua Boniface e3ed5675a9 Consistent newhost format between roles 2019-06-18 10:47:40 -04:00
Joshua Boniface c288111c2f Add MTU configuration and update for new layout 2019-06-17 23:46:35 -04:00
Joshua Boniface 1fb481f4fb Use separate bootstrap files for base and pvc roles 2019-06-17 21:59:50 -04:00
Joshua Boniface 33e9c4ae28 Revert "Keep zookeeper enabled"
This reverts commit 5554418210.

This is not needed
2019-06-17 21:58:57 -04:00
Joshua Boniface 5554418210 Keep zookeeper enabled
Without this, the service seems to just loop failing to start
indefinitely even though PVC attempts to start the daemon itself.
Reenabling seems to work. Likely a bug due to Zookeeper not being
a proper systemd unit.
2019-06-17 12:08:47 -04:00
Joshua Boniface 645a88f7cd Ensure Ceph daemons are disabled (managed by PVC) 2019-06-17 10:28:18 -04:00
Joshua Boniface 098a36b524 Clean up some tasks during bootstrap; parallel PVC 2019-06-16 19:36:45 -04:00
Joshua Boniface dd0a08bef0 Start Zookeeper during install 2019-06-16 13:57:12 -04:00
Joshua Boniface 523ca4c340 Don't start pvc services on install 2019-06-16 04:00:02 -04:00
Joshua Boniface 293fb5d950 Touch the bootstrap ceph.conf 2019-06-16 03:59:51 -04:00
Joshua Boniface 1bd7a64e1f Move IP removal and restart after install 2019-06-16 03:59:43 -04:00
Joshua Boniface 995a8e86f4 Simplify and combine 2019-06-13 16:25:33 -04:00
Joshua Boniface c092362f13 Reorganize some elements 2019-06-12 23:24:27 -04:00
Joshua Boniface cde6a188ba Reorganize and rejigger 2019-06-12 23:24:27 -04:00
Joshua Boniface 01763088ba Reorganize some bootstrap tasks 2019-06-12 23:24:27 -04:00
Joshua Boniface 9be747c4b4 Symlink ceph file dir back to group_vars 2019-06-12 23:24:27 -04:00
Joshua Boniface 2320f50621 Improve handling around loop var and correct pvcd 2019-06-12 23:24:27 -04:00
Joshua Boniface 1c1d2b95fc Make things even nicer 2019-06-11 16:32:16 -04:00
Joshua Boniface 586cec72ee Define secret key properly 2019-06-11 13:38:10 -04:00
Joshua Boniface 02bfc58473 Flush handlers properly 2019-06-11 13:37:56 -04:00
Joshua Boniface 37ae64b1df Improve libvirt key handling 2019-06-11 13:30:55 -04:00
Joshua Boniface b82c8fc185 Flush handlers before starting PVC install 2019-06-11 13:26:18 -04:00
Joshua Boniface d26c555ce0 Add creation of libvirt client key 2019-06-11 13:26:14 -04:00
Joshua Boniface 20595c7027 Add bootstrapping of Ceph 2019-06-11 11:26:56 -04:00
Joshua Boniface 7bc68d4f01 Load jemalloc 2 2019-06-11 11:16:57 -04:00
Joshua Boniface 64c6beabf8 Compatability with Ansible 2.2 2019-06-10 15:07:34 -04:00
Joshua Boniface 20d0d57a29 Remove Ceph group creation 2019-06-10 15:07:06 -04:00
Joshua Boniface 8ac0776a8e Initial commit of PVC Ansible role 2019-06-09 00:52:18 -04:00