Commit Graph

294 Commits

Author SHA1 Message Date
Joshua Boniface ec7beb08cc Add missing flag 2022-10-19 03:34:37 -04:00
Joshua Boniface 3a180193ee Fix wording of initial script paragraphs 2022-10-19 03:27:14 -04:00
Joshua Boniface 7a3870fc44 Add OVA script support
1. Ensure that system_template and script are not nullable in the DB.
2. Ensure that the CLI and API enforce the above and clean up CLI
arguments for profile add.
3. Ensure that, before uploading OVAs, a 'default_ova' provisioning
script is present.
4. Use the 'default_ova' script for new OVA uploads.
5. Ensure that OVA details are properly added to the vm_data dict in the
provisioner vmbuilder.
2022-10-06 10:48:12 -04:00
Joshua Boniface 43feb33caa Update documentation to reflect script changes 2022-10-06 00:06:02 -04:00
Joshua Boniface 4b36753f27 Add reference to bootstrap in index 2022-08-03 20:22:16 -04:00
Joshua Boniface d8d3feee22 Add selector help and adjust flag name
1. Add documentation on the node selector flags. In the API, reference
the daemon configuration manual which now includes details in this
section; in the CLI, provide the help in "pvc vm define" in detail and
then reference that command's help in the other commands that use this
field.

2. Ensure the naming is consistent in the CLI, using the flag name
"--node-selector" everywhere (was "--selector" for "pvc vm" commands and
"--node-selector" for "pvc provisioner" commands).
2022-06-10 02:42:06 -04:00
Joshua Boniface b1357cafdb Add memfree to selector and use proper defaults 2022-06-10 02:03:12 -04:00
Joshua Boniface 7a40c7a55b Add support for replacing/refreshing OSDs
Adds commands to both replace an OSD disk, and refresh (reimport) an
existing OSD disk on a new node. This handles the cases where an OSD
disk should be replaced (either due to upgrades or failures) or where a
node is rebuilt in-place and an existing OSD must be re-imported to it.

This should avoid the need to do a full remove/add sequence for either
case.

Also cleans up some aspects of OSD removal that are identical between
methods (e.g. using safe-to-destroy and sleeping after stopping) and
fixes a bug if an OSD does not truly exist when the daemon starts up.
2022-05-06 15:32:06 -04:00
Joshua Boniface 1142454934 Add pool PGs count modification
Allows an administrator to adjust the PG count of a given pool. This can
be used to increase the PGs (for example after adding more OSDs) or
decrease it (to remove OSDs, reduce CPU load, etc.).
2021-12-28 21:53:29 -05:00
Joshua Boniface bbfad340a1 Add PGs count to pool list 2021-12-28 21:12:02 -05:00
Joshua Boniface 25fe45dd28 Add device class tiers to Ceph pools
Allows specifying a particular device class ("tier") for a given pool,
for instance SSD-only or NVMe-only. This is implemented with Crush
rules on the Ceph side, and via an additional new key in the pool
Zookeeper schema which is defaulted to "default".
2021-12-28 20:58:15 -05:00
Joshua Boniface abc23ebb18 Handle detect strings as arguments for blockdevs
Allows specifying blockdevs in the OSD and OSD-DB addition commands as
detect strings rather than actual block device paths. This provides
greater flexibility for automation with pvcbootstrapd (which originates
the concept of detect strings) and in general usage as well.
2021-12-28 02:53:02 -05:00
Joshua Boniface a6dcffc737 Remove references to Ansible manual 2021-11-08 00:29:47 -05:00
Joshua Boniface 364c190106 Remove Ansible and Testing manuals
The Ansible manual can't keep up with the other repo, so it should live
there instead (eventually, after significant rewrites).

The Testing page is obsoleted by the "test-cluster" script.
2021-11-08 00:25:27 -05:00
Joshua Boniface 5f193a6134 Perform automatic shutdown/stop on VM disable
Instead of requiring the VM to already be stopped, instead allow disable
state changes to perform a shutdown first. Also add a force option which
will do a hard stop instead of a shutdown.

References #148
2021-11-06 03:57:24 -04:00
Joshua Boniface 8f906c1f81 Use power off in fence instead of reset
Use a power off (and then make the power on a requirement) during a node
fence. Removes some potential ambiguity in the power state, since we
will know for certain if it is off.
2021-10-12 11:04:27 -04:00
Joshua Boniface fb84685c2a Make cluster example images clickable 2021-10-12 03:15:04 -04:00
Joshua Boniface 032ba44d9c Mention fencing only in run state 2021-10-12 03:05:01 -04:00
Joshua Boniface b7761877e7 Adjust more wording and fix typos 2021-10-12 03:00:21 -04:00
Joshua Boniface 1fe07640b3 Adjust some wording 2021-10-12 02:54:16 -04:00
Joshua Boniface 95d983ddff Fix formatting of subsection 2021-10-12 02:49:40 -04:00
Joshua Boniface 4c5da1b6a8 Add reference to Ansible manual 2021-10-12 02:48:47 -04:00
Joshua Boniface be6b1e02e3 Fix spelling errors 2021-10-12 02:47:31 -04:00
Joshua Boniface ec2a72ed4b Fix link to cluster architecture docs 2021-10-12 02:41:22 -04:00
Joshua Boniface b06e327add Adjust getting started docs
Update the docs with the current information on setting up a cluster,
including simplifying the Ansible configuration to use the new
create-local-repo.sh script, and simplifying some other sections.
2021-10-12 02:39:25 -04:00
Joshua Boniface 221494ed1b Add new configs for Ansible 2021-10-11 14:44:18 -04:00
Joshua Boniface 4ed537ee3b Add bridge_mtu config to docs 2021-10-09 19:28:50 -04:00
Joshua Boniface 24de0f4189 Add MTU to network creation/modification
Addresses #144
2021-10-09 17:51:32 -04:00
Joshua Boniface db6e65712d Make n-1 values clearer 2021-10-07 18:11:15 -04:00
Joshua Boniface cf8e16543c Correct levels in TOC 2021-10-07 18:08:28 -04:00
Joshua Boniface 1a4fcdcc2d Correct spelling errors 2021-10-07 18:07:06 -04:00
Joshua Boniface 9a71db0800 Add documentation sections on IPMI and fencing 2021-10-07 18:05:47 -04:00
Joshua Boniface c89699bc6f Remove redundant wording from header 2021-10-07 12:20:04 -04:00
Joshua Boniface 3db7ac48f4 Add missing period to changelog sentence 2021-10-07 12:10:35 -04:00
Joshua Boniface 1830ec6465 Move changelog into dedicated file
The changelog was getting far too long for the README/docs index to
support, so move it into CHANGELOG.md and link to it instead.
2021-10-07 12:09:26 -04:00
Joshua Boniface bdb9db8375 Bump version to 0.9.39 2021-10-07 11:52:38 -04:00
Joshua Boniface c0f7ba0125 Add limit negation to VM list
When using the "state", "node", or "tag" arguments to a VM list, add
support for a "negate" flag to look for all VMs *not in* the state,
node, or tag state.
2021-10-07 11:50:52 -04:00
Joshua Boniface 761032b321 Add note about fencing at remote sites 2021-10-04 19:58:08 -04:00
Joshua Boniface 3566e13e79 Correct TOC in architecture page 2021-10-04 01:54:22 -04:00
Joshua Boniface 6b324029cf Correct spelling errors 2021-10-04 01:51:58 -04:00
Joshua Boniface 13eeabf44b Double image sizes for example clusters 2021-10-04 01:47:35 -04:00
Joshua Boniface a167757600 Revamp about and architecture docs
Makes these a little simpler to follow and provides some more up-to-date
information based on recent tests and developments.
2021-10-04 01:42:08 -04:00
Joshua Boniface 63962f10ba Move changelog headers down one more level 2021-10-04 01:41:22 -04:00
Joshua Boniface a7a681d92a Adjust indent of index/README versions 2021-10-04 00:33:24 -04:00
Joshua Boniface da9248cfa2 Bump version to 0.9.38 2021-10-03 22:32:41 -04:00
Joshua Boniface f83a345bfe Add test format versioning to storage benchmarks
Adds a test_format database column and a value in the API return for the
test format version, starting at 0 for the existing format as of 0.9.37.

References #143
2021-10-02 00:55:27 -04:00
Joshua Boniface 23977b04fc Bump version to 0.9.37 2021-09-30 02:08:14 -04:00
Joshua Boniface 65df807b09 Add support for configurable OSD DB ratios
The default of 0.05 (5%) is likely ideal in the initial implementation,
but allow this to be set explicitly for maximum flexibility in
space-constrained or performance-critical use-cases.
2021-09-24 01:06:39 -04:00
Joshua Boniface d0f3e9e285 Bump version to 0.9.36 2021-09-23 14:01:38 -04:00
Joshua Boniface adc8a5a3bc Add separate OSD DB device support
Adds in three parts:

1. Create an API endpoint to create OSD DB volume groups on a device.
Passed through to the node via the same command pipeline as
creating/removing OSDs, and creates a volume group with a fixed name
(osd-db).

2. Adds API support for specifying whether or not to use this DB volume
group when creating a new OSD via the "ext_db" flag. Naming and sizing
is fixed for simplicity and based on Ceph recommendations (5% of OSD
size). The Zookeeper schema tracks the block device to use during
removal.

3. Adds CLI support for the new and modified API endpoints, as well as
displaying the block device and DB block device in the OSD list.

While I debated supporting adding a DB device to an existing OSD, in
practice this ended up being a very complex operation involving stopping
the OSD and setting some options, so this is not supported; this can be
specified during OSD creation only.

Closes #142
2021-09-23 13:59:49 -04:00