pvc-ansible/roles/pvc/tasks/main.yml

---

# Set this_node fact
- set_fact:
    this_node: "{{ inventory_hostname.split('.')[0] }}"
  tags: always

# Set coordinator state fact
- set_fact:
    is_coordinator: "{% for node in pvc_nodes if node.hostname == this_node %}{{ node.is_coordinator }}{% endfor %}"
  tags: always

# First-run check
- name: check if this is a new instance
  shell: "echo 'bootstrapped' > /etc/pvc-install.pvc"
  args:
    creates: /etc/pvc-install.pvc
  register: newhost_check
  tags: always

- name: set newhost fact
  set_fact:
    newhost: yes
  when: newhost_check.changed
  tags: always

- include: common/add_cluster_ips.yml
  when: newhost is defined and newhost
  tags: always

# Install system tweaks
- include: system/main.yml
  tags: pvc-system

# Install base databases (coordinators only)
- include: ceph/main.yml
  tags: pvc-ceph
  when: is_coordinator

- include: zookeeper/main.yml
  tags: pvc-zookeeper
  when: is_coordinator

- include: patroni/main.yml
  tags: pvc-patroni
  when: is_coordinator

# Install core services
- include: libvirt/main.yml
  tags: pvc-libvirt

- include: frr/main.yml
  tags: pvc-frr

# Install PVC daemon
- include: pvc/main.yml
  tags: pvc-daemon

# Install CPU tuning
- include: cputuning/main.yml
  tags: pvc-cputuning
  when: debian_version|int >= 11 and cpu_tuning is defined

- block:
    - name: restart server on first install
      reboot:
        post_reboot_delay: 30
        reboot_timeout: 1800

    - name: wait 90 seconds for system to stabilize
      pause:
        seconds: 90
      become: no
      connection: local

    - name: restart pvcnoded on first install
      service:
        name: pvcnoded
        state: restarted
      throttle: 1
      ignore_errors: yes

    - name: wait 30 seconds for system to stabilize
      pause:
        seconds: 30
      become: no
      connection: local

    - name: set first node as primary coordinator on first install
      command: "pvc node primary --wait {{ ansible_play_hosts[0].split('.')[0] }}"
      run_once: yes
      delegate_to: "{{ ansible_play_hosts[0] }}"

  when: newhost is defined and newhost
  tags: always
Initial commit of PVC Ansible role 2023-09-01 15:42:19 -04:00			`---`
Reorganize and rejigger 2023-09-01 15:42:19 -04:00
Unify and standardize inventory_hostname This was causing some confusing conflicts, so create a new fact called "this_node" which is inventory_hostname.split('.')[0], i.e. the short name, and use that everywhere instead of an FQDN or true inventory hostname. 2023-09-01 15:42:28 -04:00			`# Set this_node fact`
Limit database tasks to coordinators only Non-coordinators don't need these configurations as they shouldn't run there. 2023-09-01 15:42:21 -04:00			`- set_fact:`
Unify and standardize inventory_hostname This was causing some confusing conflicts, so create a new fact called "this_node" which is inventory_hostname.split('.')[0], i.e. the short name, and use that everywhere instead of an FQDN or true inventory hostname. 2023-09-01 15:42:28 -04:00			`this_node: "{{ inventory_hostname.split('.')[0] }}"`
			`tags: always`

			`# Set coordinator state fact`
			`- set_fact:`
			`is_coordinator: "{% for node in pvc_nodes if node.hostname == this_node %}{{ node.is_coordinator }}{% endfor %}"`
Limit database tasks to coordinators only Non-coordinators don't need these configurations as they shouldn't run there. 2023-09-01 15:42:21 -04:00			`tags: always`

Reorganize and rejigger 2023-09-01 15:42:19 -04:00			`# First-run check`
			`- name: check if this is a new instance`
Consistent newhost format between roles 2023-09-01 15:42:20 -04:00			`shell: "echo 'bootstrapped' > /etc/pvc-install.pvc"`
Reorganize and rejigger 2023-09-01 15:42:19 -04:00			`args:`
Consistent newhost format between roles 2023-09-01 15:42:20 -04:00			`creates: /etc/pvc-install.pvc`
Reorganize and rejigger 2023-09-01 15:42:19 -04:00			`register: newhost_check`
Reorganize some elements 2023-09-01 15:42:19 -04:00			`tags: always`
Reorganize and rejigger 2023-09-01 15:42:19 -04:00
			`- name: set newhost fact`
			`set_fact:`
			`newhost: yes`
			`when: newhost_check.changed`
Reorganize some elements 2023-09-01 15:42:19 -04:00			`tags: always`
Reorganize and rejigger 2023-09-01 15:42:19 -04:00
			`- include: common/add_cluster_ips.yml`
			`when: newhost is defined and newhost`
Reorganize some elements 2023-09-01 15:42:19 -04:00			`tags: always`
Reorganize and rejigger 2023-09-01 15:42:19 -04:00
Add Ceph OSD cpuset tuning options Allows an administrator to set CPU pinning with the cpuset tool for Ceph OSDs, in situations where CPU contention with VMs or other system tasks may be negatively affecting OSD performance. This is optional, advanced tuning and is disabled by default. 2023-09-01 15:42:27 -04:00			`# Install system tweaks`
			`- include: system/main.yml`
			`tags: pvc-system`
Add logrotate configuration 2023-09-01 15:42:21 -04:00
Limit database tasks to coordinators only Non-coordinators don't need these configurations as they shouldn't run there. 2023-09-01 15:42:21 -04:00			`# Install base databases (coordinators only)`
Reorganize and rejigger 2023-09-01 15:42:19 -04:00			`- include: ceph/main.yml`
Initial commit of PVC Ansible role 2023-09-01 15:42:19 -04:00			`tags: pvc-ceph`
Limit database tasks to coordinators only Non-coordinators don't need these configurations as they shouldn't run there. 2023-09-01 15:42:21 -04:00			`when: is_coordinator`
Initial commit of PVC Ansible role 2023-09-01 15:42:19 -04:00
Reorganize and rejigger 2023-09-01 15:42:19 -04:00			`- include: zookeeper/main.yml`
Initial commit of PVC Ansible role 2023-09-01 15:42:19 -04:00			`tags: pvc-zookeeper`
Limit database tasks to coordinators only Non-coordinators don't need these configurations as they shouldn't run there. 2023-09-01 15:42:21 -04:00			`when: is_coordinator`
Initial commit of PVC Ansible role 2023-09-01 15:42:19 -04:00
Reorganize and rejigger 2023-09-01 15:42:19 -04:00			`- include: patroni/main.yml`
			`tags: pvc-patroni`
Limit database tasks to coordinators only Non-coordinators don't need these configurations as they shouldn't run there. 2023-09-01 15:42:21 -04:00			`when: is_coordinator`
Make things even nicer 2023-09-01 15:42:19 -04:00
Reorganize and rejigger 2023-09-01 15:42:19 -04:00			`# Install core services`
			`- include: libvirt/main.yml`
Initial commit of PVC Ansible role 2023-09-01 15:42:19 -04:00			`tags: pvc-libvirt`

Reorganize and rejigger 2023-09-01 15:42:19 -04:00			`- include: frr/main.yml`
Initial commit of PVC Ansible role 2023-09-01 15:42:19 -04:00			`tags: pvc-frr`

Clean up some tasks during bootstrap; parallel PVC 2023-09-01 15:42:20 -04:00			`# Install PVC daemon`
Reorganize and rejigger 2023-09-01 15:42:19 -04:00			`- include: pvc/main.yml`
Reorganize some elements 2023-09-01 15:42:19 -04:00			`tags: pvc-daemon`
Move IP removal and restart after install 2023-09-01 15:42:20 -04:00
Add updated tuning configuration Uses a much nicer CPU tuning configuration, leveraging systemd's AllowedCPUs and CPUAffinity options within a set of slices (some default, some custom). Configuration is also greatly simplified versus the previous implementation, simply asking for a number of CPUS for both the system and OSDs, and calculating everything else that is required. Also switches (back) to the v2 unified cgroup hierarchy by default as required by the systemd AllowedCPUs directive. 2023-09-01 15:42:29 -04:00			`# Install CPU tuning`
			`- include: cputuning/main.yml`
			`tags: pvc-cputuning`
Use debian_version custom fact 2023-09-01 15:42:29 -04:00			`when: debian_version\|int >= 11 and cpu_tuning is defined`
Add updated tuning configuration Uses a much nicer CPU tuning configuration, leveraging systemd's AllowedCPUs and CPUAffinity options within a set of slices (some default, some custom). Configuration is also greatly simplified versus the previous implementation, simply asking for a number of CPUS for both the system and OSDs, and calculating everything else that is required. Also switches (back) to the v2 unified cgroup hierarchy by default as required by the systemd AllowedCPUs directive. 2023-09-01 15:42:29 -04:00
Add additional primary node switch 2023-09-01 15:42:30 -04:00			`- block:`
			`- name: restart server on first install`
			`reboot:`
			`post_reboot_delay: 30`
			`reboot_timeout: 1800`
Remove extra whitespace 2023-09-01 15:42:30 -04:00
Add additional primary node switch 2023-09-01 15:42:30 -04:00			`- name: wait 90 seconds for system to stabilize`
			`pause:`
			`seconds: 90`
			`become: no`
			`connection: local`
Remove extra whitespace 2023-09-01 15:42:30 -04:00
Add additional primary node switch 2023-09-01 15:42:30 -04:00			`- name: restart pvcnoded on first install`
			`service:`
			`name: pvcnoded`
			`state: restarted`
			`throttle: 1`
			`ignore_errors: yes`
Remove extra whitespace 2023-09-01 15:42:30 -04:00
Add additional primary node switch 2023-09-01 15:42:30 -04:00			`- name: wait 30 seconds for system to stabilize`
			`pause:`
			`seconds: 30`
			`become: no`
			`connection: local`
Remove extra whitespace 2023-09-01 15:42:30 -04:00
Add additional primary node switch 2023-09-01 15:42:30 -04:00			`- name: set first node as primary coordinator on first install`
Fix bad calls to node primary 2023-09-01 15:42:30 -04:00			`command: "pvc node primary --wait {{ ansible_play_hosts[0].split('.')[0] }}"`
Add additional primary node switch 2023-09-01 15:42:30 -04:00			`run_once: yes`
Fix delegate_to 2023-09-01 15:42:30 -04:00			`delegate_to: "{{ ansible_play_hosts[0] }}"`
Add final pvcnoded restart 2023-09-01 15:42:30 -04:00
			`when: newhost is defined and newhost`
			`tags: always`