Send nicer provisioner crash if storage pool does not exist #90

Closed
opened 2020-02-28 14:31:56 -05:00 by JoshuaBoniface · 2 comments
JoshuaBoniface commented 2020-02-28 14:31:56 -05:00 (Migrated from git.bonifacelabs.ca)
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: [2020-02-28 14:27:54,338: WARNING/ForkPoolWorker-1] Selecting target node "pvchv2" with "53564" MB free RAM                                                                           
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: [2020-02-28 14:27:54,338: WARNING/ForkPoolWorker-1] All configured networks for VM are valid
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: [2020-02-28 14:27:54,341: ERROR/ForkPoolWorker-1] Task pvcapid.flaskapi.create_vm[6aea4f9f-8c37-48ab-8e2d-77cde6507653] raised unexpected: NoNodeError()
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: Traceback (most recent call last):                                                                                                                                                    
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:   File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 382, in trace_task                                                                                                  
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:     R = retval = fun(*args, **kwargs)                                                                                                                                                 
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:   File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 641, in __protected_call__                                                                                          
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:     return self.run(*args, **kwargs)                                                                                                                                                  
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:   File "/usr/share/pvc/pvcapid/flaskapi.py", line 189, in create_vm                                                                                                                   
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:     return api_provisioner.create_vm(self, vm_name, profile_name, define_vm=define_vm, start_vm=start_vm)                                                                             
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:   File "/usr/share/pvc/pvcapid/provisioner.py", line 1198, in create_vm                                                                                                               
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:     pool_information = pvc_ceph.getPoolInformation(zk_conn, pool)                                                                                                                     
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:   File "/usr/share/pvc/daemon_lib/ceph.py", line 580, in getPoolInformation                                                                                                           
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:     pool_stats_raw = zkhandler.readdata(zk_conn, '/ceph/pools/{}/stats'.format(pool))                                                                                                 
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:   File "/usr/share/pvc/daemon_lib/zkhandler.py", line 47, in readdata                                                                                                                 
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:     data_raw = zk_conn.get(key)                                                                                                                                                       
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:   File "/usr/lib/python3/dist-packages/kazoo/client.py", line 1042, in get                                                                                                            
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:     return self.get_async(path, watch=watch).get()                                                                                                                                    
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:   File "/usr/lib/python3/dist-packages/kazoo/handlers/utils.py", line 79, in get                                                                                                      
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]:     raise self._exception                                                                                                                                                             
Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: kazoo.exceptions.NoNodeError
``` Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: [2020-02-28 14:27:54,338: WARNING/ForkPoolWorker-1] Selecting target node "pvchv2" with "53564" MB free RAM Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: [2020-02-28 14:27:54,338: WARNING/ForkPoolWorker-1] All configured networks for VM are valid Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: [2020-02-28 14:27:54,341: ERROR/ForkPoolWorker-1] Task pvcapid.flaskapi.create_vm[6aea4f9f-8c37-48ab-8e2d-77cde6507653] raised unexpected: NoNodeError() Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: Traceback (most recent call last): Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 382, in trace_task Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: R = retval = fun(*args, **kwargs) Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 641, in __protected_call__ Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: return self.run(*args, **kwargs) Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: File "/usr/share/pvc/pvcapid/flaskapi.py", line 189, in create_vm Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: return api_provisioner.create_vm(self, vm_name, profile_name, define_vm=define_vm, start_vm=start_vm) Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: File "/usr/share/pvc/pvcapid/provisioner.py", line 1198, in create_vm Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: pool_information = pvc_ceph.getPoolInformation(zk_conn, pool) Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: File "/usr/share/pvc/daemon_lib/ceph.py", line 580, in getPoolInformation Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: pool_stats_raw = zkhandler.readdata(zk_conn, '/ceph/pools/{}/stats'.format(pool)) Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: File "/usr/share/pvc/daemon_lib/zkhandler.py", line 47, in readdata Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: data_raw = zk_conn.get(key) Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: File "/usr/lib/python3/dist-packages/kazoo/client.py", line 1042, in get Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: return self.get_async(path, watch=watch).get() Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: File "/usr/lib/python3/dist-packages/kazoo/handlers/utils.py", line 79, in get Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: raise self._exception Feb 28 14:27:54 pvchv1.lab.ca celery[341535]: kazoo.exceptions.NoNodeError ```
JoshuaBoniface commented 2020-02-28 14:31:56 -05:00 (Migrated from git.bonifacelabs.ca)

changed milestone to %2

changed milestone to %2
JoshuaBoniface commented 2020-03-15 16:58:32 -04:00 (Migrated from git.bonifacelabs.ca)

closed via commit 4a52ff56b9

closed via commit 4a52ff56b9877030cb4779a94367f417674715e5
Sign in to join this conversation.
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: parallelvirtualcluster/pvc#90
No description provided.