Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

[igoraj]

Terraform v0.9.1 (same issue also on v0.8.x)
terraform-provider-softlayer: deeab85 (current master) (same issue also on 1.4.0)

When destroying more than a dozen private VSIs it fails with the following errors:

Error applying plan:

38 error(s) occurred:

* softlayer_virtual_guest.vsi.1: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.2: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.0: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.6: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.2: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.0: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.0: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.18: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.0: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.12: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.0: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.14: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.20: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.21: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.7: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.1: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.8: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.4: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.16: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.3: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.1: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.1: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.19: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.1: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.10: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.0: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.2: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.1: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.17: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.1: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.0: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.11: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.0: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.9: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.5: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.13: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.15: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.vsi.1: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

Terraform does not automatically rollback in the face of errors.
Instead, your Terraform state file has been partially updated with
any resources that successfully completed. Please address the error
above and apply again to incrementally change your infrastructure.

[renier]

@igoraj How long is it taking from when you issue the destroy to when it finally errors out?

[igoraj]

@renier very quickly actually, the wait is only when "refresh state" is in progress, and once it proceeds to destroy it returns this issue immediately.

[renier]

@igoraj Strange because the default wait time for no transactions on the VSI is 90 minutes (previously 45 minutes). Was this also over xmlrpc?

[igoraj]

@renier yep, same config was in place at the time of the issue. i can try again, but meanwhile i already destroyed those nodes manually so i need to recreate the environment and test again, however in the past i haven't had issues with that so unsure what has changed.
do you think it could be something on the backend API that would cause this?

[athak]

We are seeing the same issue but we are not specifying an endpoint in the provider so I assume we are using REST.

* softlayer_virtual_guest.instance_image.0: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

* softlayer_virtual_guest.instance_image.1: Error deleting virtual guest, couldn't wait for zero active transactions: timeout while waiting for state to become 'idle'

[renier]

@igoraj @athak Can you guys share config so that we can test over here and reproduce?

[rakesh-von]

Hi,

I have same issue but i am using ansible collections. Has this been resolved?

[igoraj]

@rakesh-von we have in the end moved away from IBM so not sure what happened with this issue. That said afaik all softlayer modules have been deprecated and replaced by IBM modules, so try https://github.com/IBM-Cloud/terraform-provider-ibm.