K8SPG-645 turn on sidecar containers for pgbouncer

[nmarukovich]

CHANGE DESCRIPTION

Problem:
Sidecar containers for pgbouncer don't work by default

Cause:
We need to turn on PGBouncerSidecars variable

Solution:
Turn on it.

CHECKLIST

Jira

• Is the Jira ticket created and referenced properly?
• Does the Jira ticket have the proper statuses for documentation (Needs Doc) and QA (Needs QA)?
• Does the Jira ticket link to the proper milestone (Fix Version field)?

Tests

• Is an E2E test/test case added for the new feature/change?
• Are unit tests added where appropriate?

Config/Logging/Testability

• Are all needed new/changed options added to default YAML files?
• Are all needed new/changed options added to the Helm Chart?
• Did we add proper logging messages for operator actions?
• Did we ensure compatibility with the previous version or cluster upgrade process?
• Does the change support oldest and newest supported PG version?
• Does the change support oldest and newest supported Kubernetes version?

[nmarukovich]

@egegunes @inelpandzic @pooknull I have a question here.
Is there any reason why we didn't turn on it by default before?
If yes, do we want to move it to cr option?
For instances it is turned on by default.
Crunchy suggested use env var

PGO_FEATURE_GATES="PGBouncerSidecars=true"

[hors]

@egegunes @inelpandzic @pooknull I have a question here. Is there any reason why we didn't turn on it by default before? If yes, do we want to move it to cr option? For instances it is turned on by default. Crunchy suggested use env var

PGO_FEATURE_GATES="PGBouncerSidecars=true"

@nmarukovich We need to have it by default.

[nmarukovich]

@egegunes @inelpandzic @pooknull I have a question here. Is there any reason why we didn't turn on it by default before? If yes, do we want to move it to cr option? For instances it is turned on by default. Crunchy suggested use env var
PGO_FEATURE_GATES="PGBouncerSidecars=true"

@nmarukovich We need to have it by default.

So please approve in this case (=

[JNKPercona]

Test name	Status
custom-extensions	failure
custom-tls	failure
demand-backup	failure
finalizers	failure
init-deploy	failure
monitoring	failure
one-pod	failure
operator-self-healing	failure
pitr	failure
scaling	failure
scheduled-backup	failure
self-healing	failure
start-from-backup	failure
tablespaces	failure
telemetry-transfer	failure
upgrade-consistency	failure
upgrade-minor	passed
users	failure
We run 18 out of 18

commit: da3f76a
image: perconalab/percona-postgresql-operator:PR-968-da3f76aef