Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

keep-dev: GKE metrics + env repairs #534

Merged
merged 14 commits into from
Mar 19, 2019
Merged

keep-dev: GKE metrics + env repairs #534

merged 14 commits into from
Mar 19, 2019

Conversation

sthompson22
Copy link
Contributor

@sthompson22 sthompson22 commented Jan 25, 2019 •
edited
Loading

Related RFC: https://github.com/thesis/infrastructure/pull/42
Parent PR: https://github.com/thesis/infrastructure/pull/44

After prototyping shipping kube-state-metrics to Stackdriver we've codified the process in a Terraform module.

I've uninstalled all the manual work done in keep-dev as part of that prototype and here we put it back proper.

We've started being explicit about configuring providers and provider versions for some env. I went ahead and did that here as well.

BONUS: This PR ended up taking the config changes related to getting keep-dev working again after the VPN trouble. This is really one change, disabling network policies.

@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
+ create
~ update in-place
- destroy
-/+ destroy and then create replacement
 <= read (data resources)

Terraform will perform the following actions:

- helm_release.openvpn

 <= module.demo_dev_gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                                                  <computed>
      load_balancer_ingress.#:                             <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "helm-kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      spec.#:                                              <computed>

+ module.demo_dev_gke_cluster_metrics.helm_release.kube_state_metrics
      id:                                                  <computed>
      chart:                                               "stable/kube-state-metrics"
      disable_webhooks:                                    "false"
      force_update:                                        "false"
      keyring:                                             "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                                          <computed>
      name:                                                "helm-kube-state-metrics"
      namespace:                                           "metrics"
      recreate_pods:                                       "false"
      reuse:                                               "false"
      reuse_values:                                        "false"
      set.#:                                               "1"
      set.1510645123.name:                                 "rbac.serviceAccountName"
      set.1510645123.value:                                "kube-state-metrics"
      timeout:                                             "300"
      verify:                                              "false"
      version:                                             "0.13.0"
      wait:                                                "true"

+ module.demo_dev_gke_cluster_metrics.helm_release.prometheus_to_sd
      id:                                                  <computed>
      chart:                                               "stable/prometheus-to-sd"
      disable_webhooks:                                    "false"
      force_update:                                        "false"
      keyring:                                             "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                                          <computed>
      name:                                                "helm-prometheus-to-sd"
      namespace:                                           "metrics"
      recreate_pods:                                       "false"
      reuse:                                               "false"
      reuse_values:                                        "false"
      set.#:                                               "1"
      set.~642634291.name:                                 "metricsSources.kube-state-metrics"
      set.~642634291.value:                                "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"
      timeout:                                             "300"
      verify:                                              "false"
      version:                                             "0.1.1"
      wait:                                                "true"

+ module.demo_dev_gke_cluster_metrics.kubernetes_cluster_role_binding.kube_state_metrics_cluster_role_binding
      id:                                                  <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "kube-state-metrics-cluster-view-binding"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      role_ref.%:                                          "3"
      role_ref.api_group:                                  "rbac.authorization.k8s.io"
      role_ref.kind:                                       "ClusterRole"
      role_ref.name:                                       "view"
      subject.#:                                           "1"
      subject.0.kind:                                      "ServiceAccount"
      subject.0.name:                                      "kube-state-metrics"
      subject.0.namespace:                                 "metrics"

+ module.demo_dev_gke_cluster_metrics.kubernetes_namespace.metrics
      id:                                                  <computed>
      metadata.#:                                          "1"
      metadata.0.annotations.%:                            "1"
      metadata.0.annotations.description:                  "The namespace for for installing third party Kubernetes metrics tools."
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>

+ module.demo_dev_gke_cluster_metrics.kubernetes_service_account.kube_state_metrics
      id:                                                  <computed>
      automount_service_account_token:                     "false"
      default_secret_name:                                 <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>

~ module.gke_cluster.google_container_cluster.a_gke_cluster
      logging_service:                                     "logging.googleapis.com/kubernetes" => "logging.googleapis.com"

+ module.gke_cluster.google_project_service.container
      id:                                                  <computed>
      disable_on_destroy:                                  "true"
      project:                                             "keep-dev-fe24"
      service:                                             "container.googleapis.com"

~ module.helm_provider_helper.kubernetes_service_account.tiller
      automount_service_account_token:                     "" => "false"

~ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395700000002" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395700000002" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.238.255.240" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.238.255.240" => "35.238.255.240"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags.2790270952:                                     "inst-keep-dev-vpc-network-nat-us-central1-a" => "inst-keep-dev-vpc-network-nat-us-central1-a"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_a.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "2428940380811452119" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "" (forces new resource)

~ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836396700000003" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836396700000003" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.226.204.36" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.226.204.36" => "35.226.204.36"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1062827602:                                     "inst-keep-dev-vpc-network-nat-us-central1-b" => "inst-keep-dev-vpc-network-nat-us-central1-b"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_b.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "3731707379855754622" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "" (forces new resource)

~ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395600000001" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395600000001" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.202.214.39" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.202.214.39" => "35.202.214.39"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1214138052:                                     "inst-keep-dev-vpc-network-nat-us-central1-c" => "inst-keep-dev-vpc-network-nat-us-central1-c"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_c.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "9171285365591061132" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "" (forces new resource)
Plan: 12 to add, 5 to change, 7 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

@sthompson22
Copy link
Contributor Author

atlantis plan

@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
+ create
~ update in-place
- destroy
-/+ destroy and then create replacement
 <= read (data resources)

Terraform will perform the following actions:

- helm_release.openvpn

 <= module.demo_dev_gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                                                  <computed>
      load_balancer_ingress.#:                             <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "helm-kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      spec.#:                                              <computed>

+ module.demo_dev_gke_cluster_metrics.helm_release.kube_state_metrics
      id:                                                  <computed>
      chart:                                               "stable/kube-state-metrics"
      disable_webhooks:                                    "false"
      force_update:                                        "false"
      keyring:                                             "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                                          <computed>
      name:                                                "helm-kube-state-metrics"
      namespace:                                           "metrics"
      recreate_pods:                                       "false"
      reuse:                                               "false"
      reuse_values:                                        "false"
      set.#:                                               "1"
      set.1510645123.name:                                 "rbac.serviceAccountName"
      set.1510645123.value:                                "kube-state-metrics"
      timeout:                                             "300"
      verify:                                              "false"
      version:                                             "0.13.0"
      wait:                                                "true"

+ module.demo_dev_gke_cluster_metrics.helm_release.prometheus_to_sd
      id:                                                  <computed>
      chart:                                               "stable/prometheus-to-sd"
      disable_webhooks:                                    "false"
      force_update:                                        "false"
      keyring:                                             "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                                          <computed>
      name:                                                "helm-prometheus-to-sd"
      namespace:                                           "metrics"
      recreate_pods:                                       "false"
      reuse:                                               "false"
      reuse_values:                                        "false"
      set.#:                                               "1"
      set.~642634291.name:                                 "metricsSources.kube-state-metrics"
      set.~642634291.value:                                "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"
      timeout:                                             "300"
      verify:                                              "false"
      version:                                             "0.1.1"
      wait:                                                "true"

+ module.demo_dev_gke_cluster_metrics.kubernetes_cluster_role_binding.kube_state_metrics_cluster_role_binding
      id:                                                  <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "kube-state-metrics-cluster-view-binding"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      role_ref.%:                                          "3"
      role_ref.api_group:                                  "rbac.authorization.k8s.io"
      role_ref.kind:                                       "ClusterRole"
      role_ref.name:                                       "view"
      subject.#:                                           "1"
      subject.0.kind:                                      "ServiceAccount"
      subject.0.name:                                      "kube-state-metrics"
      subject.0.namespace:                                 "metrics"

+ module.demo_dev_gke_cluster_metrics.kubernetes_namespace.metrics
      id:                                                  <computed>
      metadata.#:                                          "1"
      metadata.0.annotations.%:                            "1"
      metadata.0.annotations.description:                  "The namespace for for installing third party Kubernetes metrics tools."
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>

+ module.demo_dev_gke_cluster_metrics.kubernetes_service_account.kube_state_metrics
      id:                                                  <computed>
      automount_service_account_token:                     "false"
      default_secret_name:                                 <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>

~ module.gke_cluster.google_container_cluster.a_gke_cluster
      logging_service:                                     "logging.googleapis.com/kubernetes" => "logging.googleapis.com"

+ module.gke_cluster.google_project_service.container
      id:                                                  <computed>
      disable_on_destroy:                                  "true"
      project:                                             "keep-dev-fe24"
      service:                                             "container.googleapis.com"

~ module.helm_provider_helper.kubernetes_service_account.tiller
      automount_service_account_token:                     "" => "false"

~ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395700000002" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395700000002" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.238.255.240" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.238.255.240" => "35.238.255.240"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags.2790270952:                                     "inst-keep-dev-vpc-network-nat-us-central1-a" => "inst-keep-dev-vpc-network-nat-us-central1-a"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_a.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "2428940380811452119" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "" (forces new resource)

~ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836396700000003" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836396700000003" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.226.204.36" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.226.204.36" => "35.226.204.36"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1062827602:                                     "inst-keep-dev-vpc-network-nat-us-central1-b" => "inst-keep-dev-vpc-network-nat-us-central1-b"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_b.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "3731707379855754622" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "" (forces new resource)

~ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395600000001" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395600000001" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.202.214.39" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.202.214.39" => "35.202.214.39"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1214138052:                                     "inst-keep-dev-vpc-network-nat-us-central1-c" => "inst-keep-dev-vpc-network-nat-us-central1-c"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_c.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "9171285365591061132" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "" (forces new resource)
Plan: 12 to add, 5 to change, 7 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

Standalone tf config for openvpn
d569c00 
I'm going to wrap this in a module eventually.  For now I've configured
openvpn in a separate config file to keep it from the perm configs.
@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
+ create
~ update in-place
-/+ destroy and then create replacement
 <= read (data resources)

Terraform will perform the following actions:

~ helm_release.openvpn
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

 <= module.demo_dev_gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                                                  <computed>
      load_balancer_ingress.#:                             <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "helm-kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      spec.#:                                              <computed>

+ module.demo_dev_gke_cluster_metrics.helm_release.kube_state_metrics
      id:                                                  <computed>
      chart:                                               "stable/kube-state-metrics"
      disable_webhooks:                                    "false"
      force_update:                                        "false"
      keyring:                                             "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                                          <computed>
      name:                                                "helm-kube-state-metrics"
      namespace:                                           "metrics"
      recreate_pods:                                       "false"
      reuse:                                               "false"
      reuse_values:                                        "false"
      set.#:                                               "1"
      set.1510645123.name:                                 "rbac.serviceAccountName"
      set.1510645123.value:                                "kube-state-metrics"
      timeout:                                             "300"
      verify:                                              "false"
      version:                                             "0.13.0"
      wait:                                                "true"

+ module.demo_dev_gke_cluster_metrics.helm_release.prometheus_to_sd
      id:                                                  <computed>
      chart:                                               "stable/prometheus-to-sd"
      disable_webhooks:                                    "false"
      force_update:                                        "false"
      keyring:                                             "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                                          <computed>
      name:                                                "helm-prometheus-to-sd"
      namespace:                                           "metrics"
      recreate_pods:                                       "false"
      reuse:                                               "false"
      reuse_values:                                        "false"
      set.#:                                               "1"
      set.~642634291.name:                                 "metricsSources.kube-state-metrics"
      set.~642634291.value:                                "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"
      timeout:                                             "300"
      verify:                                              "false"
      version:                                             "0.1.1"
      wait:                                                "true"

+ module.demo_dev_gke_cluster_metrics.kubernetes_cluster_role_binding.kube_state_metrics_cluster_role_binding
      id:                                                  <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "kube-state-metrics-cluster-view-binding"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      role_ref.%:                                          "3"
      role_ref.api_group:                                  "rbac.authorization.k8s.io"
      role_ref.kind:                                       "ClusterRole"
      role_ref.name:                                       "view"
      subject.#:                                           "1"
      subject.0.kind:                                      "ServiceAccount"
      subject.0.name:                                      "kube-state-metrics"
      subject.0.namespace:                                 "metrics"

+ module.demo_dev_gke_cluster_metrics.kubernetes_namespace.metrics
      id:                                                  <computed>
      metadata.#:                                          "1"
      metadata.0.annotations.%:                            "1"
      metadata.0.annotations.description:                  "The namespace for for installing third party Kubernetes metrics tools."
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>

+ module.demo_dev_gke_cluster_metrics.kubernetes_service_account.kube_state_metrics
      id:                                                  <computed>
      automount_service_account_token:                     "false"
      default_secret_name:                                 <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>

~ module.gke_cluster.google_container_cluster.a_gke_cluster
      logging_service:                                     "logging.googleapis.com/kubernetes" => "logging.googleapis.com"

+ module.gke_cluster.google_project_service.container
      id:                                                  <computed>
      disable_on_destroy:                                  "true"
      project:                                             "keep-dev-fe24"
      service:                                             "container.googleapis.com"

~ module.helm_provider_helper.kubernetes_service_account.tiller
      automount_service_account_token:                     "" => "false"

~ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395700000002" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395700000002" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.238.255.240" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.238.255.240" => "35.238.255.240"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags.2790270952:                                     "inst-keep-dev-vpc-network-nat-us-central1-a" => "inst-keep-dev-vpc-network-nat-us-central1-a"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_a.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "2428940380811452119" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "" (forces new resource)

~ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836396700000003" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836396700000003" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.226.204.36" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.226.204.36" => "35.226.204.36"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1062827602:                                     "inst-keep-dev-vpc-network-nat-us-central1-b" => "inst-keep-dev-vpc-network-nat-us-central1-b"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_b.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "3731707379855754622" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "" (forces new resource)

~ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395600000001" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395600000001" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.202.214.39" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.202.214.39" => "35.202.214.39"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1214138052:                                     "inst-keep-dev-vpc-network-nat-us-central1-c" => "inst-keep-dev-vpc-network-nat-us-central1-c"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_c.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "9171285365591061132" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "" (forces new resource)
Plan: 12 to add, 6 to change, 6 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

@sthompson22
Copy link
Contributor Author

Trying to sort out why this plan isn't clean I don't have any of the NAT delete tasks when trying terraform plan locally. Same TF version.

@sthompson22
Copy link
Contributor Author

Provider versions were different (also weird), but matching them up didn't make a difference. Having a look on the Atlantis container for now.

@sthompson22
Copy link
Contributor Author

atlantis plan -d infrastructure/terraform/keep-dev

@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
+ create
~ update in-place
-/+ destroy and then create replacement
 <= read (data resources)

Terraform will perform the following actions:

~ helm_release.openvpn
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

 <= module.demo_dev_gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                                                  <computed>
      load_balancer_ingress.#:                             <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "helm-kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      spec.#:                                              <computed>

+ module.demo_dev_gke_cluster_metrics.helm_release.kube_state_metrics
      id:                                                  <computed>
      chart:                                               "stable/kube-state-metrics"
      disable_webhooks:                                    "false"
      force_update:                                        "false"
      keyring:                                             "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                                          <computed>
      name:                                                "helm-kube-state-metrics"
      namespace:                                           "metrics"
      recreate_pods:                                       "false"
      reuse:                                               "false"
      reuse_values:                                        "false"
      set.#:                                               "1"
      set.1510645123.name:                                 "rbac.serviceAccountName"
      set.1510645123.value:                                "kube-state-metrics"
      timeout:                                             "300"
      verify:                                              "false"
      version:                                             "0.13.0"
      wait:                                                "true"

+ module.demo_dev_gke_cluster_metrics.helm_release.prometheus_to_sd
      id:                                                  <computed>
      chart:                                               "stable/prometheus-to-sd"
      disable_webhooks:                                    "false"
      force_update:                                        "false"
      keyring:                                             "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                                          <computed>
      name:                                                "helm-prometheus-to-sd"
      namespace:                                           "metrics"
      recreate_pods:                                       "false"
      reuse:                                               "false"
      reuse_values:                                        "false"
      set.#:                                               "1"
      set.~642634291.name:                                 "metricsSources.kube-state-metrics"
      set.~642634291.value:                                "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"
      timeout:                                             "300"
      verify:                                              "false"
      version:                                             "0.1.1"
      wait:                                                "true"

+ module.demo_dev_gke_cluster_metrics.kubernetes_cluster_role_binding.kube_state_metrics_cluster_role_binding
      id:                                                  <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "kube-state-metrics-cluster-view-binding"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      role_ref.%:                                          "3"
      role_ref.api_group:                                  "rbac.authorization.k8s.io"
      role_ref.kind:                                       "ClusterRole"
      role_ref.name:                                       "view"
      subject.#:                                           "1"
      subject.0.kind:                                      "ServiceAccount"
      subject.0.name:                                      "kube-state-metrics"
      subject.0.namespace:                                 "metrics"

+ module.demo_dev_gke_cluster_metrics.kubernetes_namespace.metrics
      id:                                                  <computed>
      metadata.#:                                          "1"
      metadata.0.annotations.%:                            "1"
      metadata.0.annotations.description:                  "The namespace for for installing third party Kubernetes metrics tools."
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>

+ module.demo_dev_gke_cluster_metrics.kubernetes_service_account.kube_state_metrics
      id:                                                  <computed>
      automount_service_account_token:                     "false"
      default_secret_name:                                 <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>

~ module.gke_cluster.google_container_cluster.a_gke_cluster
      logging_service:                                     "logging.googleapis.com/kubernetes" => "logging.googleapis.com"

+ module.gke_cluster.google_project_service.container
      id:                                                  <computed>
      disable_on_destroy:                                  "true"
      project:                                             "keep-dev-fe24"
      service:                                             "container.googleapis.com"

~ module.helm_provider_helper.kubernetes_service_account.tiller
      automount_service_account_token:                     "" => "false"

~ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395700000002" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395700000002" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.238.255.240" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.238.255.240" => "35.238.255.240"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags.2790270952:                                     "inst-keep-dev-vpc-network-nat-us-central1-a" => "inst-keep-dev-vpc-network-nat-us-central1-a"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_a.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "2428940380811452119" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "" (forces new resource)

~ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836396700000003" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836396700000003" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.226.204.36" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.226.204.36" => "35.226.204.36"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1062827602:                                     "inst-keep-dev-vpc-network-nat-us-central1-b" => "inst-keep-dev-vpc-network-nat-us-central1-b"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_b.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "3731707379855754622" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "" (forces new resource)

~ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395600000001" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395600000001" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.202.214.39" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.202.214.39" => "35.202.214.39"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1214138052:                                     "inst-keep-dev-vpc-network-nat-us-central1-c" => "inst-keep-dev-vpc-network-nat-us-central1-c"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_c.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "9171285365591061132" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "" (forces new resource)
Plan: 12 to add, 6 to change, 6 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

@sthompson22
Copy link
Contributor Author

Going to run this apply locally and see what happens.

@sthompson22
Copy link
Contributor Author

Totally clean locally

@sthompson22
Copy link
Contributor Author

atlantis plan

@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
+ create
~ update in-place
-/+ destroy and then create replacement
 <= read (data resources)

Terraform will perform the following actions:

~ helm_release.openvpn
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

 <= module.demo_dev_gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                                                  <computed>
      load_balancer_ingress.#:                             <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "helm-kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      spec.#:                                              <computed>

~ module.demo_dev_gke_cluster_metrics.helm_release.kube_state_metrics
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

~ module.demo_dev_gke_cluster_metrics.helm_release.prometheus_to_sd
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"
      set.1429516357.name:                                 "metricsSources.kube-state-metrics" => ""
      set.1429516357.value:                                "http://10.102.100.47:8080" => ""
      set.~642634291.name:                                 "" => "metricsSources.kube-state-metrics"
      set.~642634291.value:                                "" => "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"

~ module.demo_dev_gke_cluster_metrics.kubernetes_service_account.kube_state_metrics
      automount_service_account_token:                     "" => "false"

~ module.gke_cluster.google_container_cluster.a_gke_cluster
      logging_service:                                     "logging.googleapis.com/kubernetes" => "logging.googleapis.com"

+ module.gke_cluster.google_project_service.container
      id:                                                  <computed>
      disable_on_destroy:                                  "true"
      project:                                             "keep-dev-fe24"
      service:                                             "container.googleapis.com"

~ module.helm_provider_helper.kubernetes_service_account.tiller
      automount_service_account_token:                     "" => "false"

~ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395700000002" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395700000002" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.238.255.240" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.238.255.240" => "35.238.255.240"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags.2790270952:                                     "inst-keep-dev-vpc-network-nat-us-central1-a" => "inst-keep-dev-vpc-network-nat-us-central1-a"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_a.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "2428940380811452119" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "" (forces new resource)

~ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836396700000003" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836396700000003" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.226.204.36" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.226.204.36" => "35.226.204.36"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1062827602:                                     "inst-keep-dev-vpc-network-nat-us-central1-b" => "inst-keep-dev-vpc-network-nat-us-central1-b"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_b.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "3731707379855754622" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "" (forces new resource)

~ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395600000001" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395600000001" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.202.214.39" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.202.214.39" => "35.202.214.39"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1214138052:                                     "inst-keep-dev-vpc-network-nat-us-central1-c" => "inst-keep-dev-vpc-network-nat-us-central1-c"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_c.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "9171285365591061132" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "" (forces new resource)
Plan: 7 to add, 9 to change, 6 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

@sthompson22
Copy link
Contributor Author

Alright so after the clean apply locally, plan still leaves the bits that don't exist in my local state on the branch. Mostly expected ~ makes things a little easier to look at.

@sthompson22
Copy link
Contributor Author

atlantis plan

@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
+ create
~ update in-place
-/+ destroy and then create replacement
 <= read (data resources)

Terraform will perform the following actions:

~ helm_release.openvpn
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

 <= module.demo_dev_gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                                                  <computed>
      load_balancer_ingress.#:                             <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "helm-kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      spec.#:                                              <computed>

~ module.demo_dev_gke_cluster_metrics.helm_release.kube_state_metrics
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

~ module.demo_dev_gke_cluster_metrics.helm_release.prometheus_to_sd
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"
      set.1429516357.name:                                 "metricsSources.kube-state-metrics" => ""
      set.1429516357.value:                                "http://10.102.100.47:8080" => ""
      set.~642634291.name:                                 "" => "metricsSources.kube-state-metrics"
      set.~642634291.value:                                "" => "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"

~ module.demo_dev_gke_cluster_metrics.kubernetes_service_account.kube_state_metrics
      automount_service_account_token:                     "" => "false"

~ module.gke_cluster.google_container_cluster.a_gke_cluster
      logging_service:                                     "logging.googleapis.com/kubernetes" => "logging.googleapis.com"

+ module.gke_cluster.google_project_service.container
      id:                                                  <computed>
      disable_on_destroy:                                  "true"
      project:                                             "keep-dev-fe24"
      service:                                             "container.googleapis.com"

~ module.helm_provider_helper.kubernetes_service_account.tiller
      automount_service_account_token:                     "" => "false"

~ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395700000002" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395700000002" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.238.255.240" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.238.255.240" => "35.238.255.240"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags.2790270952:                                     "inst-keep-dev-vpc-network-nat-us-central1-a" => "inst-keep-dev-vpc-network-nat-us-central1-a"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_a.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "2428940380811452119" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "" (forces new resource)

~ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836396700000003" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836396700000003" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.226.204.36" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.226.204.36" => "35.226.204.36"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1062827602:                                     "inst-keep-dev-vpc-network-nat-us-central1-b" => "inst-keep-dev-vpc-network-nat-us-central1-b"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_b.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "3731707379855754622" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "" (forces new resource)

~ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395600000001" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395600000001" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.202.214.39" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.202.214.39" => "35.202.214.39"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1214138052:                                     "inst-keep-dev-vpc-network-nat-us-central1-c" => "inst-keep-dev-vpc-network-nat-us-central1-c"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_c.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "9171285365591061132" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "" (forces new resource)
Plan: 7 to add, 9 to change, 6 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

@sthompson22
Copy link
Contributor Author

So I had Markus pull this branch and run a plan locally. His plan looks like the Atlantis plan which makes my local the odd duck out. Will look into this more on Monday. Found another tiny bug in the data source for gke_metrics I'm going to hash out first.

@sthompson22
Copy link
Contributor Author

hashicorp/terraform#11806 the aforementioned data source issue I'm seeing

@sthompson22
Copy link
Contributor Author

So, I killed my .terraform file on local to try and reproduce the plan state Atlantis / Markus are seeing..still no dice, going to have to look deeper.

@sthompson22
Copy link
Contributor Author

atlantis plan

@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
+ create
~ update in-place
-/+ destroy and then create replacement
 <= read (data resources)

Terraform will perform the following actions:

~ helm_release.openvpn
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

 <= module.demo_dev_gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                                                  <computed>
      load_balancer_ingress.#:                             <computed>
      metadata.#:                                          "1"
      metadata.0.generation:                               <computed>
      metadata.0.name:                                     "helm-kube-state-metrics"
      metadata.0.namespace:                                "metrics"
      metadata.0.resource_version:                         <computed>
      metadata.0.self_link:                                <computed>
      metadata.0.uid:                                      <computed>
      spec.#:                                              <computed>

~ module.demo_dev_gke_cluster_metrics.helm_release.kube_state_metrics
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

~ module.demo_dev_gke_cluster_metrics.helm_release.prometheus_to_sd
      keyring:                                             "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"
      set.1429516357.name:                                 "metricsSources.kube-state-metrics" => ""
      set.1429516357.value:                                "http://10.102.100.47:8080" => ""
      set.~642634291.name:                                 "" => "metricsSources.kube-state-metrics"
      set.~642634291.value:                                "" => "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"

~ module.demo_dev_gke_cluster_metrics.kubernetes_service_account.kube_state_metrics
      automount_service_account_token:                     "" => "false"

~ module.gke_cluster.google_container_cluster.a_gke_cluster
      logging_service:                                     "logging.googleapis.com/kubernetes" => "logging.googleapis.com"

+ module.gke_cluster.google_project_service.container
      id:                                                  <computed>
      disable_on_destroy:                                  "true"
      project:                                             "keep-dev-fe24"
      service:                                             "container.googleapis.com"

~ module.helm_provider_helper.kubernetes_service_account.tiller
      automount_service_account_token:                     "" => "false"

~ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_a.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395700000002" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395700000002" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.238.255.240" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.238.255.240" => "35.238.255.240"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags.2790270952:                                     "inst-keep-dev-vpc-network-nat-us-central1-a" => "inst-keep-dev-vpc-network-nat-us-central1-a"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_a.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "2428940380811452119" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395700000002" => "" (forces new resource)

~ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_b.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836396700000003" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836396700000003" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.226.204.36" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.226.204.36" => "35.226.204.36"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1062827602:                                     "inst-keep-dev-vpc-network-nat-us-central1-b" => "inst-keep-dev-vpc-network-nat-us-central1-b"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_b.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "3731707379855754622" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836396700000003" => "" (forces new resource)

~ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_group_manager.default
      instance_template:                                   "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "${google_compute_instance_template.default.self_link}"

-/+ module.nat_gateway_zone_c.module.nat-gateway.google_compute_instance_template.default (new resource required)
      id:                                                  "default-20181115162836395600000001" => <computed> (forces new resource)
      can_ip_forward:                                      "true" => "true"
      disk.#:                                              "1" => "1"
      disk.0.auto_delete:                                  "true" => "true"
      disk.0.boot:                                         "true" => "true"
      disk.0.device_name:                                  "persistent-disk-0" => <computed>
      disk.0.disk_size_gb:                                 "0" => "0"
      disk.0.disk_type:                                    "pd-ssd" => "pd-ssd"
      disk.0.interface:                                    "SCSI" => <computed>
      disk.0.mode:                                         "READ_WRITE" => "READ_WRITE"
      disk.0.source_image:                                 "projects/debian-cloud/global/images/family/debian-9" => "projects/debian-cloud/global/images/family/debian-9"
      disk.0.type:                                         "PERSISTENT" => "PERSISTENT"
      labels.%:                                            "3" => "3"
      labels.contact:                                      "sthompson22" => "sthompson22"
      labels.environment:                                  "keep-dev" => "keep-dev"
      labels.vertical:                                     "keep" => "keep"
      machine_type:                                        "n1-standard-1" => "n1-standard-1"
      metadata.%:                                          "2" => "2"
      metadata.startup-script:                             "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" => "#!/bin/bash -xe\n\n# Enable ip forwarding and nat\nsysctl -w net.ipv4.ip_forward=1\n\n# Make forwarding persistent.\nsed -i= 's/^[# ]*net.ipv4.ip_forward=[[:digit:]]/net.ipv4.ip_forward=1/g' /etc/sysctl.conf\n\niptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE\n\napt-get update\n\n# Install nginx for instance http health check\napt-get install -y nginx\n\nENABLE_SQUID=\"false\"\n\nif [[ \"$$ENABLE_SQUID\" == \"true\" ]]; then\n  apt-get install -y squid3\n\n  cat - > /etc/squid/squid.conf <<'EOM'\nshutdown_lifetime 3 seconds\n\nhttp_access allow all\n\nhttp_port 3128\nhttp_port 3129 transparent\n\n# Anonymous proxy settings\nvia off\nforwarded_for off\n\nrequest_header_access Allow allow all \nrequest_header_access Authorization allow all \nrequest_header_access WWW-Authenticate allow all \nrequest_header_access Proxy-Authorization allow all \nrequest_header_access Proxy-Authenticate allow all \nrequest_header_access Cache-Control allow all \nrequest_header_access Content-Encoding allow all \nrequest_header_access Content-Length allow all \nrequest_header_access Content-Type allow all \nrequest_header_access Date allow all \nrequest_header_access Expires allow all \nrequest_header_access Host allow all \nrequest_header_access If-Modified-Since allow all \nrequest_header_access Last-Modified allow all \nrequest_header_access Location allow all \nrequest_header_access Pragma allow all \nrequest_header_access Accept allow all \nrequest_header_access Accept-Charset allow all \nrequest_header_access Accept-Encoding allow all \nrequest_header_access Accept-Language allow all \nrequest_header_access Content-Language allow all \nrequest_header_access Mime-Version allow all \nrequest_header_access Retry-After allow all \nrequest_header_access Title allow all \nrequest_header_access Connection allow all \nrequest_header_access Proxy-Connection allow all \nrequest_header_access User-Agent allow all \nrequest_header_access Cookie allow all \nrequest_header_access All deny all\nEOM\n\n  systemctl reload squid\nfi\n" (forces new resource)
      metadata.tf_depends_id:                              "" => ""
      metadata_fingerprint:                                "vXOUEBeWCe8=" => <computed>
      name:                                                "default-20181115162836395600000001" => <computed>
      name_prefix:                                         "default-" => "default-"
      network_interface.#:                                 "1" => "1"
      network_interface.0.access_config.#:                 "1" => "1"
      network_interface.0.access_config.0.assigned_nat_ip: "35.202.214.39" => <computed>
      network_interface.0.access_config.0.nat_ip:          "35.202.214.39" => "35.202.214.39"
      network_interface.0.access_config.0.network_tier:    "PREMIUM" => <computed>
      network_interface.0.address:                         "" => <computed>
      network_interface.0.network_ip:                      "" => <computed>
      network_interface.0.subnetwork:                      "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1" => "https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/regions/us-central1/subnetworks/keep-dev-vpc-subnet-pub-us-central1"
      network_interface.0.subnetwork_project:              "keep-dev-fe24" => "keep-dev-fe24"
      project:                                             "keep-dev-fe24" => "keep-dev-fe24"
      region:                                              "us-central1" => "us-central1"
      scheduling.#:                                        "1" => "1"
      scheduling.0.automatic_restart:                      "true" => "true"
      scheduling.0.on_host_maintenance:                    "MIGRATE" => <computed>
      scheduling.0.preemptible:                            "false" => "false"
      self_link:                                           "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => <computed>
      service_account.#:                                   "1" => "1"
      service_account.0.email:                             "default" => "default"
      service_account.0.scopes.#:                          "4" => "4"
      service_account.0.scopes.1693978638:                 "https://www.googleapis.com/auth/devstorage.full_control" => "https://www.googleapis.com/auth/devstorage.full_control"
      service_account.0.scopes.172152165:                  "https://www.googleapis.com/auth/logging.write" => "https://www.googleapis.com/auth/logging.write"
      service_account.0.scopes.299962681:                  "https://www.googleapis.com/auth/compute" => "https://www.googleapis.com/auth/compute"
      service_account.0.scopes.4177124133:                 "https://www.googleapis.com/auth/monitoring.write" => "https://www.googleapis.com/auth/monitoring.write"
      tags.#:                                              "3" => "3"
      tags.1214138052:                                     "inst-keep-dev-vpc-network-nat-us-central1-c" => "inst-keep-dev-vpc-network-nat-us-central1-c"
      tags.1990099075:                                     "inst-keep-dev-vpc-network-nat-us-central1" => "inst-keep-dev-vpc-network-nat-us-central1"
      tags.2542268873:                                     "allow-ssh" => "allow-ssh"
      tags_fingerprint:                                    "" => <computed>

-/+ module.nat_gateway_zone_c.module.nat-gateway.null_resource.dummy_dependency (new resource required)
      id:                                                  "9171285365591061132" => <computed> (forces new resource)
      triggers.%:                                          "1" => <computed> (forces new resource)
      triggers.instance_template:                          "https://www.googleapis.com/compute/beta/projects/keep-dev-fe24/global/instanceTemplates/default-20181115162836395600000001" => "" (forces new resource)
Plan: 7 to add, 9 to change, 6 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

@sthompson22
Copy link
Contributor Author

Alright, I was able to locally reproduce the terraform plan output generated by Atlantis. I missed a provider update locally. Double backed over all my provider versions, matched Atlantis, blew away my .terraform, terraform init, terraform plan.

@sthompson22
Copy link
Contributor Author

andddd here's a fresh bug report regarding the funky terraform plan GoogleCloudPlatform/terraform-google-nat-gateway#109

Not just me :wipe: , going to see if I can fix this bug and open a PR on the Google Nat Gateway module.

@sthompson22
Copy link
Contributor Author

hashicorp/terraform-provider-template@b80e43a Think this is where we'll find our issue.

sthompson22 added 3 commits February 7, 2019 15:13
Merge branch 'master' into sthompson22/keep-dev/gke_metrics
2fe09ef
Explicit provider version definitions
0414347 
Providers are our interface into the various APIs Terraform needs to
interact with to provision our infrastructure.  They're all managed
and versioned independently.  Without versioning our providers we
run the risk of breaking our currently deployed infra by a provider
update.  Here we version all providers, and rollback a the template
provider from version 2.0.0 to 1.0.0 to prevent some unsavory
behavior in the Google managed NAT module.
Sourcing from local as a temp measure to observe some terraform plan …
f6da6a4 
…changes on the flyyyyy
@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Plan Error

Show Output 
exit status 1: running "terraform init -input=false -no-color" in "/atlantis/repos/keep-network/keep-core/534/default/infrastructure/terraform/keep-dev"
Initializing modules...
- module.project
  Getting source "[email protected]:thesis/infrastructure.git//terraform/modules/gcp_project"
- module.backend_bucket
  Getting source "[email protected]:thesis/infrastructure.git//terraform/modules/gcp_bucket"
- module.vpc
  Getting source "[email protected]:thesis/infrastructure.git//terraform/modules/gcp_vpc"
- module.nat_gateway_external_ips
  Getting source "[email protected]:thesis/infrastructure.git//terraform/modules/gcp_ip"
- module.nat_gateway_zone_a
  Found version 1.2.2 of GoogleCloudPlatform/nat-gateway/google on registry.terraform.io
  Getting source "GoogleCloudPlatform/nat-gateway/google"
- module.nat_gateway_zone_b
- module.nat_gateway_zone_c
- module.gke_cluster
  Getting source "[email protected]:thesis/infrastructure.git//terraform/modules/gcp_gke"
- module.gke_cluster_metrics
  Getting source "../../../../thesis/infrastructure/terraform/modules/gke_metrics"
Error downloading modules: Error loading modules: error downloading 'file:///atlantis/repos/keep-network/keep-core/534/thesis/infrastructure/terraform/modules/gke_metrics': source path error: stat /atlantis/repos/keep-network/keep-core/534/thesis/infrastructure/terraform/modules/gke_metrics: no such file or directory

@thesis-valkyrie
Copy link

Did you mean to use atlantis instead of terraform?

@sthompson22
Copy link
Contributor Author

atlantis plan

@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
+ create
 <= read (data resources)

Terraform will perform the following actions:

<= module.gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                          <computed>
      load_balancer_ingress.#:     <computed>
      metadata.#:                  "1"
      metadata.0.generation:       <computed>
      metadata.0.name:             "helm-kube-state-metrics"
      metadata.0.namespace:        "metrics"
      metadata.0.resource_version: <computed>
      metadata.0.self_link:        <computed>
      metadata.0.uid:              <computed>
      spec.#:                      <computed>

+ module.gke_cluster_metrics.helm_release.kube_state_metrics
      id:                          <computed>
      chart:                       "stable/kube-state-metrics"
      disable_webhooks:            "false"
      force_update:                "false"
      keyring:                     "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                  <computed>
      name:                        "helm-kube-state-metrics"
      namespace:                   "metrics"
      recreate_pods:               "false"
      reuse:                       "false"
      reuse_values:                "false"
      set.#:                       "1"
      set.1510645123.name:         "rbac.serviceAccountName"
      set.1510645123.value:        "kube-state-metrics"
      timeout:                     "300"
      verify:                      "false"
      version:                     "0.13.0"
      wait:                        "true"

+ module.gke_cluster_metrics.helm_release.prometheus_to_sd
      id:                          <computed>
      chart:                       "stable/prometheus-to-sd"
      disable_webhooks:            "false"
      force_update:                "false"
      keyring:                     "/home/atlantis/.gnupg/pubring.gpg"
      metadata.#:                  <computed>
      name:                        "helm-prometheus-to-sd"
      namespace:                   "metrics"
      recreate_pods:               "false"
      reuse:                       "false"
      reuse_values:                "false"
      set.#:                       "1"
      set.~642634291.name:         "metricsSources.kube-state-metrics"
      set.~642634291.value:        "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"
      timeout:                     "300"
      verify:                      "false"
      version:                     "0.1.1"
      wait:                        "true"
Plan: 2 to add, 0 to change, 0 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

@sthompson22
Copy link
Contributor Author

atlantis apply -d infrastructure/terraform/keep-dev

@thesis-valkyrie
Copy link

Ran Apply for dir: infrastructure/terraform/keep-dev workspace: default

Apply Error

Show Output 
exit status 1: running "terraform apply -input=false -no-color \"/atlantis/repos/keep-network/keep-core/534/default/infrastructure/terraform/keep-dev/default.tfplan\"" in "/atlantis/repos/keep-network/keep-core/534/default/infrastructure/terraform/keep-dev"
module.gke_cluster_metrics.helm_release.kube_state_metrics: Creating...
  chart:                "" => "stable/kube-state-metrics"
  disable_webhooks:     "" => "false"
  force_update:         "" => "false"
  keyring:              "" => "/home/atlantis/.gnupg/pubring.gpg"
  metadata.#:           "" => "<computed>"
  name:                 "" => "helm-kube-state-metrics"
  namespace:            "" => "metrics"
  recreate_pods:        "" => "false"
  reuse:                "" => "false"
  reuse_values:         "" => "false"
  set.#:                "" => "1"
  set.1510645123.name:  "" => "rbac.serviceAccountName"
  set.1510645123.value: "" => "kube-state-metrics"
  timeout:              "" => "300"
  verify:               "" => "false"
  version:              "" => "0.13.0"
  wait:                 "" => "true"

Error: Error applying plan:

1 error(s) occurred:

* module.gke_cluster_metrics.helm_release.kube_state_metrics: 1 error(s) occurred:

* helm_release.kube_state_metrics: failed to create archive folder, mkdir /home/atlantis/.helm: read-only file system

Terraform does not automatically rollback in the face of errors.
Instead, your Terraform state file has been partially updated with
any resources that successfully completed. Please address the error
above and apply again to incrementally change your infrastructure.

@sthompson22
Copy link
Contributor Author

@lispmeister This is ready to go now, I ended up running the apply locally while debugging Atlantis.

@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
~ update in-place
 <= read (data resources)

Terraform will perform the following actions:

~ helm_release.openvpn
      keyring:                     "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

 <= module.gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                          <computed>
      load_balancer_ingress.#:     <computed>
      metadata.#:                  "1"
      metadata.0.generation:       <computed>
      metadata.0.name:             "helm-kube-state-metrics"
      metadata.0.namespace:        "metrics"
      metadata.0.resource_version: <computed>
      metadata.0.self_link:        <computed>
      metadata.0.uid:              <computed>
      spec.#:                      <computed>

~ module.gke_cluster_metrics.helm_release.kube_state_metrics
      keyring:                     "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

~ module.gke_cluster_metrics.helm_release.prometheus_to_sd
      keyring:                     "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"
      set.2278855196.name:         "metricsSources.kube-state-metrics" => ""
      set.2278855196.value:        "http://10.102.100.169:8080" => ""
      set.~642634291.name:         "" => "metricsSources.kube-state-metrics"
      set.~642634291.value:        "" => "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"
Plan: 0 to add, 3 to change, 0 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

sthompson22 added 2 commits February 13, 2019 10:08
Metrics currently creates a data read / change on each TF plan/apply
4ef1691 
Using this module will create a data read and an update for the
prometheus-to-sd resource on each Terraform planand apply run.  These
updates will do nothing and are an artifact of the depends_on in the
modules data resource. Terraform team is aware and have a proposed fix
in the works.
Docu section for gke-metrics
a95b7ae
@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
~ update in-place
 <= read (data resources)

Terraform will perform the following actions:

~ helm_release.openvpn
      keyring:                     "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

 <= module.gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                          <computed>
      load_balancer_ingress.#:     <computed>
      metadata.#:                  "1"
      metadata.0.generation:       <computed>
      metadata.0.name:             "helm-kube-state-metrics"
      metadata.0.namespace:        "metrics"
      metadata.0.resource_version: <computed>
      metadata.0.self_link:        <computed>
      metadata.0.uid:              <computed>
      spec.#:                      <computed>

~ module.gke_cluster_metrics.helm_release.kube_state_metrics
      keyring:                     "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

~ module.gke_cluster_metrics.helm_release.prometheus_to_sd
      keyring:                     "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"
      set.2278855196.name:         "metricsSources.kube-state-metrics" => ""
      set.2278855196.value:        "http://10.102.100.169:8080" => ""
      set.~642634291.name:         "" => "metricsSources.kube-state-metrics"
      set.~642634291.value:        "" => "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"
Plan: 0 to add, 3 to change, 0 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

@sthompson22
Copy link
Contributor Author

atlantis apply -d infrastructure/terraform/keep-dev

@thesis-valkyrie
Copy link

Ran Apply for dir: infrastructure/terraform/keep-dev workspace: default

Apply Error

Show Output 
exit status 1: running "terraform apply -input=false -no-color \"/atlantis/repos/keep-network/keep-core/534/default/infrastructure/terraform/keep-dev/default.tfplan\"" in "/atlantis/repos/keep-network/keep-core/534/default/infrastructure/terraform/keep-dev"
helm_release.openvpn: Modifying... (ID: helm-openvpn)
  keyring: "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"
module.gke_cluster_metrics.helm_release.kube_state_metrics: Modifying... (ID: helm-kube-state-metrics)
  keyring: "/Users/sthompson22/.gnupg/pubring.gpg" => "/home/atlantis/.gnupg/pubring.gpg"

Error: Error applying plan:

2 error(s) occurred:

* helm_release.openvpn: 1 error(s) occurred:

* helm_release.openvpn: failed to create archive folder, mkdir /home/atlantis/.helm: read-only file system
* module.gke_cluster_metrics.helm_release.kube_state_metrics: 1 error(s) occurred:

* helm_release.kube_state_metrics: failed to create archive folder, mkdir /home/atlantis/.helm: read-only file system

Terraform does not automatically rollback in the face of errors.
Instead, your Terraform state file has been partially updated with
any resources that successfully completed. Please address the error
above and apply again to incrementally change your infrastructure.

@thesis-valkyrie
Copy link

Ran Plan for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
~ update in-place
 <= read (data resources)

Terraform will perform the following actions:

<= module.gke_cluster_metrics.data.kubernetes_service.kube_state_metrics
      id:                          <computed>
      load_balancer_ingress.#:     <computed>
      metadata.#:                  "1"
      metadata.0.generation:       <computed>
      metadata.0.name:             "helm-kube-state-metrics"
      metadata.0.namespace:        "metrics"
      metadata.0.resource_version: <computed>
      metadata.0.self_link:        <computed>
      metadata.0.uid:              <computed>
      spec.#:                      <computed>

~ module.gke_cluster_metrics.helm_release.prometheus_to_sd
      set.2278855196.name:         "metricsSources.kube-state-metrics" => ""
      set.2278855196.value:        "http://10.102.100.169:8080" => ""
      set.~642634291.name:         "" => "metricsSources.kube-state-metrics"
      set.~642634291.value:        "" => "http://${data.kubernetes_service.kube_state_metrics.spec.0.cluster_ip}:8080"
Plan: 0 to add, 1 to change, 0 to destroy.
  • ▶️ To apply this plan, comment:
    • atlantis apply -d infrastructure/terraform/keep-dev
  • 🚮 To delete this plan click here
  • 🔁 To plan this project again, comment:
    • atlantis plan -d infrastructure/terraform/keep-dev
  • ⏩ To apply all unapplied plans from this pull request, comment:
    • atlantis apply

@sthompson22
Copy link
Contributor Author

atlantis apply -d infrastructure/terraform/keep-dev

@thesis-valkyrie
Copy link

Ran Apply for dir: infrastructure/terraform/keep-dev workspace: default

Show Output 
module.gke_cluster_metrics.data.kubernetes_service.kube_state_metrics: Refreshing state...

Apply complete! Resources: 0 added, 0 changed, 0 destroyed.

Outputs:

atlantis_external_ip = 35.244.176.50
backend_bucket_name = keep-dev-tf-backend-bucket
contacts = sthompson22
environment = keep-dev
nat_gateway_external_ips = [
    35.238.255.240,
    35.226.204.36,
    35.202.214.39
]
nat_gateway_region_route_tag = keep-dev-vpc-network-nat-us-central1
nat_gateway_zone_a_instance = [
    https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/zones/us-central1-a/instances/keep-dev-vpc-network-nat-gateway-us-central1-a-k0cm
]
nat_gateway_zone_a_route_tag = keep-dev-vpc-network-nat-us-central1-a
nat_gateway_zone_b_instance = [
    https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/zones/us-central1-b/instances/keep-dev-vpc-network-nat-gateway-us-central1-b-4r66
]
nat_gateway_zone_b_route_tag = keep-dev-vpc-network-nat-us-central1-b
nat_gateway_zone_c_instance = [
    https://www.googleapis.com/compute/v1/projects/keep-dev-fe24/zones/us-central1-c/instances/keep-dev-vpc-network-nat-gateway-us-central1-c-cr11
]
nat_gateway_zone_c_route_tag = keep-dev-vpc-network-nat-us-central1-c
project_id = keep-dev-fe24
project_name = keep-dev
project_owner_members = [
    user:[email protected],
    user:[email protected],
    user:[email protected],
    serviceAccount:[email protected]
]
region_data = {
  region = us-central1
  zone_a = us-central1-a
  zone_b = us-central1-b
  zone_c = us-central1-c
  zone_f = us-central1-f
}
vertical = keep
vpc_network_gateway_ip = 
vpc_network_name = keep-dev-vpc-network
vpc_private_subnet_name = keep-dev-vpc-subnet-pri-us-central1
vpc_public_subnet_name = keep-dev-vpc-subnet-pub-us-central1

@sthompson22
Copy link
Contributor Author

Finally a clean apply.

@sthompson22
Copy link
Contributor Author

Ok now this is ready ready =)

sthompson22 added 2 commits February 21, 2019 21:01
Move to openvpn install via module
a707c24
Disable network policies
0d98659 
A recent GKE upgrade resulted in openvpn connections not working.
Specifically, a client can connect to the vpn but requests to the
tun0 interface are not routed.  After exhaustive research we could
not find a misconfiguration between server and client.  Because the
demo-dev environment continued to work post upgrade and does not
have network policies enabled we rebuilt the cluster with policies
disabled.  This corrected the openvpn connection.  For now were
disabling network policies so that we can use the environment.
We need to look into Calico routing.
@sthompson22
Copy link
Contributor Author

@lispmeister Would like to have this merged sooner than later please.

sthompson22
sthompson22 commented Feb 25, 2019
View reviewed changes
infrastructure/terraform/keep-dev/main.tf
@@ -121,11 +121,11 @@ module "gke_cluster" {
gke_cluster {
name = "${var.gke_cluster["name"]}"
private_cluster = "${var.gke_cluster["private_cluster"]}"
subnetwork = "${module.vpc.vpc_private_subnet_self_link}"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Took this out because it's superfluous. This param is actually ignored by the module.

@sthompson22 sthompson22 changed the title keep-dev: GKE metrics keep-dev: GKE metrics + keep-dev repairs Feb 25, 2019
@sthompson22 sthompson22 changed the title keep-dev: GKE metrics + keep-dev repairs keep-dev: GKE metrics + env repairs Feb 25, 2019
@sthompson22
Copy link
Contributor Author

@lispmeister pinging here again.

lispmeister
lispmeister reviewed Mar 18, 2019
View reviewed changes
Copy link
Contributor

@lispmeister lispmeister left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All good.

lispmeister
lispmeister approved these changes Mar 18, 2019
View reviewed changes
Copy link
Contributor

@lispmeister lispmeister left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All good!

@sthompson22 sthompson22 merged commit 6476010 into master Mar 19, 2019
@sthompson22 sthompson22 deleted the sthompson22/keep-dev/gke_metrics branch March 19, 2019 11:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lispmeister lispmeister lispmeister approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@sthompson22 @thesis-valkyrie @lispmeister