>>> kops: Building testing/kops 1.28.0-r0 (using abuild 3.11.21-r0) started Wed, 27 Sep 2023 05:57:49 +0000 >>> kops: Checking sanity of /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/5) Installing kubernetes (1.28.2-r0) (2/5) Installing go (1.21.1-r0) (3/5) Installing readline (8.2.1-r2) (4/5) Installing bash (5.2.15-r5) Executing bash-5.2.15-r5.post-install (5/5) Installing .makedepends-kops (20230927.055751) Executing busybox-1.36.1-r8.trigger OK: 556 MiB in 115 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.0.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 146 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (22) The requested URL returned error: 404 >>> kops: Fetching kops-1.28.0.tar.gz::https://github.com/kubernetes/kops/archive/v1.28.0.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1673k 0 1673k 0 0 2476k 0 --:--:-- --:--:-- --:--:-- 2476k 100 10.9M 0 10.9M 0 0 6702k 0 --:--:-- 0:00:01 --:--:-- 9554k 100 15.4M 0 15.4M 0 0 5909k 0 --:--:-- 0:00:02 --:--:-- 7069k 100 20.8M 0 20.8M 0 0 5798k 0 --:--:-- 0:00:03 --:--:-- 6545k 100 25.1M 0 25.1M 0 0 5508k 0 --:--:-- 0:00:04 --:--:-- 6020k 100 29.2M 0 29.2M 0 0 5280k 0 --:--:-- 0:00:05 --:--:-- 5658k 100 32.6M 0 32.6M 0 0 5181k 0 --:--:-- 0:00:06 --:--:-- 4647k >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.0.tar.gz >>> kops: Checking sha512sums... kops-1.28.0.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.0.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.0/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.0/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.0 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading k8s.io/client-go v0.28.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading k8s.io/apimachinery v0.28.1 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading github.com/aws/aws-sdk-go v1.45.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading golang.org/x/crypto v0.12.0 go: downloading k8s.io/api v0.28.1 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading go.uber.org/multierr v1.11.0 go: downloading github.com/spf13/pflag v1.0.5 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/net v0.14.0 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading github.com/go-logr/logr v1.2.4 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/google/uuid v1.3.1 go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/pkg/errors v0.9.1 go: downloading golang.org/x/sys v0.11.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading golang.org/x/term v0.11.0 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading github.com/magiconair/properties v1.8.7 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading golang.org/x/text v0.12.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/moby/locker v1.0.1 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0927 06:00:27.608879 26610 addon.go:250] addon test wants to update all nodes I0927 06:00:27.611480 26610 addon.go:250] addon test wants to update workers nodes I0927 06:00:27.611906 26610 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.01s) === RUN Test_InstallPKI I0927 06:00:27.616392 26610 addon.go:283] installing PKI for "test" I0927 06:00:27.792951 26610 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.82s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.917s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.070s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] ? k8s.io/kops/pkg/apis/kops/registry [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] ? k8s.io/kops/pkg/commands/commandutils [no test files] ? k8s.io/kops/pkg/configserver [no test files] ? k8s.io/kops/pkg/dump [no test files] ? k8s.io/kops/pkg/kopscontrollerclient [no test files] ? k8s.io/kops/pkg/kubemanifest [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] ? k8s.io/kops/pkg/resources/digitalocean [no test files] ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] ? k8s.io/kops/pkg/try [no test files] ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] ? k8s.io/kops/tests/fuzz [no test files] ? k8s.io/kops/tests/integration/channel/simple [no test files] ? k8s.io/kops/upup/models [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] ? k8s.io/kops/upup/pkg/fi/secrets [no test files] ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] ? k8s.io/kops/util/pkg/env [no test files] ? k8s.io/kops/util/pkg/mirrors [no test files] ? k8s.io/kops/util/pkg/tables [no test files] ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestCreateClusterMinimal I0927 06:00:30.338419 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:30.338696 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:30.338788 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:30.338877 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:30.338974 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:30.339100 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:30.339200 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:30.339265 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:30.339346 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:30.339411 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:30.345983 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.346077 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.402332 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:30.402685 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:30.403286 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:30.425789 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:30.425908 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:30.425950 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:30.426018 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:30.426066 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:30.426122 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:30.426167 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:30.426199 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:30.426240 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:30.426271 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:30.433522 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.433575 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.478667 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:30.478972 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:30.479405 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:30.488615 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:30.488722 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:30.488761 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:30.488810 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:30.488852 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:30.488900 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:30.488942 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:30.488972 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:30.489016 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:30.489045 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:30.493348 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.493405 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.527486 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:30.527660 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:30.527993 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:30.533928 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:30.534003 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:30.534029 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:30.534057 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:30.534085 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:30.534117 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:30.534142 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:30.534161 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:30.534185 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:30.534203 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:30.589585 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.589649 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.646620 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:30.646893 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:30.647386 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:30.658070 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:30.658173 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:30.658207 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:30.658247 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:30.658276 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:30.658313 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:30.658346 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:30.658365 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:30.658391 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:30.658410 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:30.662607 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.662653 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.727227 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:30.727407 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:30.727784 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:30.733066 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:30.733134 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:30.733160 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:30.733189 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:30.733218 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:30.733251 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:30.733279 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:30.733295 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:30.733320 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:30.733339 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:30.736729 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.736771 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.774537 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:30.774642 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:30.774928 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:30.780825 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:30.780903 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:30.780940 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:30.780974 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:30.781003 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:30.781038 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:30.781070 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:30.781091 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:30.781117 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:30.781179 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:30.784911 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.784953 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.825968 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:30.826343 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:30.826849 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.50s) === RUN TestCreateClusterHetzner I0927 06:00:30.834684 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:30.834787 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:30.834815 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:30.834844 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:30.834870 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:30.834900 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:30.834926 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:30.834944 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:30.834969 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:30.834985 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:30.838539 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.838585 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0927 06:00:30.921449 28442 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0927 06:00:30.921494 28442 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0927 06:00:30.928277 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:30.928363 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:30.928391 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:30.928420 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:30.928448 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:30.928479 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:30.928506 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:30.928522 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:30.928545 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:30.928566 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:30.967972 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:30.968041 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.031955 28442 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.20s) === RUN TestCreateClusterOpenStack I0927 06:00:31.037328 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.037413 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.037440 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.037469 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.037494 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.037524 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.037550 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.037570 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.037594 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.037613 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.044764 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.044818 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0927 06:00:31.082283 28442 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0927 06:00:31.082327 28442 new_cluster.go:1373] Cloud Provider ID: "openstack" I0927 06:00:31.084602 28442 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.05s) === RUN TestCreateClusterOpenStackOctavia I0927 06:00:31.092156 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.092246 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.092275 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.092305 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.092335 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.092368 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.092395 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.092416 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.092440 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.092457 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.096039 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.096087 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0927 06:00:31.135278 28442 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0927 06:00:31.135322 28442 new_cluster.go:1373] Cloud Provider ID: "openstack" I0927 06:00:31.137462 28442 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0927 06:00:31.137486 28442 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.05s) === RUN TestCreateClusterOpenStackNoDNS I0927 06:00:31.145417 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.145505 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.145534 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.145569 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.145597 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.145633 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.145662 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.145681 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.145705 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.145723 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.149381 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.149443 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0927 06:00:31.194276 28442 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0927 06:00:31.194340 28442 new_cluster.go:1373] Cloud Provider ID: "openstack" I0927 06:00:31.194400 28442 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0927 06:00:31.194424 28442 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.06s) === RUN TestCreateClusterCilium I0927 06:00:31.210613 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.210750 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.210796 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.210854 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.210900 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.210957 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.211004 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.211034 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.211074 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.211102 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.215390 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.215447 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.269326 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:31.269506 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:31.269868 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.07s) === RUN TestCreateClusterOverride I0927 06:00:31.278492 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.278608 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.278647 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.278693 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.278731 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.278782 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.278824 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.278854 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.278896 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.278927 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.282854 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.282911 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.363993 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:31.364502 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:31.364837 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.09s) === RUN TestCreateClusterKubernetesFeatureGates I0927 06:00:31.371299 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.371384 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.371412 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.371442 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.371467 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.371496 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.371523 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.371541 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.371566 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.371583 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.375446 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.375504 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.398311 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:31.398505 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:31.398936 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.04s) === RUN TestCreateClusterComplex I0927 06:00:31.408481 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.408569 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.408596 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.408628 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.408653 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.408684 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.408709 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.408728 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.408752 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.408768 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.412609 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.412659 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.506529 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:31.506906 28442 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0927 06:00:31.506926 28442 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0927 06:00:31.506940 28442 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0927 06:00:31.507335 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.11s) === RUN TestCreateClusterComplexPrivate I0927 06:00:31.517146 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.517229 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.517255 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.517284 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.517308 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.517338 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.517363 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.517380 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.517405 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.517422 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.521505 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.521548 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.658174 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:31.658590 28442 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0927 06:00:31.658609 28442 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0927 06:00:31.658622 28442 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0927 06:00:31.658634 28442 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0927 06:00:31.658646 28442 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0927 06:00:31.658659 28442 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0927 06:00:31.658671 28442 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0927 06:00:31.658687 28442 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0927 06:00:31.658700 28442 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0927 06:00:31.658712 28442 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0927 06:00:31.659210 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.15s) === RUN TestCreateClusterHA I0927 06:00:31.670936 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.671026 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.671052 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.671084 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.671110 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.671154 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.671183 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.671200 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.671224 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.671240 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.701476 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.701542 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.751989 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:31.752338 28442 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0927 06:00:31.752358 28442 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0927 06:00:31.752372 28442 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0927 06:00:31.752768 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:31.761678 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.761752 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.761778 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.761811 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.761836 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.761870 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.761898 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.761916 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.761941 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.761959 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.766171 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.766217 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.797267 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:31.797619 28442 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0927 06:00:31.797642 28442 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0927 06:00:31.797659 28442 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0927 06:00:31.797938 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.14s) === RUN TestCreateClusterMinimalGCE I0927 06:00:31.809390 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.809483 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.809510 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.809542 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.809568 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.809598 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.809622 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.809640 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.809665 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.809683 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.813846 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.813893 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.846704 28442 new_cluster.go:1373] Cloud Provider ID: "gce" I0927 06:00:31.846821 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0927 06:00:31.852324 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.852397 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.852423 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.852454 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.852478 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.852507 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.852532 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.852552 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.852576 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.852594 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.857377 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.857428 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.903527 28442 new_cluster.go:1373] Cloud Provider ID: "gce" I0927 06:00:31.903622 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.10s) === RUN TestCreateClusterHAGCE I0927 06:00:31.909808 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:31.909905 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:31.909932 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:31.909964 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:31.909989 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:31.910021 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:31.910047 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:31.910065 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:31.910090 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:31.910107 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:31.913834 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.913891 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:31.989809 28442 new_cluster.go:1373] Cloud Provider ID: "gce" I0927 06:00:31.989951 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.09s) === RUN TestCreateClusterGCE I0927 06:00:32.002072 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.002164 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.002194 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.002226 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.002250 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.002282 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.002307 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.002327 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.002351 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.002368 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.006089 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.006142 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.127972 28442 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0927 06:00:32.128052 28442 new_cluster.go:1373] Cloud Provider ID: "gce" I0927 06:00:32.128131 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.13s) === RUN TestCreateClusterHASharedZone I0927 06:00:32.133749 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.133837 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.133865 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.133896 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.133921 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.133952 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.133981 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.134000 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.134025 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.134043 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.137588 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.137632 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0927 06:00:32.164227 28442 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0927 06:00:32.164273 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.164528 28442 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0927 06:00:32.164889 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.04s) === RUN TestCreateClusterHASharedZones I0927 06:00:32.172283 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.172370 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.172396 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.172427 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.172454 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.172485 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.172513 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.172531 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.172556 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.172574 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.176402 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.176489 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0927 06:00:32.203434 28442 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0927 06:00:32.203486 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.203883 28442 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0927 06:00:32.203902 28442 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0927 06:00:32.204307 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.05s) === RUN TestCreateClusterPrivate I0927 06:00:32.217481 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.217581 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.217610 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.217647 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.217673 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.217721 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.217752 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.217770 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.217806 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.217827 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.221570 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.221626 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.276298 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.276523 28442 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0927 06:00:32.276543 28442 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0927 06:00:32.276909 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:32.276940 28442 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.07s) === RUN TestCreateClusterPrivateGCE I0927 06:00:32.284914 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.285005 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.285031 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.285059 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.285085 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.285118 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.285148 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.285165 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.285190 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.285206 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.288962 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.289007 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.331912 28442 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0927 06:00:32.332031 28442 new_cluster.go:1373] Cloud Provider ID: "gce" I0927 06:00:32.332167 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.06s) === RUN TestCreateClusterWithNGWSpecified I0927 06:00:32.343278 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.343401 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.343437 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.343480 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.343516 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.343560 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.343602 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.343630 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.343665 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.343692 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.347550 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.347606 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.402546 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.402773 28442 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0927 06:00:32.402793 28442 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0927 06:00:32.403175 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:32.403208 28442 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.07s) === RUN TestCreateClusterWithINGWSpecified I0927 06:00:32.413381 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.413472 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.413501 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.413532 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.413557 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.413588 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.413614 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.413633 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.413658 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.413675 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.417584 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.417631 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.467694 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.467927 28442 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0927 06:00:32.467948 28442 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0927 06:00:32.468329 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:32.468362 28442 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.06s) === RUN TestCreateClusterSharedVPC I0927 06:00:32.475040 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.475121 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.475146 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.475177 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.475203 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.475235 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.475262 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.475279 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.475304 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.475322 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.479269 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.479308 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.513152 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.513316 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.513370 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.513407 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.513425 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.513468 28442 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0927 06:00:32.513794 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.04s) === RUN TestCreateClusterSharedSubnets I0927 06:00:32.519402 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.519487 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.519512 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.519540 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.519566 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.519599 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.519626 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.519646 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.519669 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.519687 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.523558 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.523611 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.582892 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.582941 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.583027 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.583170 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.583193 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.583216 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.583232 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.583587 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.07s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0927 06:00:32.589265 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.589355 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.589382 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.589413 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.589439 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.589472 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.589498 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.589516 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.589540 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.589558 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.593523 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.593563 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.644956 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:00:32.645078 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.645127 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.645414 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.645806 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.645844 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.646629 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.646673 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.647068 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.06s) === RUN TestCreateClusterPrivateSharedSubnets I0927 06:00:32.652825 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.652914 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.652941 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.652969 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.652994 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.653027 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.653057 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.653073 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.653097 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.653115 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.657520 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.657561 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.687808 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.687855 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.687910 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.687929 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.688000 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.688143 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.688164 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.688185 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:00:32.688199 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:00:32.688592 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.04s) === RUN TestCreateClusterIPv6 I0927 06:00:32.694592 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.694673 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.694698 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.694727 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.694753 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.694785 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.694813 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.694832 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.694859 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.694877 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.698832 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.698889 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.752116 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.752303 28442 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0927 06:00:32.752322 28442 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0927 06:00:32.752856 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.06s) === RUN TestCreateClusterDifferentAMIs I0927 06:00:32.759120 28442 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0927 06:00:32.759148 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.759232 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.759258 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.759287 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.759312 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.759343 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.759367 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.759385 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.759407 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.759424 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.763344 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.763402 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.815268 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.815363 28442 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0927 06:00:32.815382 28442 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0927 06:00:32.815730 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:32.822621 28442 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.06s) === RUN TestCreateClusterKarpenter I0927 06:00:32.822715 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.822797 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.822820 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.822848 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.822872 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.822902 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.822926 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.822942 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.822964 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.822985 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.826509 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.826548 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0927 06:00:32.875436 28442 new_cluster.go:1373] Cloud Provider ID: "aws" I0927 06:00:32.875620 28442 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0927 06:00:32.875639 28442 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0927 06:00:32.875653 28442 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0927 06:00:32.876027 28442 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.06s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0927 06:00:32.882239 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.882308 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.882334 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.882392 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.882418 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.882448 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.882475 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.882493 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.882519 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.882539 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.887829 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I0927 06:00:32.888982 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:32.889048 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:32.889068 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:32.889089 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:32.889112 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:32.889138 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:32.889197 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:32.889215 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:32.889236 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:32.889249 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:32.903125 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0927 06:00:32.904965 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:32.905023 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0927 06:00:36.887898 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:39.165645 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:00:39.166871 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:00:39.166909 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:00:39.167097 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:00:39.173312 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:00:39.178394 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:00:39.180069 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:39.180273 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:39.180765 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:39.181167 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:39.181292 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:00:39.181882 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:00:39.182660 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:00:39.185753 28442 target.go:111] Terraform output is in /tmp/test580163334/out --- PASS: TestMinimal (6.30s) === RUN TestMinimal_v1_23 I0927 06:00:39.188633 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:39.188744 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:39.188777 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:39.188814 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:39.188839 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:39.188870 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:39.188924 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:39.188946 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:39.188974 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:39.188991 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:39.206168 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0927 06:00:39.208662 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:39.208725 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:40.320589 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:40.461628 28442 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0927 06:00:40.462408 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:00:40.462437 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:00:40.462520 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:00:40.464221 28442 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0927 06:00:40.469244 28442 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0927 06:00:40.469580 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:40.469778 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:40.470079 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:40.470133 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:40.470180 28442 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0927 06:00:40.470352 28442 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0927 06:00:40.470583 28442 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0927 06:00:40.475952 28442 target.go:111] Terraform output is in /tmp/test2729991770/out --- PASS: TestMinimal_v1_23 (1.29s) === RUN TestMinimal_v1_24 I0927 06:00:40.479348 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:40.479456 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:40.479489 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:40.479520 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:40.479546 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:40.479577 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:40.479633 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:40.479652 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:40.479676 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:40.479700 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:40.501228 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:00:40.503231 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:40.503295 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:41.255106 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:41.389104 28442 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0927 06:00:41.392155 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:00:41.392175 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:00:41.392233 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:00:41.393396 28442 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0927 06:00:41.400214 28442 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0927 06:00:41.400494 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:41.401084 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:41.401232 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:41.401548 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:41.401675 28442 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0927 06:00:41.401848 28442 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0927 06:00:41.402059 28442 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0927 06:00:41.407293 28442 target.go:111] Terraform output is in /tmp/test2548734537/out --- PASS: TestMinimal_v1_24 (0.93s) === RUN TestMinimal_v1_25 I0927 06:00:41.411297 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:41.411424 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:41.411466 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:41.411513 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:41.411555 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:41.411601 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:41.411680 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:41.411708 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:41.411743 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:41.411771 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:41.437368 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0927 06:00:41.440482 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:41.440568 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:42.575798 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:42.729836 28442 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0927 06:00:42.730136 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:00:42.730163 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:00:42.730252 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:00:42.733319 28442 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0927 06:00:42.736462 28442 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0927 06:00:42.736766 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:42.736966 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:42.737213 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:42.737256 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:42.737316 28442 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0927 06:00:42.737476 28442 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0927 06:00:42.737644 28442 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0927 06:00:42.740702 28442 target.go:111] Terraform output is in /tmp/test2799234499/out --- PASS: TestMinimal_v1_25 (1.33s) === RUN TestMinimal_v1_26 I0927 06:00:42.743302 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:42.743384 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:42.743412 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:42.743441 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:42.743470 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:42.743506 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:42.743560 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:42.743578 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:42.743601 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:42.743618 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:42.760089 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0927 06:00:42.762092 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:42.762160 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:44.237457 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:44.386825 28442 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0927 06:00:44.388369 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:00:44.388397 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:00:44.388478 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:00:44.390246 28442 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0927 06:00:44.393507 28442 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0927 06:00:44.393789 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:44.393971 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:44.394245 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:44.394401 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:44.394496 28442 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0927 06:00:44.394728 28442 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0927 06:00:44.394929 28442 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0927 06:00:44.398149 28442 target.go:111] Terraform output is in /tmp/test710321885/out --- PASS: TestMinimal_v1_26 (1.66s) === RUN TestMinimal_v1_27 I0927 06:00:44.404960 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:44.405101 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:44.405143 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:44.405197 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:44.405239 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:44.405292 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:44.405360 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:44.405392 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:44.405737 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:44.405765 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:44.424953 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0927 06:00:44.427500 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:44.427572 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:46.401341 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:46.544401 28442 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0927 06:00:46.545122 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:00:46.545163 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:00:46.545258 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:00:46.547931 28442 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0927 06:00:46.554314 28442 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0927 06:00:46.554679 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:46.555120 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:46.556204 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:46.557138 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:46.557209 28442 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0927 06:00:46.557472 28442 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0927 06:00:46.557690 28442 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0927 06:00:46.561056 28442 target.go:111] Terraform output is in /tmp/test3274944370/out --- PASS: TestMinimal_v1_27 (2.16s) === RUN TestMinimal_NoneDNS I0927 06:00:46.563694 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:46.563789 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:46.563822 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:46.563860 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:46.563887 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:46.563921 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:46.563980 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:46.564001 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:46.564026 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:46.564045 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0927 06:00:46.581931 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:46.582001 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:47.505576 28442 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0927 06:00:47.507935 28442 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0927 06:00:47.509809 28442 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0927 06:00:47.512809 28442 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0927 06:00:47.512865 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:00:47.512941 28442 loadbalancers.go:35] PageSize not implemented I0927 06:00:47.513017 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:00:47.513135 28442 loadbalancers.go:35] PageSize not implemented I0927 06:00:47.517315 28442 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0927 06:00:47.517436 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:47.517584 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:47.517847 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:47.517903 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:47.517948 28442 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0927 06:00:47.518121 28442 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0927 06:00:47.518349 28442 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0927 06:00:47.521585 28442 target.go:111] Terraform output is in /tmp/test3556510508/out --- PASS: TestMinimal_NoneDNS (0.96s) === RUN TestHetzner I0927 06:00:47.524349 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:00:48.547624 28442 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0927 06:00:48.549909 28442 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0927 06:00:48.550249 28442 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0927 06:00:48.554749 28442 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0927 06:00:48.555260 28442 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0927 06:00:48.556545 28442 target.go:111] Terraform output is in /tmp/test2612517568/out --- PASS: TestHetzner (1.03s) === RUN TestNvidia I0927 06:00:48.558155 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:48.558235 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:48.558261 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:48.558290 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:48.558314 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:48.558345 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:48.558395 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:48.558412 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:48.558435 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:48.558451 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:48.572606 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:00:48.574428 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:48.574501 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:49.512257 28442 zones.go:93] ListHostedZonesPages { } I0927 06:00:49.655363 28442 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0927 06:00:49.657733 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:00:49.657763 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:00:49.657840 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:00:49.662135 28442 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0927 06:00:49.666006 28442 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0927 06:00:49.666209 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:49.666325 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:49.666500 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:49.666765 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:49.666833 28442 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0927 06:00:49.666984 28442 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0927 06:00:49.667176 28442 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0927 06:00:49.669627 28442 target.go:111] Terraform output is in /tmp/test1407524201/out --- PASS: TestNvidia (1.11s) === RUN TestMinimalGossip I0927 06:00:49.671707 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:49.671772 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:49.671796 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:49.671821 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:49.671841 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:49.671868 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:49.671912 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:49.671926 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:49.671947 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:49.671960 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:00:49.685601 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:49.685745 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:50.571395 28442 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0927 06:00:50.573557 28442 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0927 06:00:50.578052 28442 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0927 06:00:50.578238 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:50.578493 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:50.578608 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:50.578848 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:50.578917 28442 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0927 06:00:50.579138 28442 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0927 06:00:50.579360 28442 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0927 06:00:50.582677 28442 target.go:111] Terraform output is in /tmp/test409087721/out --- PASS: TestMinimalGossip (0.91s) === RUN TestMinimalGossipIRSA I0927 06:00:50.585461 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:50.585539 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:50.585566 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:50.585594 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:50.585619 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:50.585651 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:50.585702 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:50.585719 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:50.585744 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:50.585762 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:00:50.602268 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:50.602329 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:51.500716 28442 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0927 06:00:51.503416 28442 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0927 06:00:51.507502 28442 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0927 06:00:51.507832 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:51.508068 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:51.508320 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:51.508411 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:00:51.508495 28442 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0927 06:00:51.508722 28442 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0927 06:00:51.509000 28442 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0927 06:00:51.514799 28442 target.go:111] Terraform output is in /tmp/test4220722468/out --- PASS: TestMinimalGossipIRSA (0.93s) === RUN TestMinimalGCE I0927 06:00:51.519546 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:51.521397 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:00:52.655373 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:00:52.655436 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:00:52.655523 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0927 06:00:52.655876 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0927 06:00:52.655894 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0927 06:00:52.655936 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0927 06:00:52.656804 28442 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0927 06:00:52.658997 28442 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0927 06:00:52.662277 28442 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0927 06:00:52.663029 28442 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0927 06:00:52.663265 28442 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0927 06:00:52.665122 28442 target.go:111] Terraform output is in /tmp/test336353836/out --- PASS: TestMinimalGCE (1.15s) === RUN TestMinimalGCEPrivate I0927 06:00:52.668373 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:52.669388 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:00:53.833904 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:00:53.833982 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:00:53.834079 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0927 06:00:53.834101 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0927 06:00:53.834118 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0927 06:00:53.834160 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0927 06:00:53.835117 28442 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0927 06:00:53.837701 28442 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0927 06:00:53.841057 28442 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0927 06:00:53.841664 28442 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0927 06:00:53.841784 28442 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0927 06:00:53.843763 28442 target.go:111] Terraform output is in /tmp/test2684645123/out --- PASS: TestMinimalGCEPrivate (1.18s) === RUN TestMinimalGCEInternalLoadBalancer I0927 06:00:53.845719 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:53.846812 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:00:54.995297 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:00:54.995364 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:00:54.995445 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0927 06:00:54.995468 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0927 06:00:54.995484 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0927 06:00:54.995523 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0927 06:00:54.995551 28442 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0927 06:00:54.996579 28442 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0927 06:00:55.005742 28442 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0927 06:00:55.006256 28442 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0927 06:00:55.006577 28442 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0927 06:00:55.012278 28442 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0927 06:00:55.013194 28442 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0927 06:00:55.013450 28442 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0927 06:00:55.013751 28442 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0927 06:00:55.014036 28442 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0927 06:00:55.017547 28442 target.go:111] Terraform output is in /tmp/test2087153979/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.18s) === RUN TestMinimalGCEPublicLoadBalancer I0927 06:00:55.020858 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:55.022695 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:00:56.177415 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:00:56.177480 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:00:56.177567 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0927 06:00:56.177589 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0927 06:00:56.177605 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0927 06:00:56.177646 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0927 06:00:56.178693 28442 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0927 06:00:56.182556 28442 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0927 06:00:56.189721 28442 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0927 06:00:56.190506 28442 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0927 06:00:56.190757 28442 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0927 06:00:56.194073 28442 target.go:111] Terraform output is in /tmp/test901261565/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.18s) === RUN TestMinimalGCELongClusterName I0927 06:00:56.197702 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:56.199527 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:00:57.370592 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:00:57.370719 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:00:57.370879 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0927 06:00:57.370917 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0927 06:00:57.370946 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0927 06:00:57.371024 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0927 06:00:57.372507 28442 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0927 06:00:57.375516 28442 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0927 06:00:57.382396 28442 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0927 06:00:57.383399 28442 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0927 06:00:57.383592 28442 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0927 06:00:57.386839 28442 target.go:111] Terraform output is in /tmp/test837266727/out --- PASS: TestMinimalGCELongClusterName (1.19s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0927 06:00:57.390189 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:57.392001 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:00:58.538606 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:00:58.538670 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:00:58.538782 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0927 06:00:58.538805 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0927 06:00:58.538821 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0927 06:00:58.538861 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0927 06:00:58.538896 28442 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0927 06:00:58.539851 28442 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0927 06:00:58.543131 28442 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0927 06:00:58.544323 28442 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0927 06:00:58.544721 28442 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0927 06:00:58.549297 28442 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0927 06:00:58.549976 28442 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0927 06:00:58.550112 28442 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0927 06:00:58.550227 28442 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0927 06:00:58.550323 28442 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0927 06:00:58.553301 28442 target.go:111] Terraform output is in /tmp/test1310494964/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.17s) === RUN TestMinimalGCEDNSNone I0927 06:00:58.556311 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:58.558114 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:00:59.678938 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:00:59.679018 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:00:59.679097 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0927 06:00:59.679118 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0927 06:00:59.679133 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0927 06:00:59.679172 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0927 06:00:59.679201 28442 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0927 06:00:59.680197 28442 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0927 06:00:59.685499 28442 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0927 06:00:59.686031 28442 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0927 06:00:59.686181 28442 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0927 06:00:59.689507 28442 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0927 06:00:59.690114 28442 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0927 06:00:59.690230 28442 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0927 06:00:59.690329 28442 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0927 06:00:59.690493 28442 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0927 06:00:59.692604 28442 target.go:111] Terraform output is in /tmp/test4122654875/out --- PASS: TestMinimalGCEDNSNone (1.14s) === RUN TestMinimalScaleway I0927 06:00:59.694428 28442 featureflag.go:164] FeatureFlag "Scaleway"=true I0927 06:00:59.694446 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:00.625969 28442 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0927 06:01:00.628229 28442 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0927 06:01:00.631454 28442 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0927 06:01:00.632155 28442 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0927 06:01:00.633458 28442 target.go:111] Terraform output is in /tmp/test1399286229/out I0927 06:01:00.635373 28442 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (0.94s) === RUN TestHA I0927 06:01:00.635457 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:00.635537 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:00.635565 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:00.635595 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:00.635619 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:00.635651 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:00.635704 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:00.635721 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:00.635745 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:00.635765 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:00.668766 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:00.672087 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:00.672174 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:00.672230 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:00.672284 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:01.430310 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:01.609076 28442 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0927 06:01:01.609855 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:01.609887 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:01.609958 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:01.611529 28442 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0927 06:01:01.619830 28442 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0927 06:01:01.620021 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:01.620261 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:01.620447 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:01.620520 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:01.620663 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:01.620714 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:01.620764 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:01.620805 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:01.620869 28442 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0927 06:01:01.621060 28442 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0927 06:01:01.621291 28442 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0927 06:01:01.627595 28442 target.go:111] Terraform output is in /tmp/test1417560357/out --- PASS: TestHA (1.00s) === RUN TestHighAvailabilityGCE I0927 06:01:01.632159 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:01.634001 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:01:03.245619 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:01:03.245755 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:01:03.245881 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0927 06:01:03.245917 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0927 06:01:03.245943 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0927 06:01:03.246007 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0927 06:01:03.246092 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0927 06:01:03.246164 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0927 06:01:03.248117 28442 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0927 06:01:03.251881 28442 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0927 06:01:03.257676 28442 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0927 06:01:03.258520 28442 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0927 06:01:03.258827 28442 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0927 06:01:03.263067 28442 target.go:111] Terraform output is in /tmp/test2247056241/out --- PASS: TestHighAvailabilityGCE (1.64s) === RUN TestComplex I0927 06:01:03.267474 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:03.267606 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:03.267649 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:03.267745 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:03.267805 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:03.267860 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:03.267901 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:03.267931 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:03.267972 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:03.268002 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:03.305898 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:01:03.310094 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:03.310194 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:04.072305 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:04.243814 28442 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0927 06:01:04.247319 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:04.247363 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:04.247502 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:04.249822 28442 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0927 06:01:04.251765 28442 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0927 06:01:04.252227 28442 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0927 06:01:04.252413 28442 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0927 06:01:04.252451 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:04.252515 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:04.252625 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:04.252672 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:04.256078 28442 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0927 06:01:04.256228 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:04.256460 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:04.256688 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:04.256928 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:04.256991 28442 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0927 06:01:04.257220 28442 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0927 06:01:04.257490 28442 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0927 06:01:04.261347 28442 target.go:111] Terraform output is in /tmp/test230983742/out I0927 06:01:04.263891 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:04.263960 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:04.263986 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:04.264017 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:04.264042 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:04.264077 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:04.264103 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:04.264122 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:04.264149 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:04.264169 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:04.286680 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:01:04.289195 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:04.289263 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:05.419520 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:05.557698 28442 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0927 06:01:05.558022 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:05.558052 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:05.558123 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:05.560676 28442 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0927 06:01:05.563975 28442 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0927 06:01:05.564780 28442 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0927 06:01:05.564968 28442 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0927 06:01:05.565043 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:05.565136 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:05.565255 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:05.565328 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:05.570955 28442 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0927 06:01:05.571143 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:05.571338 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:05.571692 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:05.572636 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:05.572886 28442 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0927 06:01:05.573605 28442 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0927 06:01:05.574169 28442 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0927 06:01:05.583184 28442 target.go:111] Terraform output is in /tmp/test4293176898/out --- PASS: TestComplex (2.32s) === RUN TestCompress I0927 06:01:05.587629 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:05.587761 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:05.587822 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:05.587879 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:05.587923 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:05.587976 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:05.588062 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:05.588093 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:05.588131 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:05.588161 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:05.612316 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:05.615554 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:05.615646 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:06.384751 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:06.566182 28442 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0927 06:01:06.566995 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:06.567030 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:06.567137 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:06.569471 28442 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0927 06:01:06.574300 28442 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0927 06:01:06.582416 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:06.583181 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:06.586083 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:06.586615 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:06.586741 28442 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0927 06:01:06.587030 28442 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0927 06:01:06.587281 28442 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0927 06:01:06.592152 28442 target.go:111] Terraform output is in /tmp/test169836318/out --- PASS: TestCompress (1.01s) === RUN TestExternalPolicies I0927 06:01:06.596229 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.596361 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:06.596407 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:06.596499 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:06.596544 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:06.596598 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:06.596645 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:06.596677 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:06.596728 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:06.596760 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:06.625143 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:06.628557 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:06.628638 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:07.386540 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:07.521404 28442 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0927 06:01:07.526343 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:07.526391 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:07.526476 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:07.536514 28442 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0927 06:01:07.540965 28442 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0927 06:01:07.542399 28442 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0927 06:01:07.542562 28442 api.go:53] PageSize not implemented W0927 06:01:07.543355 28442 api.go:53] PageSize not implemented I0927 06:01:07.547892 28442 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0927 06:01:07.548096 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:07.548312 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:07.548633 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:07.548836 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:07.548947 28442 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0927 06:01:07.549210 28442 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0927 06:01:07.549455 28442 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0927 06:01:07.555579 28442 target.go:111] Terraform output is in /tmp/test3525674855/out --- PASS: TestExternalPolicies (0.96s) === RUN TestMinimalIPv6 I0927 06:01:07.560069 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:07.560204 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:07.560251 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:07.560302 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:07.560351 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:07.560417 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:07.560505 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:07.560542 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:07.560588 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:07.560618 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:07.589041 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:07.591251 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:07.591310 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:08.350206 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:08.483410 28442 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0927 06:01:08.488646 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:08.488684 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:08.488767 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:08.490857 28442 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0927 06:01:08.492797 28442 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0927 06:01:08.493306 28442 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0927 06:01:08.493573 28442 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0927 06:01:08.493674 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:08.493748 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:08.493843 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:08.493896 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:08.497217 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:01:08.497322 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:08.497492 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:08.497625 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:08.498095 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:08.498178 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:01:08.498395 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:01:08.498614 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:01:08.505330 28442 target.go:111] Terraform output is in /tmp/test3629004871/out --- PASS: TestMinimalIPv6 (0.95s) === RUN TestMinimalIPv6Calico I0927 06:01:08.509760 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:08.509884 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:08.509927 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:08.509977 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:08.510018 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:08.510065 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:08.510145 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:08.510177 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:08.510217 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:08.510245 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:08.539926 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:08.542140 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:08.542204 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:09.302535 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:09.713130 28442 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0927 06:01:09.713875 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:09.713908 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:09.713999 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:09.718849 28442 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0927 06:01:09.720868 28442 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0927 06:01:09.721355 28442 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0927 06:01:09.721630 28442 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0927 06:01:09.721672 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:09.721718 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:09.721796 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:09.721862 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:09.727810 28442 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0927 06:01:09.727969 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:09.728135 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:09.728278 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:09.728823 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:09.728921 28442 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0927 06:01:09.729181 28442 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0927 06:01:09.729420 28442 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0927 06:01:09.733515 28442 target.go:111] Terraform output is in /tmp/test4262577396/out --- PASS: TestMinimalIPv6Calico (1.23s) === RUN TestMinimalIPv6Cilium I0927 06:01:09.736674 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:09.736747 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:09.736773 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:09.736801 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:09.736825 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:09.736866 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:09.736914 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:09.736931 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:09.736957 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:09.736975 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:09.756660 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:09.758966 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:09.759036 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:10.525976 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:10.679902 28442 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0927 06:01:10.680439 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:10.680460 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:10.680536 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:10.684287 28442 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0927 06:01:10.686751 28442 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0927 06:01:10.687253 28442 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0927 06:01:10.687517 28442 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0927 06:01:10.687589 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:10.687637 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:10.687721 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:10.687769 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:10.690770 28442 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0927 06:01:10.690904 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:10.691111 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:10.691541 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:10.691610 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:10.691670 28442 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0927 06:01:10.691895 28442 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0927 06:01:10.692130 28442 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0927 06:01:10.696522 28442 target.go:111] Terraform output is in /tmp/test3823258761/out --- PASS: TestMinimalIPv6Cilium (0.96s) === RUN TestMinimalIPv6NoSubnetPrefix I0927 06:01:10.699244 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:10.699322 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:10.699347 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:10.699376 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:10.699400 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:10.699435 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:10.699483 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:10.699507 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:10.699531 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:10.699548 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:10.716386 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:10.718724 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:10.718783 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:11.660287 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:11.830710 28442 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0927 06:01:11.833406 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:11.833442 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:11.833569 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:11.837069 28442 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0927 06:01:11.840162 28442 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0927 06:01:11.840995 28442 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0927 06:01:11.841394 28442 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0927 06:01:11.841531 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:11.841625 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:11.841708 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:11.841779 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:11.846430 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:01:11.846585 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:11.846756 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:11.847126 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:11.847229 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:11.847327 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:01:11.847646 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:01:11.847942 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:01:11.853050 28442 target.go:111] Terraform output is in /tmp/test2041431251/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.16s) === RUN TestMinimalWarmPool I0927 06:01:11.856393 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:11.856488 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:11.856518 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:11.856554 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:11.856584 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:11.856623 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:11.856683 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:11.856705 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:11.856738 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:11.856779 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:11.882191 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:11.885392 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:11.885468 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:12.823076 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:12.962387 28442 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0927 06:01:12.962951 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:12.962985 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:12.963070 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:12.964124 28442 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0927 06:01:12.967569 28442 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0927 06:01:12.967891 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:12.968057 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:12.968221 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:12.968416 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:12.968479 28442 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0927 06:01:12.968684 28442 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0927 06:01:12.968920 28442 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0927 06:01:12.974466 28442 target.go:111] Terraform output is in /tmp/test4107362182/out --- PASS: TestMinimalWarmPool (1.12s) === RUN TestMinimalEtcd I0927 06:01:12.976535 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:12.976599 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:12.976622 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:12.976648 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:12.976669 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:12.976695 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:12.976735 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:12.976749 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:12.976767 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:12.976780 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:12.988626 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:12.990082 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:12.990129 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:13.756625 28442 zones.go:93] ListHostedZonesPages { } W0927 06:01:13.949032 28442 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0927 06:01:13.949093 28442 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0927 06:01:13.951735 28442 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0927 06:01:13.964931 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:01:13.966083 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:13.966126 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:13.966211 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:13.967674 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:01:13.971903 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:01:13.972247 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:13.973142 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:13.975898 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:13.976267 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:13.976398 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:01:13.976724 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:01:13.977158 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:01:13.981264 28442 target.go:111] Terraform output is in /tmp/test1536707872/out --- PASS: TestMinimalEtcd (1.01s) === RUN TestMinimalGp3 I0927 06:01:13.984046 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:13.984146 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:13.984180 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:13.984215 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:13.984241 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:13.984271 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:13.984361 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:13.984388 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:13.984429 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:13.984469 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:14.002843 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:14.004928 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:14.005001 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:14.758847 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:14.893530 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:01:14.899861 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:14.899895 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:14.899970 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:14.901095 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:01:14.904695 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:01:14.904936 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:14.905162 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:14.905463 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:14.905539 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:14.905636 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:01:14.905859 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:01:14.906448 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:01:14.913810 28442 target.go:111] Terraform output is in /tmp/test1747361359/out --- PASS: TestMinimalGp3 (0.93s) === RUN TestMinimalLongClusterName I0927 06:01:14.916417 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:14.916508 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:14.916540 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:14.916574 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:14.916601 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:14.916633 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:14.916686 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:14.916705 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:14.916730 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:14.916748 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:14.931422 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:14.933299 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:14.933362 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0927 06:01:15.690123 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:15.883611 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:01:15.884303 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:15.884349 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:15.884438 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:15.885912 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:01:15.891495 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:01:15.891921 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:15.893896 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:15.893998 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:15.894803 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:15.894939 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:01:15.895421 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:01:15.896514 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:01:15.899926 28442 target.go:111] Terraform output is in /tmp/test3621066486/out --- PASS: TestMinimalLongClusterName (0.99s) === RUN TestExistingSG I0927 06:01:15.902591 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:15.902687 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:15.902722 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:15.902760 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:15.902789 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:15.902825 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:15.902882 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:15.902900 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:15.902925 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:15.902945 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:15.933150 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:15.936692 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:15.936778 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:15.936835 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:15.936888 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.696029 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:16.852078 28442 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0927 06:01:16.855364 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:16.855404 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:16.855507 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:16.858037 28442 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0927 06:01:16.859894 28442 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0927 06:01:16.860451 28442 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0927 06:01:16.860496 28442 api.go:53] PageSize not implemented W0927 06:01:16.860521 28442 api.go:53] PageSize not implemented W0927 06:01:16.860594 28442 api.go:53] PageSize not implemented W0927 06:01:16.860710 28442 api.go:53] PageSize not implemented I0927 06:01:16.866017 28442 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0927 06:01:16.866248 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.866355 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.866545 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.866693 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.866831 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.866885 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.866955 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.867005 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.867106 28442 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0927 06:01:16.867352 28442 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0927 06:01:16.867705 28442 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0927 06:01:16.874792 28442 target.go:111] Terraform output is in /tmp/test1407755302/out --- PASS: TestExistingSG (0.98s) === RUN TestBastionAdditionalUserData I0927 06:01:16.879711 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:16.879863 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:16.879923 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:16.879980 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:16.880035 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:16.880092 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:16.880183 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:16.880217 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:16.880266 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:16.881586 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:16.904258 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:16.907675 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.907759 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:16.907834 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:17.671696 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:17.804934 28442 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0927 06:01:17.805977 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:17.806010 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:17.806096 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:17.807258 28442 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0927 06:01:17.810122 28442 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0927 06:01:17.811195 28442 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0927 06:01:17.811280 28442 api.go:53] PageSize not implemented W0927 06:01:17.811386 28442 api.go:53] PageSize not implemented W0927 06:01:17.811503 28442 api.go:53] PageSize not implemented I0927 06:01:17.817873 28442 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0927 06:01:17.818083 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:17.818191 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:17.819010 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:17.819656 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:17.819779 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:17.819870 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:17.819996 28442 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0927 06:01:17.820594 28442 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0927 06:01:17.821317 28442 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0927 06:01:17.827974 28442 target.go:111] Terraform output is in /tmp/test701138739/out --- PASS: TestBastionAdditionalUserData (0.95s) === RUN TestPrivateFlannel I0927 06:01:17.830905 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:17.830994 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:17.831026 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:17.831088 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:17.831117 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:17.831170 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:17.831200 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:17.831219 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:17.831243 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:17.831261 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:17.848888 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:17.850953 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:17.851013 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:17.851050 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:18.606790 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:18.760631 28442 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0927 06:01:18.761629 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:18.761650 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:18.761713 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:18.762929 28442 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0927 06:01:18.764855 28442 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0927 06:01:18.765307 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:18.765407 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:18.765472 28442 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0927 06:01:18.765517 28442 api.go:53] PageSize not implemented W0927 06:01:18.765653 28442 api.go:53] PageSize not implemented I0927 06:01:18.771601 28442 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0927 06:01:18.771896 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:18.772089 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:18.772493 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:18.772545 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:18.772628 28442 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0927 06:01:18.772870 28442 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0927 06:01:18.773092 28442 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0927 06:01:18.780098 28442 target.go:111] Terraform output is in /tmp/test526401115/out --- PASS: TestPrivateFlannel (0.95s) === RUN TestPrivateCalico I0927 06:01:18.784970 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:18.785063 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:18.785096 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:18.785128 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:18.785158 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:18.785194 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:18.785250 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:18.785267 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:18.785291 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:18.785308 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:18.801971 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:18.804052 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:18.804106 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:18.804143 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:19.760342 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:20.122797 28442 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0927 06:01:20.123598 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:20.123628 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:20.123698 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:20.125301 28442 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0927 06:01:20.127325 28442 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0927 06:01:20.127707 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:20.127835 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:20.128008 28442 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0927 06:01:20.128214 28442 api.go:53] PageSize not implemented W0927 06:01:20.128322 28442 api.go:53] PageSize not implemented I0927 06:01:20.131725 28442 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0927 06:01:20.131937 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:20.132155 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:20.132589 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:20.132676 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:20.132756 28442 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0927 06:01:20.133051 28442 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0927 06:01:20.133407 28442 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0927 06:01:20.139521 28442 target.go:111] Terraform output is in /tmp/test1036887013/out --- PASS: TestPrivateCalico (1.36s) === RUN TestPrivateCilium I0927 06:01:20.143979 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:20.144074 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:20.144107 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:20.144146 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:20.144180 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:20.144220 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:20.144287 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:20.144315 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:20.144347 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:20.144369 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:20.174939 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:20.178784 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:20.178883 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:20.178948 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:20.929370 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:21.080789 28442 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0927 06:01:21.081505 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:21.081530 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:21.081609 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:21.082854 28442 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0927 06:01:21.084786 28442 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0927 06:01:21.085111 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:21.085252 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:21.085332 28442 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0927 06:01:21.085412 28442 api.go:53] PageSize not implemented W0927 06:01:21.085447 28442 api.go:53] PageSize not implemented I0927 06:01:21.088616 28442 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0927 06:01:21.088777 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:21.088948 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:21.089156 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:21.089350 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:21.089414 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:01:21.089635 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:01:21.089875 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:01:21.095600 28442 target.go:111] Terraform output is in /tmp/test820215892/out --- PASS: TestPrivateCilium (0.96s) === RUN TestPrivateCilium2 I0927 06:01:21.099637 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:21.099768 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:21.099807 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:21.099856 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:21.099897 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:21.099942 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:21.100018 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:21.100047 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:21.100085 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:21.100110 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:21.123974 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:01:21.126108 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:21.126164 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:21.126198 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:21.881641 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:22.465122 28442 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0927 06:01:22.465518 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:22.465551 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:22.465637 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:22.473200 28442 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0927 06:01:22.475171 28442 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0927 06:01:22.475701 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:22.475830 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:22.475893 28442 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0927 06:01:22.476045 28442 api.go:53] PageSize not implemented W0927 06:01:22.476155 28442 api.go:53] PageSize not implemented I0927 06:01:22.479295 28442 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0927 06:01:22.479439 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:22.479556 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:22.479757 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:22.480437 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:22.480565 28442 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0927 06:01:22.480827 28442 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0927 06:01:22.481150 28442 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0927 06:01:22.488908 28442 target.go:111] Terraform output is in /tmp/test4254264108/out --- PASS: TestPrivateCilium2 (1.40s) === RUN TestPrivateCiliumAdvanced I0927 06:01:22.499785 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:22.499933 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:22.499976 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:22.500034 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:22.500078 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:22.500128 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:22.500210 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:22.500235 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:22.500272 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:22.500299 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:22.519895 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:22.522121 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:22.522177 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:22.522210 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:23.301319 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:23.509890 28442 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0927 06:01:23.512757 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:23.512788 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:23.512892 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:23.515745 28442 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0927 06:01:23.518572 28442 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0927 06:01:23.518994 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:23.519178 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:23.519318 28442 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0927 06:01:23.519429 28442 api.go:53] PageSize not implemented W0927 06:01:23.519635 28442 api.go:53] PageSize not implemented I0927 06:01:23.526209 28442 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0927 06:01:23.526415 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:23.526611 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:23.527035 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:23.527185 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:23.527268 28442 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0927 06:01:23.527545 28442 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0927 06:01:23.527905 28442 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0927 06:01:23.535606 28442 target.go:111] Terraform output is in /tmp/test1854215478/out --- PASS: TestPrivateCiliumAdvanced (1.04s) === RUN TestPrivateCiliumENI I0927 06:01:23.540157 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:23.540278 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:23.540322 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:23.540368 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:23.540405 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:23.540449 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:23.540534 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:23.540562 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:23.540602 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:23.540627 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:23.573614 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:23.577809 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:23.577929 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:23.577994 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:24.551330 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:24.745806 28442 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0927 06:01:24.746721 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:24.746770 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:24.746899 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:24.748506 28442 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0927 06:01:24.750525 28442 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0927 06:01:24.750879 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:24.750982 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:24.751232 28442 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0927 06:01:24.751453 28442 api.go:53] PageSize not implemented W0927 06:01:24.751586 28442 api.go:53] PageSize not implemented I0927 06:01:24.757277 28442 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0927 06:01:24.757521 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:24.757703 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:24.757959 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:24.758429 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:24.758544 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:01:24.758828 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:01:24.759156 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:01:24.765732 28442 target.go:111] Terraform output is in /tmp/test374166493/out --- PASS: TestPrivateCiliumENI (1.23s) === RUN TestPrivateCanal I0927 06:01:24.770073 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:24.770174 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:24.770210 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:24.770253 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:24.770295 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:24.770347 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:24.770421 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:24.770453 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:24.770491 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:24.770520 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:24.799707 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:24.803057 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:24.803168 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:24.803230 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:25.587879 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:26.027586 28442 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0927 06:01:26.029236 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:26.029294 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:26.029398 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:26.035993 28442 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0927 06:01:26.038869 28442 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0927 06:01:26.039487 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:26.039694 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:26.039805 28442 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0927 06:01:26.039873 28442 api.go:53] PageSize not implemented W0927 06:01:26.039945 28442 api.go:53] PageSize not implemented I0927 06:01:26.046683 28442 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0927 06:01:26.046904 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:26.047139 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:26.047611 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:26.047968 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:26.048086 28442 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0927 06:01:26.048390 28442 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0927 06:01:26.048707 28442 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0927 06:01:26.055902 28442 target.go:111] Terraform output is in /tmp/test2137318378/out --- PASS: TestPrivateCanal (1.29s) === RUN TestPrivateKopeio I0927 06:01:26.061585 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:26.061717 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:26.061763 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:26.061820 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:26.061865 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:26.061916 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:26.062003 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:26.062042 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:26.062082 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:26.062112 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:26.096760 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:26.100362 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:26.100463 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:26.100521 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:26.909235 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:27.116684 28442 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0927 06:01:27.118560 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:27.118602 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:27.118744 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:27.122506 28442 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0927 06:01:27.125707 28442 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0927 06:01:27.126178 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:27.126382 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:27.126848 28442 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0927 06:01:27.126989 28442 api.go:53] PageSize not implemented W0927 06:01:27.127057 28442 api.go:53] PageSize not implemented I0927 06:01:27.132627 28442 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0927 06:01:27.132986 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:27.133270 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:27.133678 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:27.133858 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:27.133989 28442 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0927 06:01:27.134308 28442 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0927 06:01:27.134698 28442 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0927 06:01:27.146755 28442 target.go:111] Terraform output is in /tmp/test474558360/out --- PASS: TestPrivateKopeio (1.09s) === RUN TestUnmanaged I0927 06:01:27.152480 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:27.152611 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:27.152653 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:27.152703 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:27.152750 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:27.152801 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:27.152886 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:27.152916 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:27.152955 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:27.152986 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:27.181590 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:27.184420 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:27.184535 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:27.184586 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:27.940193 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:28.125692 28442 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0927 06:01:28.126394 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:28.126423 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:28.126494 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:28.130262 28442 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0927 06:01:28.135744 28442 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0927 06:01:28.136287 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:28.136485 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:28.136644 28442 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0927 06:01:28.136711 28442 api.go:53] PageSize not implemented W0927 06:01:28.136837 28442 api.go:53] PageSize not implemented I0927 06:01:28.142719 28442 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0927 06:01:28.143048 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:28.143279 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:28.143602 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:28.144043 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:28.144156 28442 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0927 06:01:28.144557 28442 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0927 06:01:28.144893 28442 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0927 06:01:28.151435 28442 target.go:111] Terraform output is in /tmp/test667620116/out --- PASS: TestUnmanaged (1.00s) === RUN TestPrivateSharedSubnet I0927 06:01:28.156470 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:28.156596 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:28.156638 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:28.156688 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:28.156731 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:28.156782 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:28.156866 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:28.156896 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:28.156935 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:28.156964 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:28.185936 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:28.189297 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:28.189379 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:28.189437 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:29.208869 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:29.402253 28442 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0927 06:01:29.404431 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:29.404491 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:29.404941 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:29.411594 28442 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0927 06:01:29.412247 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:01:29.414729 28442 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0927 06:01:29.415325 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:29.415538 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:29.415653 28442 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0927 06:01:29.415698 28442 api.go:53] PageSize not implemented W0927 06:01:29.415858 28442 api.go:53] PageSize not implemented I0927 06:01:29.421682 28442 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0927 06:01:29.421862 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:29.422057 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:29.422595 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:29.422681 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:29.422776 28442 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0927 06:01:29.423143 28442 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0927 06:01:29.423475 28442 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0927 06:01:29.429944 28442 target.go:111] Terraform output is in /tmp/test3423931861/out --- PASS: TestPrivateSharedSubnet (1.28s) === RUN TestPrivateSharedIP I0927 06:01:29.434744 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:29.434876 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:29.434919 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:29.434969 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:29.435010 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:29.435064 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:29.435144 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:29.435183 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:29.435222 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:29.435249 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:29.463835 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:29.467127 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:29.467205 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:29.467258 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:30.382402 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:30.579137 28442 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0927 06:01:30.581395 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:30.581464 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:30.581644 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:30.588193 28442 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0927 06:01:30.588590 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:01:30.591552 28442 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0927 06:01:30.592389 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:30.592574 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:30.592679 28442 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0927 06:01:30.592896 28442 api.go:53] PageSize not implemented W0927 06:01:30.592955 28442 api.go:53] PageSize not implemented I0927 06:01:30.599002 28442 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0927 06:01:30.599283 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:30.599492 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:30.599825 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:30.600338 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:30.600446 28442 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0927 06:01:30.600744 28442 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0927 06:01:30.601114 28442 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0927 06:01:30.607814 28442 target.go:111] Terraform output is in /tmp/test3968300652/out --- PASS: TestPrivateSharedIP (1.18s) === RUN TestPrivateDns1 I0927 06:01:30.612665 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:30.612791 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:30.612832 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:30.612877 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:30.612918 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:30.612973 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:30.613055 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:30.613086 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:30.613126 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:30.613156 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0927 06:01:30.645287 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:30.645369 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:30.645423 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:31.659054 28442 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0927 06:01:31.668629 28442 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0927 06:01:31.669028 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0927 06:01:31.669081 28442 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0927 06:01:31.669179 28442 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0927 06:01:31.669197 28442 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0927 06:01:31.669476 28442 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0927 06:01:31.670119 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:31.670354 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:31.673101 28442 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0927 06:01:31.673193 28442 api.go:53] PageSize not implemented W0927 06:01:31.673265 28442 api.go:53] PageSize not implemented I0927 06:01:31.679036 28442 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0927 06:01:31.679376 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:31.679652 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:31.679892 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:31.680458 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:31.680564 28442 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0927 06:01:31.680889 28442 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0927 06:01:31.681259 28442 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0927 06:01:31.688428 28442 target.go:111] Terraform output is in /tmp/test3286830955/out --- PASS: TestPrivateDns1 (1.08s) === RUN TestPrivateDns2 I0927 06:01:31.693232 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:31.693356 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:31.693398 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:31.693442 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:31.693482 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:31.693536 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:31.693620 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:31.693649 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:31.693698 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:31.693728 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:31.726704 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:31.727075 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:31.727389 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:32.681527 28442 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0927 06:01:32.684674 28442 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0927 06:01:32.685066 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0927 06:01:32.685076 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:01:32.685108 28442 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0927 06:01:32.685246 28442 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0927 06:01:32.685285 28442 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0927 06:01:32.685425 28442 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0927 06:01:32.686022 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:32.686237 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:32.688758 28442 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0927 06:01:32.688975 28442 api.go:53] PageSize not implemented W0927 06:01:32.689116 28442 api.go:53] PageSize not implemented I0927 06:01:32.694615 28442 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0927 06:01:32.694971 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:32.695193 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:32.695456 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:32.695884 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:32.695985 28442 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0927 06:01:32.696286 28442 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0927 06:01:32.696615 28442 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0927 06:01:32.703078 28442 target.go:111] Terraform output is in /tmp/test1789935467/out --- PASS: TestPrivateDns2 (1.01s) === RUN TestDiscoveryFeatureGate I0927 06:01:32.707824 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:32.707982 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:32.708025 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:32.708115 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:32.708165 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:32.708224 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:32.708268 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:32.708297 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:32.708334 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:32.708364 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:32.740299 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:01:32.743698 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:32.743794 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:33.516856 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:33.737414 28442 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0927 06:01:33.738496 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:33.738544 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:33.738687 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:33.740878 28442 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0927 06:01:33.747133 28442 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0927 06:01:33.747650 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:33.747940 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:33.748193 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:33.748672 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:33.748776 28442 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0927 06:01:33.749088 28442 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0927 06:01:33.749441 28442 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0927 06:01:33.755683 28442 target.go:111] Terraform output is in /tmp/test3383803660/out --- PASS: TestDiscoveryFeatureGate (1.05s) === RUN TestVFSServiceAccountIssuerDiscovery I0927 06:01:33.761475 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:33.761608 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:33.761649 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:33.761693 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:33.761733 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:33.761783 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:33.761872 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:33.761902 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:33.761943 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:33.761973 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:33.793270 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:33.796541 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:33.796641 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:34.560175 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:34.748380 28442 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0927 06:01:34.749182 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:34.749227 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:34.749343 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:34.751334 28442 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0927 06:01:34.761508 28442 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0927 06:01:34.761970 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:34.762151 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:34.762694 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:34.762795 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:34.762897 28442 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0927 06:01:34.763234 28442 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0927 06:01:34.763541 28442 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0927 06:01:34.769803 28442 target.go:111] Terraform output is in /tmp/test1892350386/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.02s) === RUN TestAWSLBController I0927 06:01:34.781660 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:34.781821 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:34.781877 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:34.781954 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:34.782026 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:34.782116 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:34.782225 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:34.782291 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:34.782359 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:34.782407 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:34.808639 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:34.812003 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:34.812108 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:35.570115 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:36.299634 28442 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0927 06:01:36.302018 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:36.302063 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:36.302188 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:36.308705 28442 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0927 06:01:36.314548 28442 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0927 06:01:36.314827 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:36.314989 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:36.315317 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:36.315761 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:36.315883 28442 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0927 06:01:36.316241 28442 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0927 06:01:36.316561 28442 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0927 06:01:36.323567 28442 target.go:111] Terraform output is in /tmp/test371433725/out --- PASS: TestAWSLBController (1.55s) === RUN TestManyAddons I0927 06:01:36.336599 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:36.336745 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:36.336794 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:36.336844 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:36.336887 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:36.336939 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:36.337030 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:36.337061 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:36.337100 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:36.337129 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:36.365016 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:36.368564 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:36.368658 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:37.796216 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:38.594972 28442 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0927 06:01:38.602769 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:38.602793 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:38.602850 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:38.604499 28442 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0927 06:01:38.610570 28442 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0927 06:01:38.610936 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:38.611148 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:38.611491 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:38.611946 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:38.612055 28442 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0927 06:01:38.612350 28442 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0927 06:01:38.612721 28442 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0927 06:01:38.619235 28442 target.go:111] Terraform output is in /tmp/test2930684157/out --- PASS: TestManyAddons (2.30s) === RUN TestManyAddonsCCMIRSA I0927 06:01:38.631988 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:38.632139 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:38.632192 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:38.632245 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:38.632292 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:38.632349 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:38.632442 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:38.632473 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:38.632512 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:38.632543 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:38.662058 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:38.665891 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:38.665982 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:39.429400 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:40.330491 28442 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0927 06:01:40.331813 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:40.331873 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:40.331974 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:40.339053 28442 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0927 06:01:40.346136 28442 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0927 06:01:40.346714 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:40.346943 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:40.347492 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:40.347610 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:40.347724 28442 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0927 06:01:40.348114 28442 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0927 06:01:40.348430 28442 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0927 06:01:40.356203 28442 target.go:111] Terraform output is in /tmp/test3662576932/out --- PASS: TestManyAddonsCCMIRSA (1.73s) === RUN TestManyAddonsCCMIRSA23 I0927 06:01:40.366693 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:40.366851 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:40.366910 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:40.366974 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:40.367025 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:40.367099 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:40.367204 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:40.367248 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:40.367301 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:40.367336 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:40.401903 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0927 06:01:40.406020 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:40.406114 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:41.370232 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:42.288764 28442 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0927 06:01:42.289450 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:42.289470 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:42.289531 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:42.297332 28442 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0927 06:01:42.304873 28442 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0927 06:01:42.305404 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:42.305886 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:42.306180 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:42.306727 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:42.306850 28442 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0927 06:01:42.307170 28442 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0927 06:01:42.307466 28442 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0927 06:01:42.315276 28442 target.go:111] Terraform output is in /tmp/test532482654/out --- PASS: TestManyAddonsCCMIRSA23 (1.96s) === RUN TestManyAddonsCCMIRSA24 I0927 06:01:42.326283 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:42.326414 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:42.326457 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:42.326510 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:42.326557 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:42.326613 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:42.326695 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:42.326726 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:42.326767 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:42.326799 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:42.361540 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:01:42.365186 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:42.365281 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:43.130718 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:44.037749 28442 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0927 06:01:44.041893 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:44.042101 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:44.042358 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:44.048859 28442 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0927 06:01:44.054921 28442 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0927 06:01:44.055157 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:44.055349 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:44.055869 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:44.055943 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:44.056049 28442 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0927 06:01:44.056383 28442 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0927 06:01:44.056735 28442 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0927 06:01:44.064490 28442 target.go:111] Terraform output is in /tmp/test1582046232/out --- PASS: TestManyAddonsCCMIRSA24 (1.75s) === RUN TestManyAddonsCCMIRSA25 I0927 06:01:44.078072 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:44.078230 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:44.078284 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:44.078341 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:44.078389 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:44.078444 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:44.078537 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:44.078567 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:44.078606 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:44.078634 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:44.108289 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0927 06:01:44.111512 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:44.111591 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:45.065818 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:45.968727 28442 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0927 06:01:45.970940 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:45.970971 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:45.971063 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:45.978830 28442 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0927 06:01:45.985270 28442 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0927 06:01:45.985604 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:45.985985 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:45.986409 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:45.986493 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:45.986599 28442 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0927 06:01:45.986884 28442 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0927 06:01:45.987239 28442 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0927 06:01:45.995075 28442 target.go:111] Terraform output is in /tmp/test4169859223/out --- PASS: TestManyAddonsCCMIRSA25 (1.93s) === RUN TestManyAddonsCCMIRSA26 I0927 06:01:46.009251 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:46.009399 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:46.009449 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:46.009503 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:46.009552 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:46.009627 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:46.009777 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:46.009836 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:46.009911 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:46.009966 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:46.041046 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0927 06:01:46.044091 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:46.044166 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:46.813005 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:47.664550 28442 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0927 06:01:47.665573 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:47.665616 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:47.665703 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:47.669434 28442 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0927 06:01:47.681415 28442 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0927 06:01:47.681770 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:47.682042 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:47.682588 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:47.682664 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:47.682777 28442 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0927 06:01:47.683078 28442 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0927 06:01:47.683447 28442 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0927 06:01:47.691048 28442 target.go:111] Terraform output is in /tmp/test1863312491/out --- PASS: TestManyAddonsCCMIRSA26 (1.69s) === RUN TestManyAddonsGCE I0927 06:01:47.701245 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:01:49.414263 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:01:49.414332 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:01:49.414409 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0927 06:01:49.414431 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0927 06:01:49.414446 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0927 06:01:49.414498 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0927 06:01:49.415438 28442 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0927 06:01:49.420775 28442 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0927 06:01:49.428636 28442 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0927 06:01:49.429881 28442 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0927 06:01:49.430172 28442 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0927 06:01:49.434673 28442 target.go:111] Terraform output is in /tmp/test1098927924/out --- PASS: TestManyAddonsGCE (1.74s) === RUN TestCCM I0927 06:01:49.442507 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:49.442633 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:49.442677 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:49.442770 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:49.442833 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:49.442897 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:49.442944 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:49.442975 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:49.443016 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:49.443045 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:49.470109 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:49.473253 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:49.473336 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:50.450984 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:51.291387 28442 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0927 06:01:51.291682 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:51.291711 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:51.291814 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:51.295550 28442 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0927 06:01:51.301701 28442 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0927 06:01:51.302164 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:51.302450 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:51.302896 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:51.302972 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:51.303095 28442 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0927 06:01:51.303408 28442 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0927 06:01:51.303741 28442 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0927 06:01:51.314965 28442 target.go:111] Terraform output is in /tmp/test522295231/out --- PASS: TestCCM (1.89s) === RUN TestExternalDNS I0927 06:01:51.334553 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:51.334698 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:51.334745 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:51.334801 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:51.334849 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:51.334906 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:51.334999 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:51.335030 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:51.335070 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:51.335100 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:51.359372 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:51.362131 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:51.362206 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:52.390227 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:52.569772 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:01:52.572786 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:52.572824 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:52.572948 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:52.576154 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:01:52.584134 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:01:52.584788 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:52.585125 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:52.585333 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:52.585961 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:52.586085 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:01:52.586420 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:01:52.586792 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:01:52.592015 28442 target.go:111] Terraform output is in /tmp/test1019252453/out --- PASS: TestExternalDNS (1.26s) === RUN TestExternalDNSIRSA I0927 06:01:52.596455 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:52.596581 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:52.596621 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:52.596667 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:52.596707 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:52.596767 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:52.596852 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:52.596882 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:52.596923 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:52.596952 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:52.622344 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:52.625540 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:52.625626 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:53.392382 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:53.608799 28442 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0927 06:01:53.612031 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:53.612069 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:53.612196 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:53.615844 28442 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0927 06:01:53.621534 28442 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0927 06:01:53.622131 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:53.622357 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:53.622842 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:53.622940 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:53.623048 28442 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0927 06:01:53.623377 28442 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0927 06:01:53.623728 28442 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0927 06:01:53.630189 28442 target.go:111] Terraform output is in /tmp/test1442193546/out --- PASS: TestExternalDNSIRSA (1.04s) === RUN TestKarpenter I0927 06:01:53.635778 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:53.635908 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:53.635949 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:53.635996 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:53.636037 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:53.636097 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:53.636183 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:53.636215 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:53.636259 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:53.636290 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:53.667701 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:53.670927 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:53.670994 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:53.671043 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.431924 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:54.644392 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.644560 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.644689 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0927 06:01:54.785006 28442 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0927 06:01:54.785064 28442 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0927 06:01:54.785077 28442 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0927 06:01:54.785087 28442 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0927 06:01:54.785097 28442 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0927 06:01:54.808550 28442 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0927 06:01:54.809690 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:54.809737 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:54.809877 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:54.812282 28442 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0927 06:01:54.819769 28442 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0927 06:01:54.820029 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.820391 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.820536 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.820697 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.820808 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.821107 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.821281 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.821495 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.821597 28442 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0927 06:01:54.821896 28442 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0927 06:01:54.822234 28442 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0927 06:01:54.829341 28442 target.go:111] Terraform output is in /tmp/test452701711/out --- PASS: TestKarpenter (1.20s) === RUN TestSharedSubnet I0927 06:01:54.837213 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:54.837349 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:54.837403 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:54.837451 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:54.837500 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:54.837555 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:54.837643 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:54.837674 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:54.837714 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:54.837752 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:54.868382 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:54.871543 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:54.871642 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:55.622912 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:55.807435 28442 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0927 06:01:55.807887 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:55.807911 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:55.807988 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:55.814734 28442 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0927 06:01:55.815156 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:01:55.821845 28442 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0927 06:01:55.822201 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:55.822516 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:55.822696 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:55.823391 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:55.823516 28442 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0927 06:01:55.823812 28442 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0927 06:01:55.824189 28442 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0927 06:01:55.829012 28442 target.go:111] Terraform output is in /tmp/test1214002867/out --- PASS: TestSharedSubnet (1.00s) === RUN TestSharedVPC I0927 06:01:55.833503 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:55.833634 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:55.833678 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:55.833726 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:55.833772 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:55.833826 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:55.833912 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:55.833946 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:55.833986 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:55.834016 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:55.858969 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:55.862180 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:55.862268 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:56.659485 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:56.853349 28442 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0927 06:01:56.854247 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:56.854280 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:56.854345 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:56.859681 28442 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0927 06:01:56.861222 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:01:56.866533 28442 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0927 06:01:56.866773 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:56.867260 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:56.867522 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:56.867842 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:56.868022 28442 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0927 06:01:56.868492 28442 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0927 06:01:56.868996 28442 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0927 06:01:56.874318 28442 target.go:111] Terraform output is in /tmp/test3037485884/out --- PASS: TestSharedVPC (1.05s) === RUN TestSharedVPCIPv6 I0927 06:01:56.878828 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:56.878975 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:56.879021 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:56.879069 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:56.879131 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:56.879200 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:56.879304 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:56.879346 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:56.879401 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:56.879429 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:56.881535 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:01:56.881593 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:01:56.909566 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:01:56.909620 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0927 06:01:56.909744 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:01:56.913383 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:56.913459 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:58.110407 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:58.307759 28442 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0927 06:01:58.308453 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:58.308492 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:58.308593 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:58.313004 28442 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0927 06:01:58.313758 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:01:58.314793 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:01:58.319366 28442 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0927 06:01:58.320912 28442 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0927 06:01:58.321003 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:58.321079 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:58.321143 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:01:58.321210 28442 loadbalancers.go:35] PageSize not implemented I0927 06:01:58.325978 28442 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0927 06:01:58.326240 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:58.326440 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:58.326850 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:58.327002 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:58.327129 28442 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0927 06:01:58.327417 28442 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0927 06:01:58.327809 28442 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0927 06:01:58.334248 28442 target.go:111] Terraform output is in /tmp/test873392920/out --- PASS: TestSharedVPCIPv6 (1.46s) === RUN TestExistingIAM I0927 06:01:58.338881 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:58.339017 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:58.339080 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:58.339130 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:58.339174 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:58.339229 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:58.339314 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:58.339344 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:58.339383 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:58.339413 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:58.372928 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:58.376330 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:58.376407 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:58.376455 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:58.376503 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.139181 28442 zones.go:93] ListHostedZonesPages { } I0927 06:01:59.341300 28442 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0927 06:01:59.346431 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:01:59.346469 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:01:59.346568 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:01:59.347008 28442 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0927 06:01:59.353400 28442 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0927 06:01:59.353748 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.354002 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.354156 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.354489 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.354634 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.354887 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.355048 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.355181 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.355289 28442 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0927 06:01:59.355681 28442 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0927 06:01:59.356120 28442 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0927 06:01:59.362878 28442 target.go:111] Terraform output is in /tmp/test1197069509/out --- PASS: TestExistingIAM (1.03s) === RUN TestPhaseNetwork I0927 06:01:59.372435 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:59.372572 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:59.372618 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:59.372667 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:59.372714 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:59.372766 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:59.372809 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:59.372840 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:59.372879 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:59.372907 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:59.401652 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:01:59.405049 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.405138 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:01:59.405198 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:00.180135 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:00.377921 28442 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0927 06:02:00.378477 28442 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0927 06:02:00.379074 28442 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0927 06:02:00.379528 28442 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0927 06:02:00.379727 28442 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0927 06:02:00.379925 28442 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0927 06:02:00.379983 28442 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0927 06:02:00.380029 28442 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0927 06:02:00.380996 28442 target.go:111] Terraform output is in /tmp/test1446829969/out --- PASS: TestPhaseNetwork (1.01s) === RUN TestExternalLoadBalancer I0927 06:02:00.381563 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:00.381696 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:00.381741 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:00.381793 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:00.381838 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:00.381894 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:00.381991 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:00.382022 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:00.382062 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:00.382092 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:00.408108 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:00.411345 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:00.411444 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.191286 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:01.381226 28442 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0927 06:02:01.381747 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:01.381785 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:01.381886 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:01.384103 28442 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0927 06:02:01.390361 28442 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0927 06:02:01.390844 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.391073 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.391375 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.391873 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.391993 28442 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0927 06:02:01.393243 28442 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0927 06:02:01.393717 28442 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0927 06:02:01.402763 28442 target.go:111] Terraform output is in /tmp/test3492709790/out --- PASS: TestExternalLoadBalancer (1.03s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0927 06:02:01.408185 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:01.408321 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:01.408367 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:01.408418 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:01.408466 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:01.408519 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:01.408604 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:01.408635 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:01.408674 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:01.408704 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:01.441821 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:01.445311 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.445391 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.445448 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.445500 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.445548 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.445589 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:01.445636 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.225727 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:02.428340 28442 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0927 06:02:02.430187 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:02.430226 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:02.430324 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:02.432020 28442 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0927 06:02:02.443770 28442 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0927 06:02:02.444310 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.444569 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.444837 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.445129 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.445280 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.445532 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.445737 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.446377 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.446489 28442 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0927 06:02:02.446890 28442 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0927 06:02:02.447352 28442 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0927 06:02:02.454548 28442 target.go:111] Terraform output is in /tmp/test113243478/out --- PASS: TestMixedInstancesASG (1.05s) === RUN TestMixedInstancesSpotASG I0927 06:02:02.460140 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:02.460277 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:02.460318 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:02.460366 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:02.460408 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:02.460459 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:02.460543 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:02.460576 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:02.460616 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:02.460647 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:02.493630 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:02.496963 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.497043 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.497096 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.497145 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.497189 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.497230 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:02.497268 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.279646 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:03.485629 28442 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0927 06:02:03.486332 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:03.486366 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:03.486482 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:03.489638 28442 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0927 06:02:03.497904 28442 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0927 06:02:03.498282 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.498517 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.499620 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.499918 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.500286 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.500503 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.500925 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.501368 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.501663 28442 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0927 06:02:03.502826 28442 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0927 06:02:03.504140 28442 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0927 06:02:03.512678 28442 target.go:111] Terraform output is in /tmp/test1204951637/out --- PASS: TestMixedInstancesSpotASG (1.06s) === RUN TestAdditionalObjects I0927 06:02:03.518310 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:03.518435 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:03.518479 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:03.518542 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:03.518588 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:03.518639 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:03.518724 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:03.518754 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:03.518792 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:03.518825 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:03.546471 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0927 06:02:03.549663 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:03.549748 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:04.595317 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:04.782023 28442 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0927 06:02:04.785289 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:04.785345 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:04.785435 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:04.786692 28442 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0927 06:02:04.797127 28442 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0927 06:02:04.797550 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:04.798244 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:04.798355 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:04.799205 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:04.799641 28442 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0927 06:02:04.799930 28442 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0927 06:02:04.800401 28442 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0927 06:02:04.806237 28442 target.go:111] Terraform output is in /tmp/test3262762336/out --- PASS: TestAdditionalObjects (1.29s) === RUN TestContainerd I0927 06:02:04.810672 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:04.810796 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:04.810839 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:04.810886 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:04.810931 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:04.810981 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:04.811061 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:04.811090 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:04.811148 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:04.811181 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:04.835711 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:04.838879 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:04.838967 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:05.599740 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:05.791902 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:02:05.793479 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:05.793505 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:05.793584 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:05.798675 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:02:05.805621 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:02:05.806080 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:05.806297 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:05.806526 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:05.807082 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:05.807216 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:02:05.807613 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:02:05.808042 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:02:05.813853 28442 target.go:111] Terraform output is in /tmp/test3939526157/out --- PASS: TestContainerd (1.01s) === RUN TestContainerdCustom I0927 06:02:05.818385 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:05.818534 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:05.818577 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:05.818653 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:05.818711 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:05.818789 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:05.818889 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:05.818929 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:05.818985 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:05.819017 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:05.845342 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:05.848799 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:05.848891 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:06.344269 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:06.535078 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:02:06.535409 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:06.535435 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:06.535544 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:06.541059 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:02:06.547939 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:02:06.548597 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:06.548881 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:06.549420 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:06.549519 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:06.549614 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:02:06.549952 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:02:06.550321 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:02:06.555524 28442 target.go:111] Terraform output is in /tmp/test971320899/out --- PASS: TestContainerdCustom (0.74s) === RUN TestDockerCustom I0927 06:02:06.559912 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:06.560040 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:06.560082 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:06.560125 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:06.560166 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:06.560218 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:06.560301 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:06.560332 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:06.560370 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:06.560399 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:06.586293 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0927 06:02:06.589754 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:06.589842 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:07.083268 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:07.273650 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:02:07.274137 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:07.274193 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:07.274350 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:07.278518 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:02:07.288662 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:02:07.290105 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:07.290381 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:07.290834 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:07.290961 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:07.291106 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:02:07.291468 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:02:07.291806 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:02:07.297572 28442 target.go:111] Terraform output is in /tmp/test161034832/out --- PASS: TestDockerCustom (0.74s) === RUN TestAPIServerNodes I0927 06:02:07.302151 28442 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0927 06:02:07.302180 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:07.302298 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:07.302337 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:07.302383 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:07.302428 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:07.302479 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:07.302564 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:07.302595 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:07.302636 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:07.302664 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:07.329554 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0927 06:02:07.332551 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:07.332631 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:07.332683 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:08.168237 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:08.361985 28442 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0927 06:02:08.363718 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:08.363751 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:08.363919 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:08.370503 28442 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0927 06:02:08.376851 28442 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0927 06:02:08.377228 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:08.377415 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:08.377694 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:08.377946 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:08.378238 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:08.378341 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:08.378431 28442 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0927 06:02:08.378825 28442 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0927 06:02:08.379359 28442 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0927 06:02:08.385475 28442 target.go:111] Terraform output is in /tmp/test1227869578/out I0927 06:02:08.390448 28442 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.09s) === RUN TestNTHIMDSProcessor I0927 06:02:08.390577 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:08.390694 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:08.390733 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:08.390778 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:08.390819 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:08.390869 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:08.390948 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:08.390978 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:08.391016 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:08.391046 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:08.422004 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:08.425255 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:08.425351 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:09.453275 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:09.646121 28442 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0927 06:02:09.647117 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:09.647147 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:09.647225 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:09.649668 28442 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0927 06:02:09.655792 28442 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0927 06:02:09.656291 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:09.657994 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:09.658909 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:09.659545 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:09.659744 28442 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0927 06:02:09.660437 28442 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0927 06:02:09.661375 28442 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0927 06:02:09.666835 28442 target.go:111] Terraform output is in /tmp/test1124927824/out --- PASS: TestNTHIMDSProcessor (1.28s) === RUN TestNTHIMDSProcessorIRSA I0927 06:02:09.670780 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:09.670905 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:09.670945 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:09.670993 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:09.671035 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:09.671086 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:09.671194 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:09.671226 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:09.671264 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:09.671292 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:09.697604 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:09.700854 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:09.700945 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:10.705223 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:10.927198 28442 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0927 06:02:10.929871 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:10.929909 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:10.930008 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:10.933226 28442 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0927 06:02:10.943287 28442 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0927 06:02:10.943656 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:10.943951 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:10.944656 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:10.944895 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:10.945030 28442 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0927 06:02:10.945382 28442 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0927 06:02:10.945707 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:02:10.951448 28442 target.go:111] Terraform output is in /tmp/test1406998175/out --- PASS: TestNTHIMDSProcessorIRSA (1.29s) === RUN TestCustomIRSA I0927 06:02:10.956524 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:10.956648 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:10.956689 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:10.956735 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:10.956775 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:10.956827 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:10.956909 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:10.956940 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:10.956978 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:10.957019 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:10.985670 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:10.988922 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:10.988999 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:11.758749 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:12.455208 28442 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0927 06:02:12.455768 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:12.455791 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:12.455853 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:12.464086 28442 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0927 06:02:12.471173 28442 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0927 06:02:12.471423 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:12.471709 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:12.472261 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:12.472360 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:12.472467 28442 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0927 06:02:12.472877 28442 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0927 06:02:12.473242 28442 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0927 06:02:12.479839 28442 target.go:111] Terraform output is in /tmp/test3259249610/out --- PASS: TestCustomIRSA (1.53s) === RUN TestClusterNameDigit I0927 06:02:12.488972 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:12.489109 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:12.489152 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:12.489197 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:12.489237 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:12.489288 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:12.489372 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:12.489402 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:12.489441 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:12.489470 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:12.524199 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:12.527620 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:12.527716 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:13.285121 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:13.483060 28442 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0927 06:02:13.484035 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:13.484076 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:13.484178 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:13.490848 28442 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0927 06:02:13.497137 28442 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0927 06:02:13.497471 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:13.497628 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:13.498117 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:13.498283 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:13.498390 28442 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0927 06:02:13.498684 28442 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0927 06:02:13.499015 28442 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0927 06:02:13.504747 28442 target.go:111] Terraform output is in /tmp/test1540780130/out --- PASS: TestClusterNameDigit (1.02s) === RUN TestCASPriorityExpander I0927 06:02:13.509707 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:13.509828 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:13.509869 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:13.509913 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:13.509953 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:13.510009 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:13.510094 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:13.510124 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:13.510162 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:13.510194 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:13.540383 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0927 06:02:13.543366 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:13.543438 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:13.543484 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:13.543527 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0927 06:02:14.313658 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:14.517048 28442 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0927 06:02:14.518659 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:14.518700 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:14.518798 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:14.521191 28442 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0927 06:02:14.527356 28442 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0927 06:02:14.527900 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.528189 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.529550 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.529938 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.530261 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.530538 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.530699 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.531576 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.532809 28442 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0927 06:02:14.533469 28442 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0927 06:02:14.534962 28442 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0927 06:02:14.541353 28442 target.go:111] Terraform output is in /tmp/test4128319181/out --- PASS: TestCASPriorityExpander (1.04s) === RUN TestCASPriorityExpanderCustom I0927 06:02:14.546738 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:14.546860 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:14.546905 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:14.546953 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:14.546997 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:14.547052 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:14.547137 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:14.547168 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:14.547205 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:14.547232 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:02:14.578714 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0927 06:02:14.582101 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.582180 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.582233 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:14.582282 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0927 06:02:15.338883 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:15.552693 28442 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0927 06:02:15.553863 28442 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0927 06:02:15.553911 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:15.554002 28442 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0927 06:02:15.556765 28442 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0927 06:02:15.562727 28442 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0927 06:02:15.563100 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:15.563374 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:15.563628 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:15.563890 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:15.563985 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:15.564224 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:15.564425 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:15.564682 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:15.564797 28442 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0927 06:02:15.566613 28442 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0927 06:02:15.567723 28442 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0927 06:02:15.576878 28442 target.go:111] Terraform output is in /tmp/test1174869005/out --- PASS: TestCASPriorityExpanderCustom (1.04s) === RUN TestLifecycleMinimalAWS I0927 06:02:15.582069 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:15.582201 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:15.582249 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:15.582301 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:15.582345 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:15.582400 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:15.582446 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:15.582474 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:15.582513 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:15.582542 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0927 06:02:15.606685 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0927 06:02:15.609805 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:15.609893 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0927 06:02:16.430622 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:16.613193 28442 iamrole.go:89] ListRoles: { } I0927 06:02:16.614821 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:02:16.615173 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0927 06:02:16.615316 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0927 06:02:16.615514 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:16.615848 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:16.616102 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:16.616198 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0927 06:02:16.616314 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0927 06:02:16.616390 28442 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.616553 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.616666 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:16.616860 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:16.617118 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:16.617220 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:16.617508 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:16.617744 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:16.617857 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0927 06:02:16.617949 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0927 06:02:16.618010 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:16.618345 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:16.618445 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:16.618491 28442 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.618608 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:16.618743 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:02:16.618902 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:16.619029 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0927 06:02:16.619084 28442 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0927 06:02:16.619149 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0927 06:02:16.619188 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0927 06:02:16.619105 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0927 06:02:16.619394 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0927 06:02:16.619431 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:16.619465 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0927 06:02:16.619552 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:16.619647 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:16.619719 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:16.619737 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0927 06:02:16.619922 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:16.620114 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0927 06:02:16.620339 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:16.620553 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:16.620766 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:16.620832 28442 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0927 06:02:16.620801 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0927 06:02:16.620928 28442 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0927 06:02:16.620987 28442 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0927 06:02:16.621030 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:16.621137 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:16.621214 28442 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.620915 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0927 06:02:16.621321 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:16.621392 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:16.621442 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:16.621483 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:16.624684 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:02:16.625029 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:16.625175 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:16.625397 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0927 06:02:16.625450 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0927 06:02:16.625510 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.625683 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:16.625789 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:16.625973 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:16.626106 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:16.626313 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.626551 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" }] }] } I0927 06:02:16.626736 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:16.626818 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0927 06:02:16.627030 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:16.627105 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.627279 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.627528 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.627693 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" }] }] } I0927 06:02:16.627880 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0927 06:02:16.628046 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.628204 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.628352 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.628507 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0927 06:02:16.628671 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:16.628835 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:16.628944 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:02:16.629358 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:02:16.629693 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:02:16.629759 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:16.629801 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:16.629874 28442 dns.go:235] Pre-creating DNS records I0927 06:02:16.629904 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:16.637296 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0927 06:02:16.642494 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:16.642592 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0927 06:02:17.458951 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:17.641739 28442 iamrole.go:89] ListRoles: { } I0927 06:02:17.642825 28442 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0927 06:02:17.642976 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.643063 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:17.643106 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:17.643148 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:17.646070 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:17.646175 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:17.646421 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.646767 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] }] } I0927 06:02:17.647075 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.650504 28442 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0927 06:02:17.650639 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.650891 28442 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0927 06:02:17.650815 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0927 06:02:17.651015 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:17.651089 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0927 06:02:17.651081 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0927 06:02:17.651296 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.651535 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:17.651620 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:17.651728 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:17.651830 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:17.651923 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.657580 28442 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0927 06:02:17.657918 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:17.658041 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:17.658248 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:17.658413 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:17.658569 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:17.658825 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:17.658989 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:17.659828 28442 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0927 06:02:17.660119 28442 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0927 06:02:17.660376 28442 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0927 06:02:17.663096 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:17.663161 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:17.663202 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:17.663235 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:17.663269 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:17.663303 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:17.663337 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:17.663374 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:02:17.663408 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:17.663446 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:17.663487 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:17.663518 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:17.663550 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:17.663595 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:17.663628 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:17.663662 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:17.663704 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:17.663742 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:17.663774 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:17.663806 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:17.663837 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:17.663874 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:17.663910 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:17.663944 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:17.665242 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:17.665324 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:17.665347 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:17.665404 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.665454 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0927 06:02:17.665511 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.665569 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.665618 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.665673 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.665716 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.665755 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0927 06:02:17.665803 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.665853 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:17.665893 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0927 06:02:17.665939 28442 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0927 06:02:17.665976 28442 api.go:53] PageSize not implemented I0927 06:02:17.665998 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:17.666025 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:17.666046 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:17.666076 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:17.666096 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0927 06:02:17.666150 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:17.666188 28442 iamrole.go:89] ListRoles: { } I0927 06:02:17.666231 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:17.666260 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:17.666304 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:17.666346 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:17.666380 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:17.666921 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:17.666941 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0927 06:02:17.667033 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0927 06:02:17.666986 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0927 06:02:17.667171 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:17.667190 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } autoscaling-group:nodes.minimal.example.com ok autoscaling-config:lt-2 ok security-group:sg-1 ok I0927 06:02:17.667263 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:17.667300 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } autoscaling-config:lt-1 ok I0927 06:02:17.667130 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok I0927 06:02:17.667358 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0927 06:02:17.667341 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0927 06:02:17.667559 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:17.667585 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0927 06:02:17.667622 28442 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0927 06:02:17.667685 28442 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0927 06:02:17.667737 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0927 06:02:17.667837 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0927 06:02:17.667911 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0927 06:02:17.668004 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0927 06:02:17.668058 28442 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0927 06:02:17.668073 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0927 06:02:17.668117 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0927 06:02:17.668155 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0927 06:02:17.668198 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0927 06:02:17.668211 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0927 06:02:17.668239 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0927 06:02:17.668043 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0927 06:02:17.668343 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0927 06:02:17.668440 28442 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0927 06:02:17.668525 28442 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (2.09s) === RUN TestLifecycleMinimalOpenstack I0927 06:02:17.669047 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0927 06:02:17.677003 28442 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:02:18.602269 28442 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0927 06:02:18.602319 28442 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0927 06:02:18.620532 28442 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2023/09/27 06:02:18 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:18 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0927 06:02:18.627741 28442 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0927 06:02:18.638822 28442 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0927 06:02:18.642661 28442 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2023/09/27 06:02:18 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:18 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:18 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0927 06:02:18.645831 28442 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0927 06:02:18.646213 28442 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0927 06:02:18.646336 28442 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0927 06:02:19.656018 28442 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:02:20.811573 28442 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0927 06:02:20.811618 28442 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0927 06:02:20.830699 28442 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2023/09/27 06:02:20 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:20 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0927 06:02:20.841879 28442 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0927 06:02:20.850004 28442 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0927 06:02:20.851739 28442 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2023/09/27 06:02:20 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:20 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:20 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0927 06:02:20.854760 28442 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0927 06:02:20.855192 28442 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0927 06:02:20.855770 28442 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0927 06:02:20.857376 28442 delete_cluster.go:128] Looking for cloud resources to delete 2023/09/27 06:02:20 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SecurityGroup:dff7e0ff-ae02-4a4c-963c-a1ef0bc25fc2 ok SecurityGroup:d75e8505-aa41-4756-9414-094edc8f41d6 ok Instance:cce9c04f-982a-40c6-8da8-15d6ec82d8da ok ServerGroup:cc04020c-d6ea-423e-91b5-f9ce5e996640 ok Port:79c8990d-cbc3-4d59-9425-92b77b150154 ok SecurityGroup:d47a1f0c-658f-4189-8917-b8ac971a53a2 ok Subnet:a1a22d1d-c38b-4045-9fac-8ffcf3390fb9 ok ServerGroup:88a0b0eb-c23e-4e77-8a91-12f4e76a65cf ok Port:1d47f6bf-8209-4566-bdb4-53f415d09e75 ok Port:74fbe3d4-6467-4349-8eb0-0f51102b3f35 ok Instance:d586caf9-b28c-446b-a3a5-ec0a4a5096f9 ok Network:29f44c5e-72a5-4fa0-9f59-798c6c6c05ef ok Instance:ace584ed-b406-4122-8317-0d11d9b7a731 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok --- PASS: TestLifecycleMinimalOpenstack (4.30s) === RUN TestLifecycleMinimalGCE I0927 06:02:21.968638 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0927 06:02:21.970455 28442 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:02:23.171998 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:02:23.172200 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:02:23.172375 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0927 06:02:23.172428 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0927 06:02:23.172476 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0927 06:02:23.172584 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0927 06:02:23.174096 28442 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0927 06:02:23.178081 28442 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0927 06:02:23.183972 28442 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0927 06:02:23.185057 28442 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0927 06:02:23.185293 28442 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0927 06:02:23.185391 28442 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:02:24.369768 28442 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0927 06:02:24.369877 28442 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0927 06:02:24.369999 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0927 06:02:24.370035 28442 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0927 06:02:24.370062 28442 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0927 06:02:24.370130 28442 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0927 06:02:24.371613 28442 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0927 06:02:24.375519 28442 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0927 06:02:24.381386 28442 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0927 06:02:24.382452 28442 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0927 06:02:24.382648 28442 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0927 06:02:24.384257 28442 delete_cluster.go:128] Looking for cloud resources to delete I0927 06:02:24.384326 28442 gce.go:99] Scanning zones: [us-test1-a] I0927 06:02:24.384713 28442 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0927 06:02:24.384739 28442 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok FirewallRule:master-to-master-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1695794543 ok InstanceTemplate:nodes-minimal-gce-example-com-1695794543 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (2.42s) === RUN TestLifecycleFloatingIPOpenstack I0927 06:02:24.386186 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0927 06:02:24.393775 28442 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:02:25.328230 28442 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0927 06:02:25.328287 28442 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0927 06:02:25.346233 28442 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2023/09/27 06:02:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0927 06:02:25.350978 28442 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0927 06:02:25.363819 28442 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0927 06:02:25.366947 28442 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2023/09/27 06:02:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:25 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0927 06:02:25.369207 28442 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0927 06:02:25.369501 28442 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0927 06:02:26.374519 28442 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0927 06:02:27.293822 28442 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0927 06:02:27.293869 28442 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0927 06:02:27.315923 28442 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2023/09/27 06:02:27 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:27 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0927 06:02:27.320772 28442 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0927 06:02:27.333128 28442 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0927 06:02:27.335139 28442 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2023/09/27 06:02:27 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:27 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/09/27 06:02:27 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0927 06:02:27.338188 28442 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0927 06:02:27.338648 28442 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0927 06:02:27.339186 28442 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0927 06:02:27.340795 28442 delete_cluster.go:128] Looking for cloud resources to delete 2023/09/27 06:02:27 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Router-IF:5735c44f-493d-4711-b40e-a09207cdb2fe ok Port:d8a0baf2-e76a-49cb-9577-9a68ce154ee7 ok SecurityGroup:e0d7db0f-5c36-4680-b6ec-a0b9d1e55a07 ok Port:c534bcbd-f12b-4b45-8e3c-5f15f5ff0f3f ok Subnet:5735c44f-493d-4711-b40e-a09207cdb2fe ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok ServerGroup:effec21a-0fc5-49d9-a1ef-6f20168abe52 ok ServerGroup:83448c58-e8f0-420d-870b-b1a342728d14 ok Router:042c3e38-e96f-49eb-9b8c-d33a4780ae39 ok SecurityGroup:03c5b91b-db50-4024-82f7-d4678a552dc4 ok Network:04b28afc-7491-4a22-b0a3-98e9987d490a ok SecurityGroup:c51d8f53-bff3-4d73-acbd-6a5513d52b1b ok Port:109962a3-8a85-4afc-b62b-170258be82f7 ok Instance:77769f53-56ea-43e4-838b-cf7be472fbf9 ok Instance:cff25db9-b1aa-408d-bfd4-f30cea973882 ok Port:8cba42e7-5468-40d0-a5ee-6f79c0d14c75 ok Instance:e8dd8d15-1902-46df-a330-214e1d1ecf92 ok --- PASS: TestLifecycleFloatingIPOpenstack (4.07s) === RUN TestLifecyclePrivateCalico I0927 06:02:28.455186 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:28.455338 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:28.455381 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:28.455428 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:28.455471 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:28.455521 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:28.455562 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:28.455591 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:28.455629 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:28.455656 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0927 06:02:28.485021 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:02:28.488728 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:28.488817 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:28.488876 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:29.246023 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:29.699799 28442 iamrole.go:89] ListRoles: { } I0927 06:02:29.702128 28442 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0927 06:02:29.702407 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:29.702439 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:29.702610 28442 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.702770 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:29.703087 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:29.703238 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0927 06:02:29.703308 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:29.703461 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:29.703394 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0927 06:02:29.703525 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:29.703706 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0927 06:02:29.703757 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:29.703801 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0927 06:02:29.703964 28442 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.704015 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0927 06:02:29.704106 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] } I0927 06:02:29.704011 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.704293 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0927 06:02:29.704340 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0927 06:02:29.704378 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:29.704433 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:29.704520 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:29.704699 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:29.704835 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:29.706791 28442 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0927 06:02:29.706997 28442 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0927 06:02:29.706962 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0927 06:02:29.706960 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0927 06:02:29.707164 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:29.707069 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0927 06:02:29.707270 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:29.707256 28442 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0927 06:02:29.707415 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0927 06:02:29.707445 28442 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0927 06:02:29.707490 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0927 06:02:29.707510 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:29.707721 28442 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0927 06:02:29.707676 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0927 06:02:29.707813 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0927 06:02:29.707953 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0927 06:02:29.708044 28442 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0927 06:02:29.708026 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:29.708128 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:29.708203 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0927 06:02:29.708235 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:29.708334 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0927 06:02:29.708329 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0927 06:02:29.708442 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:29.708541 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0927 06:02:29.708645 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:29.708733 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:29.708830 28442 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0927 06:02:29.708881 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:29.708943 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:29.708985 28442 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.708987 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:29.709070 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:29.709149 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0927 06:02:29.709299 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0927 06:02:29.709301 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:29.709410 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:29.709475 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:29.709528 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0927 06:02:29.709665 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0927 06:02:29.709680 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }], VpcId: "vpc-1" } I0927 06:02:29.709786 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0927 06:02:29.709834 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:29.709870 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:29.709933 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:29.709983 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:29.710024 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:29.710070 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:29.709668 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0927 06:02:29.710118 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:29.710166 28442 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" } ] } I0927 06:02:29.710259 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:29.710313 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:29.710357 28442 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0927 06:02:29.710489 28442 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0927 06:02:29.710682 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0927 06:02:29.710830 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:29.710897 28442 api.go:53] PageSize not implemented I0927 06:02:29.710824 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0927 06:02:29.710906 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:29.711008 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:29.711159 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:29.711270 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:29.711205 28442 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I0927 06:02:29.711349 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:29.711344 28442 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0927 06:02:29.711485 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:29.711571 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0927 06:02:29.711550 28442 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0927 06:02:29.711639 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0927 06:02:29.711650 28442 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0927 06:02:29.711711 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0927 06:02:29.711977 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.712211 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0927 06:02:29.712318 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.712545 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.712709 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:29.712814 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:29.712970 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.713167 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.713347 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:29.713441 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:29.713527 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:29.713584 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:29.713620 28442 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.713633 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" }] }] } I0927 06:02:29.713681 28442 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I0927 06:02:29.713792 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } W0927 06:02:29.713898 28442 api.go:53] PageSize not implemented I0927 06:02:29.713925 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:29.714007 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.714187 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" }] }] } I0927 06:02:29.714345 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0927 06:02:29.714483 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.714628 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.714755 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.714893 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.715021 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.715149 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.715280 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I0927 06:02:29.715411 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0927 06:02:29.715453 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0927 06:02:29.715491 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0927 06:02:29.715592 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" }] }] } I0927 06:02:29.715727 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0927 06:02:29.715821 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0927 06:02:29.715958 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.716098 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.716222 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.716378 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.716512 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0927 06:02:29.716670 28442 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0927 06:02:29.716857 28442 api.go:53] PageSize not implemented I0927 06:02:29.716827 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:29.716916 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:29.716924 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:29.717024 28442 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:29.716994 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:29.717100 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0927 06:02:29.717139 28442 api.go:53] PageSize not implemented I0927 06:02:29.717225 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:29.717192 28442 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0927 06:02:29.717291 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:29.717340 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0927 06:02:29.717397 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:29.717440 28442 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0927 06:02:29.722743 28442 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0927 06:02:29.723032 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:29.723171 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:29.723313 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:29.723442 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:29.723577 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:29.723756 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0927 06:02:29.724038 28442 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0927 06:02:29.724307 28442 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0927 06:02:29.724670 28442 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0927 06:02:29.724730 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:29.724769 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:29.724837 28442 dns.go:235] Pre-creating DNS records I0927 06:02:29.724862 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:29.731450 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:02:29.735020 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:29.735106 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:29.735169 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:30.497554 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:30.934500 28442 iamrole.go:89] ListRoles: { } I0927 06:02:30.935902 28442 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0927 06:02:30.936189 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:30.936338 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.936694 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.937988 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:30.938849 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.940330 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.940464 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:30.940512 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:30.940572 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:30.944216 28442 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0927 06:02:30.944941 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:30.945261 28442 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0927 06:02:30.945183 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0927 06:02:30.945347 28442 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0927 06:02:30.945367 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0927 06:02:30.945394 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.945489 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0927 06:02:30.945550 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0927 06:02:30.945553 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0927 06:02:30.945580 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:30.945654 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0927 06:02:30.945832 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:30.945888 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] }] } I0927 06:02:30.946043 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:30.946090 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:30.946185 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.946321 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0927 06:02:30.946493 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:30.946544 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.946648 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0927 06:02:30.946767 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.946930 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:30.947012 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:30.947575 28442 executor.go:111] Tasks: 79 done / 142 total; 41 can run W0927 06:02:30.947816 28442 api.go:53] PageSize not implemented I0927 06:02:30.947755 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:30.947866 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:30.947934 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:30.947930 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0927 06:02:30.947994 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } W0927 06:02:30.948033 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:30.948058 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0927 06:02:30.948072 28442 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0927 06:02:30.948121 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0927 06:02:30.948180 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0927 06:02:30.948155 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:30.948246 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0927 06:02:30.948320 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0927 06:02:30.948322 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0927 06:02:30.948497 28442 api.go:53] PageSize not implemented I0927 06:02:30.948538 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:30.949042 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:30.949152 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0927 06:02:30.949226 28442 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0927 06:02:30.949285 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:30.949408 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:30.949531 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0927 06:02:30.949661 28442 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0927 06:02:30.949725 28442 api.go:53] PageSize not implemented I0927 06:02:30.949773 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:30.949782 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:30.949819 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0927 06:02:30.949903 28442 api.go:53] PageSize not implemented I0927 06:02:30.949927 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0927 06:02:30.949910 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:30.949887 28442 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0927 06:02:30.949988 28442 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0927 06:02:30.949971 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:30.950173 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:30.950258 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:30.955654 28442 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0927 06:02:30.955843 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:30.956014 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:30.956187 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:30.956341 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:30.956481 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:30.956970 28442 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0927 06:02:30.957109 28442 api.go:53] PageSize not implemented I0927 06:02:30.957144 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:30.957368 28442 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0927 06:02:30.957675 28442 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0927 06:02:30.961100 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:30.961189 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:30.961231 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:30.961265 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0927 06:02:30.961303 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:30.961338 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:30.961370 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:30.961406 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:30.961443 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:02:30.961478 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:30.961516 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:30.961562 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0927 06:02:30.961600 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0927 06:02:30.961636 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:30.961667 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:30.961700 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:30.961737 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:30.961769 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:30.961806 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:30.961841 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:30.961877 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:30.961912 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0927 06:02:30.961948 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:30.961985 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:30.962021 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:30.962059 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:30.962092 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:30.962125 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:30.962166 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:30.962205 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:30.962244 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:30.963881 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:30.963960 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:30.963981 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:30.964023 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.964085 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0927 06:02:30.964154 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.964221 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.964271 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.964323 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.964369 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.964415 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0927 06:02:30.964496 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.964553 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:30.964582 28442 natgateway.go:117] DescribeNatGateways: { } I0927 06:02:30.964619 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0927 06:02:30.964659 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0927 06:02:30.964712 28442 api.go:53] PageSize not implemented I0927 06:02:30.964730 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0927 06:02:30.964774 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:30.964800 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:30.964815 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0927 06:02:30.964852 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:30.964876 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:30.964893 28442 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I0927 06:02:30.964954 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:30.964993 28442 iamrole.go:89] ListRoles: { } I0927 06:02:30.965046 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:30.965073 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:30.965114 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:30.965159 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:30.965200 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0927 06:02:30.965238 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0927 06:02:30.965274 28442 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0927 06:02:30.965905 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok keypair:key-1 ok I0927 06:02:30.965974 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } autoscaling-group:bastion.privatecalico.example.com ok volume:vol-2 ok autoscaling-config:lt-1 ok I0927 06:02:30.966031 28442 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-config:lt-2 ok I0927 06:02:30.966072 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0927 06:02:30.966116 28442 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } I0927 06:02:30.966150 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } internet-gateway:igw-2 ok iam-instance-profile:nodes.privatecalico.example.com ok I0927 06:02:30.966144 28442 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok I0927 06:02:30.966182 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0927 06:02:30.966142 28442 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } autoscaling-group:nodes.privatecalico.example.com ok I0927 06:02:30.966232 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I0927 06:02:30.966182 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:30.966271 28442 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I0927 06:02:30.966281 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0927 06:02:30.966008 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.privatecalico.example.com ok I0927 06:02:30.966375 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I0927 06:02:30.966288 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0927 06:02:30.966470 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:30.966505 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0927 06:02:30.966552 28442 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0927 06:02:30.966642 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-3 ok I0927 06:02:30.966714 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:30.966790 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W0927 06:02:30.966995 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:30.967026 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0927 06:02:30.967064 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:30.967138 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0927 06:02:30.967372 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:30.967395 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0927 06:02:30.967499 28442 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0927 06:02:30.967517 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0927 06:02:30.967602 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0927 06:02:30.967601 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0927 06:02:30.967622 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0927 06:02:30.967667 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I0927 06:02:30.967666 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0927 06:02:30.967709 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0927 06:02:30.967745 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:30.967776 28442 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0927 06:02:30.967900 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0927 06:02:30.967939 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I0927 06:02:30.967833 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } I0927 06:02:30.967986 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } W0927 06:02:30.968018 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:30.968030 28442 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0927 06:02:30.968041 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0927 06:02:30.968043 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0927 06:02:30.968101 28442 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0927 06:02:30.968196 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0927 06:02:30.968271 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0927 06:02:30.968361 28442 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0927 06:02:30.968451 28442 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (2.51s) === RUN TestLifecyclePrivateKopeio I0927 06:02:30.968944 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:30.969100 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:30.969141 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:30.969183 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:30.969243 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:30.969305 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:30.969351 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:30.969394 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:30.969446 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:30.969479 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0927 06:02:30.999112 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:31.002791 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:31.002882 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:31.002961 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:31.756739 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:31.962933 28442 iamrole.go:89] ListRoles: { } I0927 06:02:31.964964 28442 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0927 06:02:31.965234 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.965349 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0927 06:02:31.965424 28442 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.965528 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0927 06:02:31.965562 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0927 06:02:31.965592 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:31.965632 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:31.965439 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0927 06:02:31.965705 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:31.965780 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0927 06:02:31.965906 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:31.965994 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.965998 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0927 06:02:31.966179 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.966423 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:31.966565 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:31.966553 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0927 06:02:31.966627 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0927 06:02:31.966639 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.966814 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:31.966959 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:31.967007 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.967143 28442 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" }] }] } I0927 06:02:31.967232 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:31.971381 28442 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0927 06:02:31.971622 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0927 06:02:31.971966 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0927 06:02:31.971950 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.972098 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0927 06:02:31.972190 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.972349 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0927 06:02:31.972255 28442 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0927 06:02:31.972313 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0927 06:02:31.972452 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.972637 28442 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0927 06:02:31.972749 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.972687 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0927 06:02:31.972630 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0927 06:02:31.973523 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0927 06:02:31.973591 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0927 06:02:31.973724 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0927 06:02:31.973780 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:31.973801 28442 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0927 06:02:31.973835 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:31.973877 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.973975 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:31.973971 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0927 06:02:31.974079 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:31.974143 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:31.974099 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0927 06:02:31.974114 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0927 06:02:31.974828 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.974918 28442 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0927 06:02:31.975032 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0927 06:02:31.974960 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0927 06:02:31.975086 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.975179 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:31.975278 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:31.975387 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:31.975463 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0927 06:02:31.975588 28442 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.975672 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:31.975764 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:31.975826 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0927 06:02:31.976029 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0927 06:02:31.976069 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0927 06:02:31.976275 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0927 06:02:31.976262 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0927 06:02:31.976364 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:31.976421 28442 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0927 06:02:31.976427 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0927 06:02:31.976181 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0927 06:02:31.976505 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:31.976625 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:31.976686 28442 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0927 06:02:31.976727 28442 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0927 06:02:31.976782 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:31.976883 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:31.976933 28442 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" } ] } I0927 06:02:31.977014 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0927 06:02:31.977065 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:31.977105 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:31.977158 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:31.977197 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:31.977249 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:31.977299 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:31.977343 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:31.977401 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0927 06:02:31.977447 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0927 06:02:31.977489 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0927 06:02:31.977532 28442 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I0927 06:02:31.977655 28442 executor.go:111] Tasks: 81 done / 144 total; 41 can run W0927 06:02:31.977935 28442 api.go:53] PageSize not implemented I0927 06:02:31.977883 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0927 06:02:31.978072 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:31.978091 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:31.978216 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:31.978142 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:31.978289 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0927 06:02:31.978269 28442 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0927 06:02:31.978384 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:31.978441 28442 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0927 06:02:31.978391 28442 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-3" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0927 06:02:31.978368 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0927 06:02:31.978535 28442 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0927 06:02:31.978587 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0927 06:02:31.978752 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0927 06:02:31.978871 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:31.979058 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0927 06:02:31.979147 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.979379 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.979569 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0927 06:02:31.979696 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:31.979830 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:31.979953 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:31.980119 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:31.980248 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0927 06:02:31.980361 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0927 06:02:31.980402 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:31.980437 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I0927 06:02:31.980483 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.980636 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.980790 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0927 06:02:31.980891 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0927 06:02:31.980982 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.981110 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0927 06:02:31.981244 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:31.981289 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0927 06:02:31.981327 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" }] }] } I0927 06:02:31.981505 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.981861 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.982194 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:31.982313 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0927 06:02:31.982395 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.982561 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.982715 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.982883 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.983045 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0927 06:02:31.983206 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.983363 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I0927 06:02:31.983517 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0927 06:02:31.983675 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:31.983717 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.983850 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.983993 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0927 06:02:31.984033 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:31.984077 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:31.984111 28442 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0927 06:02:31.984236 28442 api.go:53] PageSize not implemented I0927 06:02:31.984169 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0927 06:02:31.984262 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:31.984302 28442 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0927 06:02:31.984350 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0927 06:02:31.984391 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0927 06:02:31.984421 28442 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0927 06:02:31.984493 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0927 06:02:31.984542 28442 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0927 06:02:31.984584 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0927 06:02:31.984652 28442 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0927 06:02:31.984711 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:31.984843 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0927 06:02:31.984910 28442 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0927 06:02:31.984951 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:31.984994 28442 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0927 06:02:31.985091 28442 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0927 06:02:31.985155 28442 api.go:53] PageSize not implemented I0927 06:02:31.985222 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:31.985206 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:31.985221 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:31.985393 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:31.985443 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-3" } I0927 06:02:31.985505 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0927 06:02:31.985554 28442 api.go:53] PageSize not implemented I0927 06:02:31.985514 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:31.985616 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:31.985632 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:31.985663 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-2" } I0927 06:02:31.991327 28442 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0927 06:02:31.991523 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:31.991701 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:31.991910 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:31.992077 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:31.992862 28442 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0927 06:02:31.993202 28442 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0927 06:02:31.993552 28442 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0927 06:02:31.993603 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:31.993638 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:31.993706 28442 dns.go:235] Pre-creating DNS records I0927 06:02:31.993733 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:32.000381 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:32.003909 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:32.003997 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:32.004057 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:32.759172 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:32.966651 28442 iamrole.go:89] ListRoles: { } I0927 06:02:32.968752 28442 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0927 06:02:32.969106 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.969473 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.969755 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:32.970264 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.970363 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:32.970392 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:32.970439 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:32.971030 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.971616 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:32.973117 28442 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0927 06:02:32.973273 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.973389 28442 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0927 06:02:32.973439 28442 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0927 06:02:32.973467 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0927 06:02:32.973431 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0927 06:02:32.973404 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0927 06:02:32.973517 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0927 06:02:32.973584 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0927 06:02:32.973619 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0927 06:02:32.973932 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:32.974012 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.974172 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:32.974237 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:32.974358 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.974624 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.974866 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0927 06:02:32.974944 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.975136 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.975300 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:32.975348 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:32.975438 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0927 06:02:32.975567 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.975671 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.975774 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:32.975844 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0927 06:02:32.975960 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:32.976018 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:32.976131 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:32.976241 28442 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0927 06:02:32.976342 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0927 06:02:32.976435 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0927 06:02:32.976551 28442 api.go:53] PageSize not implemented I0927 06:02:32.976563 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:32.976580 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:32.976667 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:32.976628 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:32.976727 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:32.976725 28442 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0927 06:02:32.976753 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0927 06:02:32.976797 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0927 06:02:32.976836 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0927 06:02:32.976646 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:32.976878 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0927 06:02:32.976917 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W0927 06:02:32.977008 28442 api.go:53] PageSize not implemented I0927 06:02:32.977031 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:32.977058 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:32.977189 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:32.977397 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:32.977576 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:32.977679 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0927 06:02:32.978305 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:32.978558 28442 executor.go:111] Tasks: 122 done / 144 total; 7 can run I0927 06:02:32.978655 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0927 06:02:32.978711 28442 api.go:53] PageSize not implemented I0927 06:02:32.978737 28442 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0927 06:02:32.978657 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:32.978763 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:32.978794 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:32.978888 28442 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0927 06:02:32.978918 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:32.978807 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:32.978986 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } W0927 06:02:32.979040 28442 api.go:53] PageSize not implemented I0927 06:02:32.979086 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:32.988478 28442 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0927 06:02:32.988716 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:32.988908 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:32.988990 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:32.989152 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:32.989701 28442 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0927 06:02:32.989799 28442 api.go:53] PageSize not implemented I0927 06:02:32.989821 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:32.990015 28442 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0927 06:02:32.990240 28442 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0927 06:02:32.993648 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:32.993720 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:32.993769 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:32.993808 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:32.993843 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:32.993880 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:32.993915 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:32.993954 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:02:32.993990 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:32.994030 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:32.994079 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0927 06:02:32.994120 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:32.994157 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:32.994194 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:32.994234 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:32.994268 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:32.994308 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0927 06:02:32.994346 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:32.994383 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:32.994421 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:32.994484 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0927 06:02:32.994526 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:32.994566 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:32.994600 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:32.994641 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0927 06:02:32.994682 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0927 06:02:32.994722 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:32.994756 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:32.994791 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:32.994830 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:32.994870 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:32.994908 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:32.996576 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:32.996650 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:32.996672 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:32.996716 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.996779 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0927 06:02:32.996868 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.996969 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.997055 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.997148 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.997223 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.997308 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0927 06:02:32.997419 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.997515 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:32.997553 28442 natgateway.go:117] DescribeNatGateways: { } I0927 06:02:32.997592 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0927 06:02:32.997637 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0927 06:02:32.997693 28442 api.go:53] PageSize not implemented I0927 06:02:32.997711 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0927 06:02:32.997753 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:32.997800 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:32.997818 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0927 06:02:32.997859 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:32.997885 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:32.997902 28442 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I0927 06:02:32.997969 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:32.998013 28442 iamrole.go:89] ListRoles: { } I0927 06:02:32.998063 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:32.998094 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:32.998142 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:32.998189 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:32.998239 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-3","rtb-2"] } I0927 06:02:32.998284 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0927 06:02:32.998318 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I0927 06:02:32.998968 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } autoscaling-group:nodes.privatekopeio.example.com ok I0927 06:02:32.998981 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } volume:vol-2 ok I0927 06:02:32.998988 28442 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0927 06:02:32.999059 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok iam-instance-profile:masters.privatekopeio.example.com ok I0927 06:02:32.999062 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:32.999110 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0927 06:02:32.999200 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok I0927 06:02:32.999173 28442 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } load-balancer:api-privatekopeio-example-tl2bv8 ok I0927 06:02:32.999223 28442 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I0927 06:02:32.999104 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:32.999151 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 } ] } route53-record:Z1AFAKE1ZON3YO/A/api.privatekopeio.example.com ok autoscaling-group:bastion.privatekopeio.example.com ok W0927 06:02:32.999353 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:32.999373 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok autoscaling-config:lt-1 ok autoscaling-config:lt-3 ok I0927 06:02:32.999386 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0927 06:02:32.999436 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0927 06:02:32.999451 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I0927 06:02:32.999496 28442 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0927 06:02:32.999558 28442 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0927 06:02:32.999603 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I0927 06:02:32.999669 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:32.999719 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0927 06:02:32.999840 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:32.999862 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0927 06:02:32.999897 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:32.999945 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0927 06:02:33.000137 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:33.000151 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0927 06:02:33.000249 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0927 06:02:33.000285 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0927 06:02:33.000363 28442 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0927 06:02:33.000311 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:33.000380 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0927 06:02:33.000419 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I0927 06:02:33.000461 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0927 06:02:33.000507 28442 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0927 06:02:33.000520 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0927 06:02:33.000549 28442 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0927 06:02:33.000589 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0927 06:02:33.000630 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0927 06:02:33.000425 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0927 06:02:33.000643 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } W0927 06:02:33.000668 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:33.000678 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0927 06:02:33.000709 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0927 06:02:33.000789 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0927 06:02:33.000884 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0927 06:02:33.000971 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0927 06:02:33.001104 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0927 06:02:33.001229 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0927 06:02:33.001339 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0927 06:02:33.001440 28442 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0927 06:02:33.001530 28442 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (2.03s) === RUN TestLifecycleIPv6 I0927 06:02:33.002017 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:33.002153 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:33.002192 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:33.002234 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:33.002279 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:33.002331 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:33.002373 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:33.002405 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:33.002446 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:33.002476 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0927 06:02:33.031558 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:02:33.035630 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:33.035721 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:33.807678 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:34.002219 28442 iamrole.go:89] ListRoles: { } I0927 06:02:34.004414 28442 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0927 06:02:34.004854 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0927 06:02:34.004989 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:34.005027 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] } I0927 06:02:34.005223 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.005599 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.005791 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0927 06:02:34.005810 28442 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0927 06:02:34.005937 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:34.005910 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0927 06:02:34.006134 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.006343 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:34.006425 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.006434 28442 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }] } I0927 06:02:34.006601 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0927 06:02:34.006668 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0927 06:02:34.006725 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:34.006810 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:34.006874 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:34.007119 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:34.007197 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] }] } I0927 06:02:34.007426 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:34.007570 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:34.008545 28442 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0927 06:02:34.008790 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0927 06:02:34.008783 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.008888 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0927 06:02:34.008937 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.008960 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0927 06:02:34.009056 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0927 06:02:34.009150 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0927 06:02:34.009132 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0927 06:02:34.009155 28442 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0927 06:02:34.009188 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:34.009341 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:34.009319 28442 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0927 06:02:34.009433 28442 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0927 06:02:34.009392 28442 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0927 06:02:34.009515 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0927 06:02:34.009631 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:34.009684 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:34.009716 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0927 06:02:34.009728 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.009863 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0927 06:02:34.009968 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0927 06:02:34.010015 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0927 06:02:34.010158 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:34.010218 28442 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" } ] } I0927 06:02:34.010323 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:34.010442 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:34.010507 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:34.010573 28442 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.010682 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:34.010792 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:34.010883 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0927 06:02:34.011031 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.011193 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.010935 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0927 06:02:34.011339 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:34.011409 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0927 06:02:34.011577 28442 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0927 06:02:34.011582 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:34.011628 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:34.011742 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:34.011813 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:34.011861 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:34.011990 28442 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0927 06:02:34.012057 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0927 06:02:34.012123 28442 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0927 06:02:34.012254 28442 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0927 06:02:34.012401 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:34.012524 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.012632 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:34.012721 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0927 06:02:34.012820 28442 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.012834 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0927 06:02:34.013105 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.013263 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:34.013322 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:34.013436 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.013658 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.013806 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.013939 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:34.014021 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.014108 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:34.014173 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I0927 06:02:34.014222 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.014310 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.014296 28442 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.014313 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0927 06:02:34.014406 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.014467 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0927 06:02:34.014529 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.014622 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:34.014694 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:34.014556 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I0927 06:02:34.014729 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:34.014672 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:34.014765 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0927 06:02:34.014903 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.015048 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" }] }] } I0927 06:02:34.015173 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0927 06:02:34.015274 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.015393 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.015514 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.015641 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I0927 06:02:34.015684 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.015834 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0927 06:02:34.015929 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.016073 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" }] }] } I0927 06:02:34.016201 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0927 06:02:34.016262 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" }] }] } I0927 06:02:34.016404 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0927 06:02:34.016494 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0927 06:02:34.016540 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.016668 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I0927 06:02:34.016818 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:34.016872 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:34.016923 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0927 06:02:34.016970 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:34.017011 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0927 06:02:34.017059 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0927 06:02:34.017110 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0927 06:02:34.017155 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0927 06:02:34.017198 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0927 06:02:34.017240 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0927 06:02:34.017308 28442 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0927 06:02:34.017392 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:34.017451 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:34.017542 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:34.017486 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:34.017668 28442 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-5" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0927 06:02:34.017751 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0927 06:02:34.017834 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I0927 06:02:34.017881 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0927 06:02:34.017923 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-5" } I0927 06:02:34.017958 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:34.018091 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0927 06:02:34.018134 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-6" } I0927 06:02:34.018168 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:34.018247 28442 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } I0927 06:02:34.018370 28442 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.018395 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:34.018531 28442 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-5"] }] } I0927 06:02:34.018612 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:34.018680 28442 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-5", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0927 06:02:34.018760 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0927 06:02:34.018808 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0927 06:02:34.018867 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0927 06:02:34.018919 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0927 06:02:34.018965 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:34.019036 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0927 06:02:34.019086 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0927 06:02:34.019131 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0927 06:02:34.019171 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:34.019234 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0927 06:02:34.019297 28442 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0927 06:02:34.019362 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0927 06:02:34.019391 28442 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0927 06:02:34.019443 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } W0927 06:02:34.019467 28442 api.go:53] PageSize not implemented I0927 06:02:34.019498 28442 tags.go:42] CreateTags { Resources: ["subnet-5"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0927 06:02:34.019583 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0927 06:02:34.019628 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0927 06:02:34.019668 28442 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0927 06:02:34.019745 28442 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0927 06:02:34.019829 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:34.019883 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:34.019905 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0927 06:02:34.019840 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:34.019914 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:34.020046 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:34.020123 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:34.020077 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:34.020075 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I0927 06:02:34.020149 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0927 06:02:34.020183 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:34.020213 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:34.020304 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:34.020353 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0927 06:02:34.020408 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:34.020543 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I0927 06:02:34.020591 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:34.020707 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0927 06:02:34.029705 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:02:34.030050 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:34.030194 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:34.030337 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:34.030495 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:34.031020 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:02:34.031400 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:02:34.031678 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:02:34.031738 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:34.031775 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:34.031845 28442 dns.go:235] Pre-creating DNS records I0927 06:02:34.031869 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:34.039770 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0927 06:02:34.043595 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:34.043686 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:34.802840 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:34.993794 28442 iamrole.go:89] ListRoles: { } I0927 06:02:34.995966 28442 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0927 06:02:34.996228 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.996560 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.996765 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:34.997304 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.997666 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:34.997965 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:34.998084 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:34.998119 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:34.998174 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:35.000373 28442 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0927 06:02:35.000494 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0927 06:02:35.000543 28442 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0927 06:02:35.000506 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.000581 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0927 06:02:35.000725 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0927 06:02:35.000664 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0927 06:02:35.000793 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0927 06:02:35.000828 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0927 06:02:35.001042 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:35.001145 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.001290 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:35.001350 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0927 06:02:35.001516 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:35.001633 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:35.001729 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.001855 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] }] } I0927 06:02:35.001989 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.002110 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:35.002392 28442 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0927 06:02:35.002585 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:35.002708 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:35.002807 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.002981 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:35.003038 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0927 06:02:35.003088 28442 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0927 06:02:35.003130 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0927 06:02:35.003210 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:35.003374 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.003515 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:35.003604 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.003738 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0927 06:02:35.003959 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] }] } I0927 06:02:35.004143 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0927 06:02:35.004335 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] }] } I0927 06:02:35.004514 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:35.004571 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:35.004650 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:35.004718 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] }] } I0927 06:02:35.004820 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:35.004900 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0927 06:02:35.004938 28442 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0927 06:02:35.004982 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0927 06:02:35.005069 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0927 06:02:35.005190 28442 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0927 06:02:35.005284 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:35.005338 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:35.005424 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:35.005392 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:35.005445 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0927 06:02:35.005504 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0927 06:02:35.005489 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:35.005546 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0927 06:02:35.005611 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0927 06:02:35.005648 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0927 06:02:35.005688 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0927 06:02:35.005710 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0927 06:02:35.005761 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0927 06:02:35.005817 28442 api.go:53] PageSize not implemented I0927 06:02:35.005852 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:35.005937 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:35.006020 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:35.006099 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:35.006213 28442 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0927 06:02:35.006292 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:35.006349 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:35.006294 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:35.006369 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0927 06:02:35.006310 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:35.006460 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:35.006523 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:35.006528 28442 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0927 06:02:35.006471 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:35.006544 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0927 06:02:35.006564 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:35.006595 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:35.006637 28442 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0927 06:02:35.006712 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:35.006688 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0927 06:02:35.006765 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0927 06:02:35.006911 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:35.006948 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0927 06:02:35.012188 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:02:35.012306 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:35.012456 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:35.012561 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:35.012722 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:35.013221 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:02:35.013446 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:02:35.013749 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:02:35.017099 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:35.017169 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:35.017216 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:35.017253 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0927 06:02:35.017290 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0927 06:02:35.017328 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:35.017364 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0927 06:02:35.017401 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:35.017436 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:35.017471 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:35.017508 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:02:35.017545 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:35.017585 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:35.017631 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0927 06:02:35.017670 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0927 06:02:35.017707 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:35.017742 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:35.017776 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:35.017845 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:35.017881 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:35.017919 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0927 06:02:35.017957 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:35.017994 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:35.018030 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:35.018066 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:35.018106 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:35.018141 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:35.018182 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0927 06:02:35.018220 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0927 06:02:35.018258 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0927 06:02:35.018298 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0927 06:02:35.018335 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:35.018373 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:35.018408 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:35.018447 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:35.018485 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:35.018523 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:35.020593 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:35.020662 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:35.020682 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:35.020725 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.020783 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0927 06:02:35.020845 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.020906 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.020960 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.021017 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.021068 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.021138 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0927 06:02:35.021210 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.021289 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:35.021322 28442 natgateway.go:117] DescribeNatGateways: { } I0927 06:02:35.021368 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0927 06:02:35.021413 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0927 06:02:35.021468 28442 api.go:53] PageSize not implemented I0927 06:02:35.021487 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:35.021513 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:35.021528 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0927 06:02:35.021567 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:35.021591 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:35.021607 28442 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" ] } I0927 06:02:35.021671 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:35.021712 28442 iamrole.go:89] ListRoles: { } I0927 06:02:35.021761 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:35.021788 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:35.021828 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:35.021876 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:35.021926 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-3","rtb-1"] } I0927 06:02:35.021972 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0927 06:02:35.022011 28442 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0927 06:02:35.022048 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0927 06:02:35.022079 28442 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0927 06:02:35.022718 28442 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok egress-only-internet-gateway:eigw-2 ok I0927 06:02:35.022786 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } autoscaling-group:nodes.minimal-ipv6.example.com ok I0927 06:02:35.022847 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0927 06:02:35.022797 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I0927 06:02:35.022904 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0927 06:02:35.022949 28442 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok iam-instance-profile:nodes.minimal-ipv6.example.com ok I0927 06:02:35.022983 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:35.023022 28442 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0927 06:02:35.023065 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0927 06:02:35.022913 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/kops-controller.internal.minimal-ipv6.example.com. ok I0927 06:02:35.023144 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } iam-instance-profile:masters.minimal-ipv6.example.com ok I0927 06:02:35.023061 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0927 06:02:35.023388 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:35.023415 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0927 06:02:35.023488 28442 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0927 06:02:35.023591 28442 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0927 06:02:35.023635 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:35.023696 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0927 06:02:35.023849 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:35.023866 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0927 06:02:35.023910 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0927 06:02:35.023973 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0927 06:02:35.024031 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0927 06:02:35.024090 28442 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I0927 06:02:35.024152 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I0927 06:02:35.024209 28442 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0927 06:02:35.024261 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:35.024310 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0927 06:02:35.024424 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0927 06:02:35.024478 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0927 06:02:35.024537 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0927 06:02:35.024637 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0927 06:02:35.024547 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0927 06:02:35.024714 28442 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0927 06:02:35.024697 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0927 06:02:35.024742 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0927 06:02:35.024764 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0927 06:02:35.024770 28442 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } I0927 06:02:35.024803 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } elastic-ip:eipalloc-2 ok iam-role:nodes.minimal-ipv6.example.com ok I0927 06:02:35.024830 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0927 06:02:35.024861 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } I0927 06:02:35.024848 28442 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } iam-role:masters.minimal-ipv6.example.com ok elastic-ip:eipalloc-1 ok I0927 06:02:35.024962 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0927 06:02:35.025026 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0927 06:02:35.025106 28442 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0927 06:02:35.025191 28442 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (2.02s) === RUN TestLifecycleSharedVPC I0927 06:02:35.025671 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:35.025808 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:35.025847 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:35.025891 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:35.025932 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:35.025980 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:35.026024 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:35.026057 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:35.026095 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:35.026124 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0927 06:02:35.050896 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:35.054030 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:35.054118 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:35.840407 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:36.031182 28442 iamrole.go:89] ListRoles: { } I0927 06:02:36.033170 28442 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0927 06:02:36.033630 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:02:36.033760 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0927 06:02:36.033799 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0927 06:02:36.033729 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0927 06:02:36.033855 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0927 06:02:36.033948 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0927 06:02:36.034049 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0927 06:02:36.034190 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:36.034373 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:36.034374 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:36.034649 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:36.034876 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] }] } I0927 06:02:36.035076 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:36.035218 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:36.035491 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:36.035662 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0927 06:02:36.037628 28442 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0927 06:02:36.037841 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:02:36.037975 28442 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0927 06:02:36.037997 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:36.038138 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0927 06:02:36.038198 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0927 06:02:36.038286 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0927 06:02:36.038284 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0927 06:02:36.038376 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0927 06:02:36.038460 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0927 06:02:36.038540 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:36.038652 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0927 06:02:36.038740 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0927 06:02:36.038777 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" } ] }], VpcId: "vpc-12345678" } I0927 06:02:36.038896 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:36.038948 28442 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0927 06:02:36.039063 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:36.039116 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:36.039166 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:36.039264 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:36.039317 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:36.039358 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:36.039451 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:36.039491 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:36.040157 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0927 06:02:36.044513 28442 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0927 06:02:36.044812 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0927 06:02:36.045072 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:36.045264 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0927 06:02:36.045423 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0927 06:02:36.045676 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" }] }] } I0927 06:02:36.045923 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:36.046031 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" }] }] } I0927 06:02:36.046188 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:36.046265 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:36.046390 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:36.046535 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0927 06:02:36.046729 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0927 06:02:36.046878 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" }] }] } I0927 06:02:36.047015 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0927 06:02:36.047146 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0927 06:02:36.047284 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0927 06:02:36.047414 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0927 06:02:36.047462 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0927 06:02:36.047594 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0927 06:02:36.047723 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0927 06:02:36.047772 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0927 06:02:36.047837 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:36.047891 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:36.047941 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0927 06:02:36.048080 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0927 06:02:36.049647 28442 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0927 06:02:36.050391 28442 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0927 06:02:36.051446 28442 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0927 06:02:36.051559 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:36.051617 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:36.051704 28442 dns.go:235] Pre-creating DNS records I0927 06:02:36.051756 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:36.059303 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:36.062807 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:36.062902 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:36.814611 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:36.997435 28442 iamrole.go:89] ListRoles: { } I0927 06:02:36.998607 28442 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0927 06:02:36.999424 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.001155 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.001315 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:02:37.001385 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0927 06:02:37.001417 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0927 06:02:37.001718 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:37.002516 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:37.007270 28442 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0927 06:02:37.007421 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.007629 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0927 06:02:37.007699 28442 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0927 06:02:37.007686 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0927 06:02:37.007961 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:37.008058 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:02:37.008180 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0927 06:02:37.008325 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:37.008387 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] }] } I0927 06:02:37.008585 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:37.013818 28442 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0927 06:02:37.013951 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:37.014108 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:37.014237 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:37.014411 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:37.014977 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:37.015161 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:37.015326 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:37.016086 28442 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0927 06:02:37.016328 28442 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0927 06:02:37.016653 28442 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0927 06:02:37.019381 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:37.019449 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:37.019487 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:37.019521 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:37.019556 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:37.019590 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:02:37.019628 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:37.019671 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:37.019709 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:37.019742 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:37.019774 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:37.019811 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:37.019841 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:37.019877 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:37.019910 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:37.019948 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:37.019982 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:37.020015 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:37.020047 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:37.020086 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:37.020126 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:37.021541 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:37.021629 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:37.021651 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:37.021698 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.021751 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0927 06:02:37.021807 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.021869 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.021910 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.021951 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.021994 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.022032 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0927 06:02:37.022077 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.022132 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0927 06:02:37.022170 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0927 06:02:37.022219 28442 api.go:53] PageSize not implemented I0927 06:02:37.022241 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:37.022270 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:37.022289 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:37.022314 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:37.022334 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0927 06:02:37.022400 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:37.022443 28442 iamrole.go:89] ListRoles: { } I0927 06:02:37.022494 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:37.022524 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:37.022568 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:37.022606 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:37.022635 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:nodes.sharedvpc.example.com ok autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I0927 06:02:37.023044 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0927 06:02:37.023080 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0927 06:02:37.023113 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I0927 06:02:37.023172 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } volume:vol-2 ok iam-instance-profile:nodes.sharedvpc.example.com ok I0927 06:02:37.023227 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0927 06:02:37.023277 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok I0927 06:02:37.023254 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:37.023176 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedvpc.example.com. ok I0927 06:02:37.023369 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0927 06:02:37.023511 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:37.023537 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0927 06:02:37.023577 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I0927 06:02:37.023673 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:37.023745 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0927 06:02:37.023945 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:37.023967 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0927 06:02:37.024054 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0927 06:02:37.024085 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0927 06:02:37.024177 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0927 06:02:37.024197 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0927 06:02:37.024243 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0927 06:02:37.024288 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0927 06:02:37.024377 28442 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0927 06:02:37.024394 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0927 06:02:37.024430 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0927 06:02:37.024524 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (2.00s) === RUN TestLifecycleComplex I0927 06:02:37.024987 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:37.025120 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:37.025158 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:37.025212 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:37.025255 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:37.025308 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:37.025352 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:37.025382 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:37.025421 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:37.025450 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0927 06:02:37.062095 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:37.066247 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:37.066346 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:37.834955 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:38.043549 28442 iamrole.go:89] ListRoles: { } I0927 06:02:38.045779 28442 executor.go:111] Tasks: 0 done / 135 total; 51 can run W0927 06:02:38.046009 28442 api.go:53] PageSize not implemented I0927 06:02:38.046097 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:38.046199 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:38.046223 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0927 06:02:38.046334 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0927 06:02:38.046372 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.046589 28442 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0927 06:02:38.046749 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:38.046819 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0927 06:02:38.046848 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0927 06:02:38.046963 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.046986 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0927 06:02:38.047173 28442 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0927 06:02:38.047242 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.047495 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:38.047676 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:38.047736 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.047935 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:38.048091 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:38.048147 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:38.048271 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0927 06:02:38.048309 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0927 06:02:38.048335 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:38.048376 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:38.048421 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0927 06:02:38.049719 28442 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0927 06:02:38.049897 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:38.049930 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:38.050042 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:38.050015 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:38.050113 28442 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0927 06:02:38.050128 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0927 06:02:38.050182 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:38.050142 28442 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0927 06:02:38.050231 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:38.050308 28442 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:38.050351 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:38.050404 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:38.050581 28442 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0927 06:02:38.050599 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:38.050704 28442 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:38.050797 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0927 06:02:38.050833 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.051013 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0927 06:02:38.051096 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.051165 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0927 06:02:38.051284 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0927 06:02:38.051535 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:38.051486 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0927 06:02:38.051631 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.051751 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0927 06:02:38.051863 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0927 06:02:38.051845 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:38.052103 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.052281 28442 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0927 06:02:38.052380 28442 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0927 06:02:38.052428 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:38.052523 28442 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0927 06:02:38.052569 28442 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0927 06:02:38.052303 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0927 06:02:38.052625 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:38.052750 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.052846 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:38.052950 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:38.052918 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:38.053029 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:38.053096 28442 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I0927 06:02:38.053234 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0927 06:02:38.053352 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:38.053407 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:38.053471 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:38.053593 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:38.053641 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:38.053682 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:38.053738 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:38.053799 28442 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] } I0927 06:02:38.053930 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:38.053984 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:38.054047 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:38.054180 28442 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0927 06:02:38.054326 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:38.054434 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0927 06:02:38.054792 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0927 06:02:38.054939 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0927 06:02:38.055188 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" } ] }] } I0927 06:02:38.055425 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" } ] }] } I0927 06:02:38.055652 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0927 06:02:38.055826 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0927 06:02:38.055877 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0927 06:02:38.055991 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" } ] }] } I0927 06:02:38.056156 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:38.056241 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:38.056322 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:38.056429 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:38.056510 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:38.056575 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0927 06:02:38.056545 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0927 06:02:38.056706 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0927 06:02:38.056861 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:38.056932 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0927 06:02:38.057082 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0927 06:02:38.057180 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0927 06:02:38.057332 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0927 06:02:38.057428 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0927 06:02:38.057572 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0927 06:02:38.057712 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0927 06:02:38.057827 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0927 06:02:38.057979 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0927 06:02:38.058066 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0927 06:02:38.058113 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0927 06:02:38.058262 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0927 06:02:38.058299 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0927 06:02:38.058338 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0927 06:02:38.058482 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-1", TransitGatewayId: "tgw-0123456" } I0927 06:02:38.058534 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0927 06:02:38.058634 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0927 06:02:38.058779 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0927 06:02:38.058878 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0927 06:02:38.058977 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0927 06:02:38.059125 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0927 06:02:38.059266 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-1", TransitGatewayId: "tgw-123456" } I0927 06:02:38.059316 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0927 06:02:38.059356 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0927 06:02:38.059396 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0927 06:02:38.059450 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:38.059532 28442 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0927 06:02:38.059613 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:38.059642 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:38.059732 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:38.059752 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0927 06:02:38.059798 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0927 06:02:38.059856 28442 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-1" }], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ], Type: "network" } I0927 06:02:38.059979 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:38.060039 28442 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0927 06:02:38.060142 28442 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0927 06:02:38.060217 28442 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0927 06:02:38.060292 28442 api.go:53] PageSize not implemented I0927 06:02:38.060353 28442 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0927 06:02:38.060428 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:38.060496 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:38.060568 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:38.060574 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:38.060593 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:38.060677 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:38.060875 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:38.060937 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:38.060889 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:38.060959 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:38.066518 28442 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0927 06:02:38.066749 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:38.066883 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:38.066954 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:38.067095 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:38.067926 28442 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0927 06:02:38.068240 28442 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0927 06:02:38.068617 28442 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0927 06:02:38.068674 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:38.068710 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:38.068780 28442 dns.go:235] Pre-creating DNS records I0927 06:02:38.068805 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:38.076987 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:38.083690 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:38.083937 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:38.840959 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:39.050818 28442 iamrole.go:89] ListRoles: { } I0927 06:02:39.052799 28442 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0927 06:02:39.052998 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:39.053156 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0927 06:02:39.053323 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:39.053535 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0927 06:02:39.053676 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:39.053842 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:39.053898 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:39.053999 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:39.054189 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:39.054281 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:39.055099 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0927 06:02:39.055471 28442 api.go:53] PageSize not implemented I0927 06:02:39.055530 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:39.056664 28442 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0927 06:02:39.056755 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:39.056934 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:39.056866 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:39.056985 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:39.057005 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:39.057014 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:39.057094 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:39.057189 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:39.057135 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:39.057230 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:39.057334 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:39.057323 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:39.057375 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:39.057429 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:39.057614 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:39.057673 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:39.057867 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:39.057938 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:39.058033 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:39.058179 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:39.058227 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:39.058289 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0927 06:02:39.058440 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:39.058539 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:39.058681 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:39.058834 28442 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0927 06:02:39.059042 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:39.059132 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:39.059294 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:39.059382 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:39.059559 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:39.059777 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:39.059871 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:39.060271 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:39.060602 28442 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0927 06:02:39.060688 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:39.060757 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:39.060776 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:39.060826 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:39.060865 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:39.060734 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:39.060907 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:39.060943 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:39.060976 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0927 06:02:39.061072 28442 api.go:53] PageSize not implemented I0927 06:02:39.061140 28442 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0927 06:02:39.061216 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:39.061295 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:39.061231 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:39.061402 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:39.061317 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:39.061432 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:39.061526 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:39.061548 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:39.061572 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:39.061632 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:39.061682 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:39.061706 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:39.061860 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:39.061912 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:39.071562 28442 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0927 06:02:39.071852 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:39.072070 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:39.072273 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:39.072446 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:39.073058 28442 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0927 06:02:39.073368 28442 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0927 06:02:39.073600 28442 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0927 06:02:39.079904 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:39.084170 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:39.096376 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:39.100455 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:39.100550 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:39.874713 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:40.071139 28442 iamrole.go:89] ListRoles: { } I0927 06:02:40.072530 28442 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0927 06:02:40.072769 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:40.074815 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:40.075330 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0927 06:02:40.076523 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0927 06:02:40.076921 28442 api.go:53] PageSize not implemented I0927 06:02:40.077027 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:40.078285 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:40.078972 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:40.079014 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:40.079082 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:40.079126 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0927 06:02:40.079260 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:40.079681 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:40.081760 28442 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0927 06:02:40.081973 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:40.082173 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:40.082141 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:40.082227 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:40.082163 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:40.082333 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:40.082283 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:40.082425 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:40.082495 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:40.082550 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:40.082584 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:40.082632 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:40.082652 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:40.082872 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:40.082930 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:40.083029 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:40.083118 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:40.083212 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:40.083357 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:40.083506 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:40.083564 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:40.083711 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:40.083870 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0927 06:02:40.084035 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:40.084084 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:40.084257 28442 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0927 06:02:40.084497 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:40.084606 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:40.084759 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:40.084950 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:40.085415 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:40.085609 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:40.085707 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:40.085947 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:40.086185 28442 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0927 06:02:40.086272 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:40.086341 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:40.086288 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:40.086359 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:40.086406 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:40.086444 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:40.086484 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:40.086519 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:40.086552 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:40.086732 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0927 06:02:40.086774 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:40.086806 28442 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0927 06:02:40.086839 28442 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0927 06:02:40.086873 28442 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0927 06:02:40.086969 28442 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0927 06:02:40.087039 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:40.087087 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0927 06:02:40.087132 28442 api.go:53] PageSize not implemented I0927 06:02:40.087180 28442 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0927 06:02:40.087254 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:40.087334 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:40.087254 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0927 06:02:40.087360 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0927 06:02:40.087418 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:40.087433 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:40.087450 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:40.087635 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:40.087669 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:40.087756 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:40.087803 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:40.087858 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:40.087911 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:40.087925 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:40.093856 28442 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0927 06:02:40.093978 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:40.094127 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:40.094308 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:40.094466 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:40.095147 28442 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0927 06:02:40.095356 28442 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0927 06:02:40.095605 28442 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0927 06:02:40.095676 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:40.095733 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:40.095835 28442 dns.go:235] Pre-creating DNS records I0927 06:02:40.103988 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:40.108371 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:40.108494 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:40.872748 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:41.087297 28442 iamrole.go:89] ListRoles: { } I0927 06:02:41.089236 28442 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0927 06:02:41.089579 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:41.089638 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:41.090048 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0927 06:02:41.090216 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:41.090671 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:41.090990 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0927 06:02:41.091047 28442 api.go:53] PageSize not implemented I0927 06:02:41.091190 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0927 06:02:41.091393 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0927 06:02:41.091582 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:41.091690 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:41.091722 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:41.091783 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:41.092970 28442 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0927 06:02:41.093098 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:41.093114 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:41.093231 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:41.093282 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:41.093304 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:41.093115 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:41.093404 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:41.093422 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:41.093548 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:41.093614 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:41.093642 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:41.093709 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:41.093859 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:41.093960 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:41.094112 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:41.094158 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:41.094245 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:41.094334 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:41.094474 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:41.094690 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:41.094740 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:41.094834 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:41.094880 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:41.094991 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:41.095181 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:41.095308 28442 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0927 06:02:41.095434 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:41.095540 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:41.095755 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:41.096087 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:41.096397 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:41.096619 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:41.096774 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:41.096837 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:41.097008 28442 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0927 06:02:41.097127 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:41.097236 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:41.097263 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:41.097127 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:41.097319 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:41.097388 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:41.097442 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:41.097478 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:41.097511 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0927 06:02:41.097610 28442 api.go:53] PageSize not implemented I0927 06:02:41.097674 28442 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0927 06:02:41.097755 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:41.097851 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:41.097798 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:41.097914 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:41.097880 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:41.097921 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:41.098028 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:41.098057 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:41.098088 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:41.098165 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:41.098194 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:41.099299 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:41.099396 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:41.099427 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:41.107801 28442 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0927 06:02:41.107937 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:41.108098 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:41.108271 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:41.108512 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:41.109211 28442 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0927 06:02:41.109524 28442 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0927 06:02:41.109804 28442 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0927 06:02:41.113540 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:41.117128 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:41.129515 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:41.133740 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:41.133838 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:42.166099 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:42.369926 28442 iamrole.go:89] ListRoles: { } I0927 06:02:42.372098 28442 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0927 06:02:42.372432 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0927 06:02:42.372697 28442 api.go:53] PageSize not implemented I0927 06:02:42.372690 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.372818 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:42.372973 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.373159 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:42.373209 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:42.373298 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:42.373351 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.373544 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.373684 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:42.373837 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0927 06:02:42.373930 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0927 06:02:42.374083 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:42.376087 28442 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0927 06:02:42.376315 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:42.376345 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:42.376492 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:42.376544 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:42.376480 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:42.376623 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:42.376664 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:42.376614 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:42.376720 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:42.376765 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.376853 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:42.376996 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:42.377017 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:42.377068 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:42.377309 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:42.377390 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.377534 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.377666 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:42.377759 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:42.377963 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:42.378017 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:42.378160 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.378323 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:42.378373 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.378511 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:42.378690 28442 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0927 06:02:42.378932 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:42.379024 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:42.379171 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:42.379441 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:42.379615 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:42.379904 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:42.380134 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:42.380488 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:42.380616 28442 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0927 06:02:42.380706 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:42.380747 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:42.380835 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:42.380855 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:42.380899 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:42.380940 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:42.380980 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:42.381018 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:42.381050 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0927 06:02:42.381173 28442 api.go:53] PageSize not implemented I0927 06:02:42.381237 28442 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0927 06:02:42.381287 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:42.381335 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:42.381353 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:42.381380 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:42.381441 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:42.381529 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:42.381526 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:42.381553 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:42.381623 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:42.381502 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:42.381658 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:42.381699 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:42.381774 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:42.381817 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:42.387157 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:02:42.387275 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:42.387427 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:42.387603 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:42.387771 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:42.388213 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:42.388280 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:42.388630 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:02:42.388886 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:02:42.389194 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:02:42.389250 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:42.389288 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:42.389355 28442 dns.go:235] Pre-creating DNS records I0927 06:02:42.397369 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:42.401594 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:42.401691 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:43.650032 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:43.857865 28442 iamrole.go:89] ListRoles: { } I0927 06:02:43.859851 28442 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0927 06:02:43.860323 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.860647 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.860856 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W0927 06:02:43.861349 28442 api.go:53] PageSize not implemented I0927 06:02:43.861491 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:43.861627 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.861822 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0927 06:02:43.861988 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:43.862174 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:43.862201 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0927 06:02:43.862384 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.862568 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:43.862626 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:43.862732 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:43.864204 28442 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0927 06:02:43.864332 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:43.864421 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:43.864531 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:43.864603 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:43.864607 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:43.864651 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:43.864730 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:43.864792 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:43.864838 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.864864 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:43.865053 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:43.865105 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:43.865159 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:43.865163 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:43.865236 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:43.865409 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:43.865463 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.865645 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.865802 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:43.865849 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.865957 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:43.866029 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:43.866159 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.866258 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:43.866305 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:43.866502 28442 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0927 06:02:43.866847 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:43.866952 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:43.867131 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:43.867297 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:43.867448 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:43.867537 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:43.867745 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:43.867904 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:43.868236 28442 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0927 06:02:43.868319 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:43.868384 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:43.868356 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:43.868402 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:43.868511 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:43.868562 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:43.868604 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:43.868639 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:43.868676 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0927 06:02:43.868776 28442 api.go:53] PageSize not implemented I0927 06:02:43.868843 28442 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0927 06:02:43.868898 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:43.868951 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:43.868937 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:43.869025 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:43.868986 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:43.869071 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:43.869055 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:43.869127 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:43.869101 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:43.869296 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:43.869333 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:43.869398 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:43.869433 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:43.869483 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:43.877300 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:02:43.877648 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:43.878037 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:43.878294 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:43.878592 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:43.880865 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:02:43.881180 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:02:43.881501 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0927 06:02:43.886963 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:43.890896 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:43.890994 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:43.900651 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:43.904747 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:43.904837 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:43.904893 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:44.931208 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:45.137862 28442 iamrole.go:89] ListRoles: { } I0927 06:02:45.140025 28442 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0927 06:02:45.140433 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:45.140682 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0927 06:02:45.140858 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:45.141000 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:45.141163 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:45.141211 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:45.141287 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0927 06:02:45.141375 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W0927 06:02:45.141520 28442 api.go:53] PageSize not implemented I0927 06:02:45.141481 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0927 06:02:45.141741 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:45.141934 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:45.142163 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:45.142344 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0927 06:02:45.144074 28442 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0927 06:02:45.144204 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:45.144342 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:45.144408 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:45.144547 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:45.144388 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:45.144620 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:45.144666 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:45.144714 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:45.144722 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:45.144798 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:45.144871 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:45.144912 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:45.144820 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:45.145074 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:45.145140 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:45.145342 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:45.145490 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:45.145631 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:45.145704 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:45.145871 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:45.145914 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:45.146094 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:45.146175 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:45.146332 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:45.146378 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:45.146549 28442 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0927 06:02:45.146702 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:45.146857 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:45.147066 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:45.147386 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:45.147486 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:45.147638 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:45.147683 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:45.148037 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:45.148278 28442 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0927 06:02:45.148357 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:45.148381 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:45.148461 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:45.148483 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:45.148530 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:45.148567 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:45.148609 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:45.148646 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:45.148681 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0927 06:02:45.148787 28442 api.go:53] PageSize not implemented I0927 06:02:45.148837 28442 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0927 06:02:45.148915 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0927 06:02:45.148911 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:45.149017 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0927 06:02:45.148983 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:45.149048 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:45.149111 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:45.149089 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:45.149217 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:45.149311 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:45.149345 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:45.149449 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:45.149509 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:45.149598 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:45.149643 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:45.154939 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:02:45.155062 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:45.155225 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:45.155424 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:45.155597 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:45.156170 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:02:45.156546 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:02:45.156795 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:02:45.156848 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:45.156885 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:45.156953 28442 dns.go:235] Pre-creating DNS records I0927 06:02:45.165466 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:45.169673 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:45.169771 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:45.169829 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:45.924765 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:46.131262 28442 iamrole.go:89] ListRoles: { } I0927 06:02:46.133467 28442 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0927 06:02:46.133776 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:46.133954 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0927 06:02:46.134006 28442 api.go:53] PageSize not implemented I0927 06:02:46.134063 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0927 06:02:46.134160 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.134331 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.134689 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.134751 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:46.134828 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:46.134865 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:46.134927 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:46.135265 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0927 06:02:46.136365 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.136577 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:46.138489 28442 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0927 06:02:46.138668 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:46.138642 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:46.138720 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:46.138755 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:46.138742 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:46.138861 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:46.138861 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.138932 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:46.139063 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:46.139170 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:46.139022 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:46.139222 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:46.139312 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:46.139385 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:46.139612 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:46.139682 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.139833 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:46.139879 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:46.139917 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.140088 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:46.140196 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.140332 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:46.140481 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:46.140546 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.140730 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:46.140879 28442 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0927 06:02:46.140988 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:46.141100 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:46.141423 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:46.141615 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:46.141789 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:46.142176 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:46.142304 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:46.142673 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:46.142840 28442 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0927 06:02:46.142941 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:46.142956 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:46.143042 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:46.143072 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:46.143134 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:46.143197 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:46.143262 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:46.143322 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:46.143378 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0927 06:02:46.143508 28442 api.go:53] PageSize not implemented I0927 06:02:46.143577 28442 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0927 06:02:46.143644 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:46.143704 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:46.143675 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:46.143761 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:46.143741 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:46.143799 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:46.143862 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:46.143886 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:46.143916 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:46.143988 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:46.144014 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:46.144061 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:46.144116 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:46.144131 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:46.149941 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:02:46.150062 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.150228 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.150343 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.150530 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.151138 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:02:46.151472 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:02:46.151724 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0927 06:02:46.154673 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:46.158571 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.158660 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.158713 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.168644 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:46.172797 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.172886 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.172942 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:46.172992 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:47.172298 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:47.378853 28442 iamrole.go:89] ListRoles: { } I0927 06:02:47.380559 28442 executor.go:111] Tasks: 0 done / 136 total; 52 can run W0927 06:02:47.380741 28442 api.go:53] PageSize not implemented I0927 06:02:47.380837 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.380979 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:47.381100 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:47.381136 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:47.381233 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0927 06:02:47.381746 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.381926 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.382037 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0927 06:02:47.382117 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0927 06:02:47.382483 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.382631 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:47.382682 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:47.382750 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:47.384663 28442 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0927 06:02:47.384798 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:47.384902 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:47.384973 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:47.384900 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:47.384936 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.385063 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:47.385124 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:47.385154 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:47.385279 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:47.385257 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:47.385333 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:47.385381 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.385545 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:47.385636 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:47.385798 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:47.385864 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:47.386035 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:47.386084 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:47.386235 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.386345 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:47.386425 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.386526 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.386628 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:47.386774 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:47.386856 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:47.386932 28442 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0927 06:02:47.387108 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:47.387248 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:47.387487 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:47.387856 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:47.388027 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:47.388110 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:47.388291 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:47.388394 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:47.388755 28442 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0927 06:02:47.388832 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:47.388905 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:47.389005 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:47.389028 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:47.389078 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:47.389119 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:47.389162 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:47.389200 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:47.389234 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0927 06:02:47.389330 28442 api.go:53] PageSize not implemented I0927 06:02:47.389394 28442 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0927 06:02:47.389440 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:47.389490 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:47.389506 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:47.389562 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:47.389660 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:47.389610 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:47.389700 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:47.389687 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:47.389719 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:47.389794 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:47.389820 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:47.389773 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:47.389928 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:47.389969 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:47.399995 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:02:47.400136 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:47.400340 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:47.400500 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:47.400702 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:47.401687 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:02:47.402118 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:02:47.402377 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:02:47.402434 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:47.402470 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:47.402540 28442 dns.go:235] Pre-creating DNS records I0927 06:02:47.411345 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0927 06:02:47.415527 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:47.415627 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:47.415687 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:47.415741 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:48.191268 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:48.387029 28442 iamrole.go:89] ListRoles: { } I0927 06:02:48.390529 28442 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0927 06:02:48.391100 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.391440 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0927 06:02:48.392287 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.392692 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0927 06:02:48.393291 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0927 06:02:48.393431 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0927 06:02:48.393534 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0927 06:02:48.395143 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } W0927 06:02:48.395241 28442 api.go:53] PageSize not implemented I0927 06:02:48.395429 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:48.395712 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.395850 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:48.395887 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:48.395958 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:48.397030 28442 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0927 06:02:48.397204 28442 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:48.397198 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0927 06:02:48.397269 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:48.397186 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.397293 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:48.397333 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0927 06:02:48.397340 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.397414 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0927 06:02:48.397477 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:48.397507 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:48.397484 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0927 06:02:48.397692 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:48.397771 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.397938 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:48.397993 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:48.398086 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:48.398174 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0927 06:02:48.398331 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:48.398376 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:48.398490 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.398639 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:48.398692 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.398798 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0927 06:02:48.398917 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:48.399033 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:48.399113 28442 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0927 06:02:48.399336 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:48.399427 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:48.399545 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:48.399892 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:48.400073 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:48.400288 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:48.400634 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.400796 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0927 06:02:48.401013 28442 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0927 06:02:48.401109 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:48.401223 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:48.401321 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:48.401343 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:48.401399 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:48.401438 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0927 06:02:48.401480 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0927 06:02:48.401516 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0927 06:02:48.401550 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0927 06:02:48.401649 28442 api.go:53] PageSize not implemented I0927 06:02:48.401700 28442 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0927 06:02:48.401745 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:48.401794 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:48.401810 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:48.401820 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:48.401920 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:48.401949 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:48.401977 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:48.401984 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:48.402053 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:48.402119 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:48.402100 28442 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0927 06:02:48.402138 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:48.402335 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0927 06:02:48.402367 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:48.408122 28442 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0927 06:02:48.408324 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:48.408483 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:48.408581 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:48.408762 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:48.409554 28442 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0927 06:02:48.409812 28442 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0927 06:02:48.410064 28442 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0927 06:02:48.410251 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:48.410310 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:48.410363 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:48.410403 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:48.410436 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:48.410468 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:48.410504 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:48.410547 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:48.410590 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:48.410635 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:48.410668 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:48.410702 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:48.410741 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:48.410777 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:48.410812 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:48.410849 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:48.410887 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:48.410925 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:48.410964 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:48.410998 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:48.411036 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0927 06:02:48.411073 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:48.411107 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:48.411166 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:48.411206 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:48.411245 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:48.411284 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:48.413939 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:48.414008 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:48.414030 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:48.414065 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.414128 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0927 06:02:48.414192 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.414254 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.414304 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.414365 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.414412 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.414476 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0927 06:02:48.414538 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.414614 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0927 06:02:48.414659 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0927 06:02:48.414715 28442 api.go:53] PageSize not implemented I0927 06:02:48.414736 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:48.414764 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:48.414779 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0927 06:02:48.414824 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:48.414848 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:48.414867 28442 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" ] } I0927 06:02:48.414940 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:48.414980 28442 iamrole.go:89] ListRoles: { } I0927 06:02:48.415026 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:48.415052 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:48.415097 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:48.415147 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:48.415191 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } autoscaling-config:lt-2 ok I0927 06:02:48.415784 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0927 06:02:48.415844 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok I0927 06:02:48.415810 28442 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok autoscaling-group:nodes.complex.example.com ok I0927 06:02:48.415870 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0927 06:02:48.415921 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0927 06:02:48.415970 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I0927 06:02:48.415959 28442 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0927 06:02:48.415961 28442 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } autoscaling-config:lt-1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4 ok I0927 06:02:48.416033 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-group:master-us-test-1a.masters.complex.example.com ok I0927 06:02:48.416079 28442 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0927 06:02:48.416104 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5 ok I0927 06:02:48.416172 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } I0927 06:02:48.415993 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } subnet:subnet-2 ok route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.complex.example.com. ok I0927 06:02:48.416239 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 } ] } W0927 06:02:48.416614 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:48.416637 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0927 06:02:48.416681 28442 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0927 06:02:48.416715 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:48.416773 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0927 06:02:48.416806 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:48.416856 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 } ] } W0927 06:02:48.417053 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:48.417074 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0927 06:02:48.417115 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0927 06:02:48.417219 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0927 06:02:48.417277 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0927 06:02:48.417258 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0927 06:02:48.417339 28442 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0927 06:02:48.417360 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0927 06:02:48.417398 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0927 06:02:48.417435 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0927 06:02:48.417478 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0927 06:02:48.417491 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0927 06:02:48.417519 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0927 06:02:48.417605 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0927 06:02:48.417695 28442 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0927 06:02:48.417773 28442 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (11.39s) === RUN TestLifecycleExternalLB I0927 06:02:48.418298 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:48.418437 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:48.418475 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:48.418513 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:48.418551 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:48.418600 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:48.418643 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:48.418673 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:48.418710 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:48.418736 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0927 06:02:48.444152 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:48.447413 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:48.447511 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:49.217027 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:49.411127 28442 iamrole.go:89] ListRoles: { } I0927 06:02:49.412600 28442 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0927 06:02:49.412805 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0927 06:02:49.412924 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } W0927 06:02:49.412953 28442 api.go:53] PageSize not implemented I0927 06:02:49.412978 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } W0927 06:02:49.413056 28442 api.go:53] PageSize not implemented I0927 06:02:49.412885 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:49.413112 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0927 06:02:49.413222 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0927 06:02:49.413271 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0927 06:02:49.413234 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } W0927 06:02:49.413323 28442 api.go:53] PageSize not implemented I0927 06:02:49.413227 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:49.413314 28442 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.413336 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0927 06:02:49.413396 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0927 06:02:49.413505 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0927 06:02:49.413455 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:49.413556 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0927 06:02:49.413482 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:49.413622 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:49.413803 28442 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" }] }] } I0927 06:02:49.415915 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:49.416045 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:49.416437 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:49.416615 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I0927 06:02:49.416823 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0927 06:02:49.416768 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:49.417066 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0927 06:02:49.417148 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.417493 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:49.417617 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:49.417705 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0927 06:02:49.417771 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:49.417910 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:49.420315 28442 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0927 06:02:49.420680 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] }] } I0927 06:02:49.420889 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:49.421868 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0927 06:02:49.420995 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:49.421960 28442 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0927 06:02:49.421974 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:49.422017 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0927 06:02:49.422120 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0927 06:02:49.422241 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0927 06:02:49.422263 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:49.422372 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0927 06:02:49.422414 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }], VpcId: "vpc-1" } I0927 06:02:49.422555 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:49.422617 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:49.422666 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0927 06:02:49.422812 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0927 06:02:49.422880 28442 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" }] }] } I0927 06:02:49.423007 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:49.423070 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0927 06:02:49.423304 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "masters.externallb.example.com" }] }], VpcId: "vpc-1" } I0927 06:02:49.423408 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:49.423490 28442 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0927 06:02:49.423565 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:49.423614 28442 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] } I0927 06:02:49.423695 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:49.423749 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:49.423802 28442 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0927 06:02:49.423890 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:49.423970 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:49.424098 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0927 06:02:49.428342 28442 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0927 06:02:49.428609 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.428902 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:49.429091 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:49.429161 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:49.429269 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:49.429359 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.429699 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.429911 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:49.430024 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:49.430110 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0927 06:02:49.430346 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.430513 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.430682 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.430851 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.431022 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.431223 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.431396 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0927 06:02:49.431565 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.431732 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0927 06:02:49.431801 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0927 06:02:49.431854 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:49.431972 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:49.432038 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:49.432136 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0927 06:02:49.432322 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0927 06:02:49.432554 28442 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0927 06:02:49.432848 28442 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0927 06:02:49.433134 28442 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0927 06:02:49.433190 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:49.433230 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:49.433300 28442 dns.go:235] Pre-creating DNS records I0927 06:02:49.433334 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:49.439687 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:49.442952 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:49.443053 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:50.201239 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:50.392219 28442 iamrole.go:89] ListRoles: { } I0927 06:02:50.393846 28442 executor.go:111] Tasks: 0 done / 107 total; 51 can run W0927 06:02:50.394092 28442 api.go:53] PageSize not implemented I0927 06:02:50.394197 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0927 06:02:50.394355 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0927 06:02:50.394400 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0927 06:02:50.394406 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.394534 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0927 06:02:50.394573 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0927 06:02:50.394675 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0927 06:02:50.394632 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.394752 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0927 06:02:50.394818 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0927 06:02:50.394846 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0927 06:02:50.394900 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:50.395032 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.395205 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:02:50.395240 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:02:50.395296 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W0927 06:02:50.395341 28442 api.go:53] PageSize not implemented I0927 06:02:50.395337 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W0927 06:02:50.395764 28442 api.go:53] PageSize not implemented I0927 06:02:50.395728 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:50.397692 28442 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0927 06:02:50.397869 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0927 06:02:50.397953 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:50.398079 28442 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0927 06:02:50.398076 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:50.398169 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.398307 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.398463 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:50.398537 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0927 06:02:50.398784 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:50.398856 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.398997 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0927 06:02:50.399157 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:50.403583 28442 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0927 06:02:50.403864 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:50.403987 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:50.404132 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:50.404277 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:50.404547 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:50.404703 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:50.404888 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:50.405414 28442 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0927 06:02:50.405683 28442 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0927 06:02:50.405976 28442 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0927 06:02:50.409412 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:50.409481 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:50.409524 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:50.409561 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:50.409594 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:50.409627 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:50.409660 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:50.409696 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:02:50.409732 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:50.409771 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:50.409814 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:50.409850 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:50.409881 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:50.409917 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:50.409948 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:50.409985 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:50.410020 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:50.410059 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:50.410093 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:50.410125 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:50.410158 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:50.410197 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:50.410237 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:50.410272 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:50.411624 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:50.411689 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:50.411709 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:50.411750 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.411805 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0927 06:02:50.411862 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.411921 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.411966 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.412019 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.412062 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.412103 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0927 06:02:50.412149 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.412202 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0927 06:02:50.412241 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0927 06:02:50.412294 28442 api.go:53] PageSize not implemented I0927 06:02:50.412315 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:50.412342 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:50.412359 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:50.412383 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:50.412400 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0927 06:02:50.412451 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:50.412493 28442 iamrole.go:89] ListRoles: { } I0927 06:02:50.412540 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:50.412569 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:50.412612 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:50.412658 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:50.412695 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:50.413116 28442 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0927 06:02:50.413181 28442 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0927 06:02:50.413181 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0927 06:02:50.413260 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok I0927 06:02:50.413244 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.externallb.example.com ok I0927 06:02:50.413320 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0927 06:02:50.413404 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I0927 06:02:50.413267 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.externallb.example.com. ok I0927 06:02:50.413333 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0927 06:02:50.413475 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:50.413498 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I0927 06:02:50.413556 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I0927 06:02:50.413624 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:50.413678 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0927 06:02:50.413870 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:50.413889 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0927 06:02:50.413936 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0927 06:02:50.413998 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0927 06:02:50.414086 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0927 06:02:50.414123 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0927 06:02:50.414227 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0927 06:02:50.414258 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0927 06:02:50.414312 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0927 06:02:50.414364 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0927 06:02:50.414465 28442 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0927 06:02:50.414487 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0927 06:02:50.414527 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0927 06:02:50.414605 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0927 06:02:50.414687 28442 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0927 06:02:50.414763 28442 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (2.00s) === RUN TestLifecycleSharedSubnet I0927 06:02:50.415229 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:50.415368 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:50.415408 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:50.415450 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:50.415494 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:50.415544 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:50.415587 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:50.415619 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:50.415658 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:50.415687 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0927 06:02:50.445552 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:50.448721 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:50.448809 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:51.210127 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:51.395419 28442 iamrole.go:89] ListRoles: { } I0927 06:02:51.396457 28442 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0927 06:02:51.396625 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] }] } I0927 06:02:51.396799 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:51.396918 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:51.396999 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:51.397090 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:02:51.397197 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0927 06:02:51.397234 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0927 06:02:51.397172 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0927 06:02:51.397292 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0927 06:02:51.397318 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:51.397502 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.397843 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0927 06:02:51.397924 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0927 06:02:51.398121 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:51.400652 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:51.400988 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:51.405304 28442 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0927 06:02:51.405635 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0927 06:02:51.405593 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0927 06:02:51.405917 28442 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0927 06:02:51.405935 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0927 06:02:51.406080 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0927 06:02:51.406208 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0927 06:02:51.406209 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0927 06:02:51.406330 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0927 06:02:51.406497 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:02:51.406678 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:51.406826 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:51.406899 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:51.407032 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:51.407092 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:51.407150 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:51.407197 28442 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] } I0927 06:02:51.407280 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:51.407872 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0927 06:02:51.412559 28442 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0927 06:02:51.412765 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.412975 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.413123 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.413373 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:51.413483 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:51.413684 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.413997 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:51.414118 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.414293 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.414492 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0927 06:02:51.414672 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:51.414809 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.415076 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0927 06:02:51.415316 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.415559 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.415813 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.415996 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" }] }] } I0927 06:02:51.416162 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0927 06:02:51.416362 28442 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0927 06:02:51.416691 28442 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0927 06:02:51.417023 28442 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0927 06:02:51.417078 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:51.417124 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:51.417196 28442 dns.go:235] Pre-creating DNS records I0927 06:02:51.417227 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:51.423136 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:51.426388 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:51.426479 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:52.181548 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:52.367048 28442 iamrole.go:89] ListRoles: { } I0927 06:02:52.368475 28442 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0927 06:02:52.368945 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:02:52.369127 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0927 06:02:52.369192 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0927 06:02:52.369253 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.369312 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:52.369502 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:52.369695 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.371736 28442 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0927 06:02:52.371879 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0927 06:02:52.372036 28442 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0927 06:02:52.372057 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:52.372077 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0927 06:02:52.372143 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0927 06:02:52.372335 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:52.372410 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0927 06:02:52.372573 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:02:52.377649 28442 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0927 06:02:52.377986 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:52.378167 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:52.378409 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:52.378592 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:52.379345 28442 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0927 06:02:52.379684 28442 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0927 06:02:52.379955 28442 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0927 06:02:52.382789 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:52.382855 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:52.382890 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:52.382940 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:52.382982 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:52.383024 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:02:52.383070 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:52.383126 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:52.383181 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:52.383221 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:52.383264 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:52.383296 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:52.383354 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:52.383395 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:52.383444 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:52.383482 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:52.383524 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:52.383582 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:52.383624 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:52.385102 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:52.385182 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:52.385205 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:52.385255 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.385315 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0927 06:02:52.385403 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.385477 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.385538 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.385593 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.385650 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.385697 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0927 06:02:52.385758 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.385809 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0927 06:02:52.385859 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0927 06:02:52.385923 28442 api.go:53] PageSize not implemented I0927 06:02:52.385955 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:52.385990 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:52.386009 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:52.386048 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:52.386077 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0927 06:02:52.386148 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:52.386210 28442 iamrole.go:89] ListRoles: { } I0927 06:02:52.386261 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:52.386304 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:52.386358 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:52.386408 28442 routetable.go:53] DescribeRouteTables: { } autoscaling-group:nodes.sharedsubnet.example.com ok I0927 06:02:52.386861 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:52.386904 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I0927 06:02:52.386991 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok I0927 06:02:52.387029 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0927 06:02:52.387102 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok I0927 06:02:52.386932 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0927 06:02:52.387224 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:52.387260 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0927 06:02:52.387158 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedsubnet.example.com. ok I0927 06:02:52.387309 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:52.387409 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0927 06:02:52.387549 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:52.387578 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok I0927 06:02:52.387644 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0927 06:02:52.387722 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0927 06:02:52.387830 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I0927 06:02:52.387989 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0927 06:02:52.388071 28442 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0927 06:02:52.388091 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0927 06:02:52.388127 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I0927 06:02:52.388163 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0927 06:02:52.388207 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0927 06:02:52.388220 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0927 06:02:52.388249 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (1.97s) === RUN TestLifecyclePrivateSharedSubnet I0927 06:02:52.388726 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:52.388871 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:52.388910 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:52.388958 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:52.388999 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:52.389051 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:52.389098 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:52.389130 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:52.389169 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:52.389198 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0927 06:02:52.417879 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:52.421377 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:52.421458 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:52.421514 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:53.364760 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:53.554430 28442 iamrole.go:89] ListRoles: { } I0927 06:02:53.555946 28442 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0927 06:02:53.556364 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0927 06:02:53.556465 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] } I0927 06:02:53.556473 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:53.556505 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] }] } I0927 06:02:53.556688 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0927 06:02:53.556684 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:53.556750 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-subnet.example.com" }] } I0927 06:02:53.556802 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:53.556850 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:53.556962 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0927 06:02:53.557034 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0927 06:02:53.556970 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.557168 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:02:53.557226 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0927 06:02:53.557247 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0927 06:02:53.557284 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] }] } I0927 06:02:53.557413 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:53.558530 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:53.560255 28442 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0927 06:02:53.560757 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0927 06:02:53.560726 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0927 06:02:53.561177 28442 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0927 06:02:53.561250 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0927 06:02:53.561289 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0927 06:02:53.561520 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:02:53.561585 28442 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0927 06:02:53.561765 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0927 06:02:53.561731 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:53.561971 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:53.561816 28442 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0927 06:02:53.562064 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0927 06:02:53.562054 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0927 06:02:53.562732 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0927 06:02:53.562866 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0927 06:02:53.562812 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0927 06:02:53.562957 28442 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0927 06:02:53.563076 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:53.563129 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0927 06:02:53.563205 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:53.563265 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:53.563318 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:53.564066 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:53.564118 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:53.564156 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:53.564190 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0927 06:02:53.564308 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0927 06:02:53.564392 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:53.564459 28442 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I0927 06:02:53.564549 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0927 06:02:53.564655 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0927 06:02:53.564715 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:53.564765 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:53.564810 28442 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I0927 06:02:53.566082 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0927 06:02:53.566594 28442 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0927 06:02:53.566910 28442 api.go:53] PageSize not implemented I0927 06:02:53.566863 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.567053 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.567112 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:53.567205 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:53.567107 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:53.567319 28442 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I0927 06:02:53.567284 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.567373 28442 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0927 06:02:53.567499 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:53.567540 28442 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0927 06:02:53.567599 28442 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0927 06:02:53.567652 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0927 06:02:53.567935 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" }] }] } I0927 06:02:53.568132 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.568283 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0927 06:02:53.568418 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0927 06:02:53.568628 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0927 06:02:53.568697 28442 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W0927 06:02:53.568796 28442 api.go:53] PageSize not implemented I0927 06:02:53.568820 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:53.568774 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.568984 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.569139 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0927 06:02:53.569238 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" }] }] } I0927 06:02:53.569379 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0927 06:02:53.569520 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:53.569636 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:53.569712 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0927 06:02:53.569868 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0927 06:02:53.570018 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.570151 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.570288 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0927 06:02:53.570386 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.570531 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0927 06:02:53.570661 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0927 06:02:53.570761 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.570894 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0927 06:02:53.571025 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0927 06:02:53.571253 28442 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0927 06:02:53.571298 28442 api.go:53] PageSize not implemented I0927 06:02:53.571341 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0927 06:02:53.571472 28442 api.go:53] PageSize not implemented I0927 06:02:53.571426 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:53.571520 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:53.571605 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:53.571718 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:53.571840 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:53.577355 28442 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0927 06:02:53.577578 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:53.577707 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:53.577812 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:53.577936 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:53.578485 28442 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0927 06:02:53.578765 28442 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0927 06:02:53.579084 28442 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0927 06:02:53.579154 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:53.579197 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:53.579262 28442 dns.go:235] Pre-creating DNS records I0927 06:02:53.579287 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:53.585826 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:53.589319 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:53.589408 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:53.589467 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:54.550769 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:54.733441 28442 iamrole.go:89] ListRoles: { } I0927 06:02:54.735866 28442 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0927 06:02:54.736244 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:54.736277 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] }] } I0927 06:02:54.736587 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0927 06:02:54.736870 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:54.737192 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:02:54.737256 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0927 06:02:54.737279 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0927 06:02:54.738881 28442 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0927 06:02:54.739084 28442 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0927 06:02:54.739104 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0927 06:02:54.739180 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0927 06:02:54.739219 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0927 06:02:54.739166 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0927 06:02:54.739284 28442 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0927 06:02:54.739302 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0927 06:02:54.739399 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0927 06:02:54.739454 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:54.739504 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:54.739568 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0927 06:02:54.739720 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:54.739795 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0927 06:02:54.740033 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0927 06:02:54.740253 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:02:54.740458 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0927 06:02:54.740755 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:54.741291 28442 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0927 06:02:54.741492 28442 api.go:53] PageSize not implemented I0927 06:02:54.741525 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:54.741513 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:54.741620 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:54.741599 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0927 06:02:54.741672 28442 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } W0927 06:02:54.741697 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:54.741718 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0927 06:02:54.741762 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0927 06:02:54.741656 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:54.741813 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0927 06:02:54.741866 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0927 06:02:54.741901 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } W0927 06:02:54.742012 28442 api.go:53] PageSize not implemented I0927 06:02:54.742050 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:54.742536 28442 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0927 06:02:54.742617 28442 api.go:53] PageSize not implemented I0927 06:02:54.742650 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:54.742764 28442 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0927 06:02:54.742658 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:54.742801 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:54.742877 28442 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0927 06:02:54.742903 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0927 06:02:54.742943 28442 api.go:53] PageSize not implemented I0927 06:02:54.742992 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:54.743162 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:54.748634 28442 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0927 06:02:54.748753 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:54.748885 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:54.749047 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:54.749207 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:54.749935 28442 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0927 06:02:54.750070 28442 api.go:53] PageSize not implemented I0927 06:02:54.750101 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:54.750303 28442 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0927 06:02:54.750543 28442 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0927 06:02:54.753763 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:54.753831 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:54.753869 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:54.753903 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:54.753937 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:54.753971 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:02:54.754014 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:54.754052 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:54.754098 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0927 06:02:54.754138 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:54.754175 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:54.754208 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:54.754246 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:54.754282 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:54.754318 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:54.754351 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0927 06:02:54.754391 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:54.754427 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:54.754492 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:54.754528 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:54.754566 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:54.754603 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:54.756124 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:54.756197 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:54.756219 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:54.756263 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0927 06:02:54.756326 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0927 06:02:54.756392 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0927 06:02:54.756456 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0927 06:02:54.756500 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0927 06:02:54.756545 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0927 06:02:54.756590 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0927 06:02:54.756627 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0927 06:02:54.756665 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0927 06:02:54.756711 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0927 06:02:54.756748 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0927 06:02:54.756796 28442 api.go:53] PageSize not implemented I0927 06:02:54.756814 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0927 06:02:54.756858 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:54.756885 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:54.756900 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0927 06:02:54.756938 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:54.756962 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:54.756979 28442 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0927 06:02:54.757049 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:54.757092 28442 iamrole.go:89] ListRoles: { } I0927 06:02:54.757138 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:54.757166 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:54.757208 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:54.757258 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:54.757797 28442 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok I0927 06:02:54.757845 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0927 06:02:54.757933 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } autoscaling-group:nodes.private-shared-subnet.example.com ok I0927 06:02:54.757916 28442 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I0927 06:02:54.757917 28442 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok I0927 06:02:54.757985 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0927 06:02:54.758013 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0927 06:02:54.758065 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok autoscaling-group:bastion.private-shared-subnet.example.com ok I0927 06:02:54.758044 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0927 06:02:54.758133 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok W0927 06:02:54.758184 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:54.758196 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0927 06:02:54.758203 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } autoscaling-config:lt-2 ok security-group:sg-3 ok I0927 06:02:54.758038 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.private-shared-subnet.example.com. ok I0927 06:02:54.758266 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:54.758320 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0927 06:02:54.758514 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:54.758533 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0927 06:02:54.758566 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:54.758620 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W0927 06:02:54.758753 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:54.758773 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0927 06:02:54.758815 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0927 06:02:54.758871 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok autoscaling-config:lt-3 ok I0927 06:02:54.758979 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0927 06:02:54.759113 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0927 06:02:54.759169 28442 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0927 06:02:54.759130 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:54.759185 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0927 06:02:54.759221 28442 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I0927 06:02:54.759254 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0927 06:02:54.759211 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W0927 06:02:54.759325 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:54.759345 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0927 06:02:54.759303 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0927 06:02:54.759393 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0927 06:02:54.759428 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok I0927 06:02:54.759464 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0927 06:02:54.759514 28442 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0927 06:02:54.759531 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0927 06:02:54.759562 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (2.37s) === RUN TestLifecyclePrivateSharedIP I0927 06:02:54.760020 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:54.760154 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:54.760193 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:54.760236 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:54.760278 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:54.760330 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:54.760373 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:54.760404 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:54.760445 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:54.760473 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0927 06:02:54.789040 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:54.792548 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:54.792635 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:54.792699 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:55.564719 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:55.755172 28442 iamrole.go:89] ListRoles: { } I0927 06:02:55.757252 28442 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0927 06:02:55.757727 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:55.757966 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0927 06:02:55.758015 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:55.758087 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] } I0927 06:02:55.758176 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:55.758248 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0927 06:02:55.758239 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:55.758325 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0927 06:02:55.758415 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:55.758546 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:55.758599 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:55.758764 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.758949 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:55.759141 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0927 06:02:55.759219 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0927 06:02:55.759226 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:02:55.759312 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0927 06:02:55.759342 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0927 06:02:55.760524 28442 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0927 06:02:55.760658 28442 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0927 06:02:55.760784 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0927 06:02:55.760840 28442 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0927 06:02:55.760758 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0927 06:02:55.760909 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0927 06:02:55.761000 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0927 06:02:55.761052 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:55.761083 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0927 06:02:55.761177 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0927 06:02:55.761202 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0927 06:02:55.761336 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0927 06:02:55.761333 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:55.761378 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0927 06:02:55.761339 28442 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0927 06:02:55.761495 28442 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0927 06:02:55.761498 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0927 06:02:55.761552 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-12345678" } I0927 06:02:55.761540 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:55.761669 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0927 06:02:55.761724 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:02:55.761795 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0927 06:02:55.761781 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0927 06:02:55.761865 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:55.762044 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:55.762129 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:55.762192 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0927 06:02:55.762357 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0927 06:02:55.762535 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:55.762687 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:55.762826 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:55.762794 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-12345678" } I0927 06:02:55.762888 28442 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" } ] } I0927 06:02:55.762993 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:55.763048 28442 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] } I0927 06:02:55.763155 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0927 06:02:55.763269 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:55.763338 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:55.763389 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0927 06:02:55.763499 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0927 06:02:55.763553 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:55.763618 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:55.763222 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0927 06:02:55.763669 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:55.763755 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:55.763822 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:55.763891 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:55.763945 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:55.764041 28442 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0927 06:02:55.764283 28442 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0927 06:02:55.764389 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } W0927 06:02:55.764420 28442 api.go:53] PageSize not implemented I0927 06:02:55.764411 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:55.764507 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:55.764498 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.764592 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:55.764620 28442 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0927 06:02:55.764715 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:55.764686 28442 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-ip.example.com" }] } I0927 06:02:55.764758 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:55.764776 28442 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } I0927 06:02:55.764797 28442 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0927 06:02:55.764895 28442 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } W0927 06:02:55.764979 28442 api.go:53] PageSize not implemented I0927 06:02:55.765002 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:55.764907 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0927 06:02:55.765068 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:55.765215 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0927 06:02:55.765261 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0927 06:02:55.765312 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0927 06:02:55.765489 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.765635 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:55.765709 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:55.765813 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:55.765877 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0927 06:02:55.766007 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:55.766061 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.766208 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.766336 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0927 06:02:55.766375 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0927 06:02:55.766413 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0927 06:02:55.766466 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0927 06:02:55.766613 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.766745 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.766867 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0927 06:02:55.766999 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.767127 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0927 06:02:55.767269 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" }] }] } I0927 06:02:55.767398 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0927 06:02:55.767445 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.767582 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.767718 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.767876 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.768016 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0927 06:02:55.768119 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:55.768216 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:55.768306 28442 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0927 06:02:55.768396 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.768558 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0927 06:02:55.768660 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.768793 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.768921 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0927 06:02:55.769094 28442 executor.go:111] Tasks: 110 done / 132 total; 6 can run I0927 06:02:55.769180 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0927 06:02:55.769252 28442 api.go:53] PageSize not implemented I0927 06:02:55.769299 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:55.769325 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:55.769417 28442 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:55.769309 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:55.769423 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0927 06:02:55.769597 28442 api.go:53] PageSize not implemented I0927 06:02:55.769560 28442 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0927 06:02:55.769585 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:55.769661 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0927 06:02:55.769642 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:55.769707 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:55.769752 28442 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0927 06:02:55.775184 28442 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0927 06:02:55.775412 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:55.775540 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:55.775594 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:55.775716 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:55.775821 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:55.776036 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0927 06:02:55.776294 28442 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0927 06:02:55.776590 28442 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0927 06:02:55.776886 28442 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0927 06:02:55.776942 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:55.776986 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:55.777054 28442 dns.go:235] Pre-creating DNS records I0927 06:02:55.777080 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:55.783792 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:55.787266 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:55.787356 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:55.787415 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:57.068405 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:57.262004 28442 iamrole.go:89] ListRoles: { } I0927 06:02:57.263911 28442 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0927 06:02:57.264551 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0927 06:02:57.264707 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0927 06:02:57.264745 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0927 06:02:57.264980 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.265760 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:57.266225 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.266679 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:57.268251 28442 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0927 06:02:57.268410 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0927 06:02:57.268387 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0927 06:02:57.268528 28442 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0927 06:02:57.268584 28442 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0927 06:02:57.268611 28442 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0927 06:02:57.268580 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0927 06:02:57.268689 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0927 06:02:57.268731 28442 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0927 06:02:57.268746 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0927 06:02:57.268994 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:57.269087 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0927 06:02:57.269225 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:57.269297 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0927 06:02:57.269468 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:57.269562 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.269744 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:57.269815 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.269949 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.270073 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:57.270122 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.270244 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0927 06:02:57.270428 28442 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0927 06:02:57.270583 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:57.270670 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0927 06:02:57.270714 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0927 06:02:57.270748 28442 loadbalancers.go:35] PageSize not implemented W0927 06:02:57.270769 28442 api.go:53] PageSize not implemented I0927 06:02:57.270772 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0927 06:02:57.270768 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:57.270836 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0927 06:02:57.270912 28442 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0927 06:02:57.270967 28442 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0927 06:02:57.271014 28442 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0927 06:02:57.270806 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:57.271048 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:57.271161 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:57.271238 28442 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } W0927 06:02:57.271304 28442 api.go:53] PageSize not implemented I0927 06:02:57.271337 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:57.271442 28442 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0927 06:02:57.271540 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:57.271761 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:57.271971 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0927 06:02:57.272202 28442 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0927 06:02:57.272271 28442 api.go:53] PageSize not implemented I0927 06:02:57.272306 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:57.272415 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0927 06:02:57.272523 28442 api.go:53] PageSize not implemented I0927 06:02:57.272519 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0927 06:02:57.272414 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:57.272599 28442 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0927 06:02:57.272573 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:57.272632 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0927 06:02:57.272717 28442 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0927 06:02:57.272749 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:57.272820 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:57.278431 28442 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0927 06:02:57.278547 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:57.278696 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:57.278825 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:57.279018 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:57.279212 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:57.281075 28442 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0927 06:02:57.281440 28442 api.go:53] PageSize not implemented I0927 06:02:57.281485 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:57.281761 28442 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0927 06:02:57.282147 28442 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0927 06:02:57.288211 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:02:57.288294 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:02:57.288333 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:02:57.288371 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:02:57.288410 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:02:57.288442 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:02:57.288482 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:02:57.288520 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:02:57.288565 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0927 06:02:57.288605 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0927 06:02:57.288643 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:02:57.288674 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:02:57.288708 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:57.288743 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:02:57.288777 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0927 06:02:57.288812 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:57.288848 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:57.288884 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0927 06:02:57.288919 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0927 06:02:57.288955 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:57.288993 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:02:57.289027 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0927 06:02:57.289063 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:02:57.289098 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:02:57.289132 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:57.289171 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:57.289208 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:02:57.290702 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:02:57.290775 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:02:57.290800 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:02:57.290843 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.290906 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0927 06:02:57.290976 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.291043 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.291086 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.291150 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.291196 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.291240 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0927 06:02:57.291294 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.291350 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:57.291381 28442 natgateway.go:117] DescribeNatGateways: { } I0927 06:02:57.291422 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0927 06:02:57.291460 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0927 06:02:57.291507 28442 api.go:53] PageSize not implemented I0927 06:02:57.291525 28442 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0927 06:02:57.291566 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:02:57.291592 28442 loadbalancers.go:35] PageSize not implemented I0927 06:02:57.291608 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0927 06:02:57.291646 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:02:57.291671 28442 targetgroups.go:35] PageSize not implemented I0927 06:02:57.291688 28442 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" ] } I0927 06:02:57.291753 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:02:57.291796 28442 iamrole.go:89] ListRoles: { } I0927 06:02:57.291843 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:57.291871 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:57.291919 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:02:57.291961 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:02:57.291995 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0927 06:02:57.292031 28442 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0927 06:02:57.292065 28442 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } autoscaling-config:lt-1 ok I0927 06:02:57.292706 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0927 06:02:57.292741 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } autoscaling-group:nodes.private-shared-ip.example.com ok I0927 06:02:57.292757 28442 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I0927 06:02:57.292841 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok autoscaling-group:bastion.private-shared-ip.example.com ok I0927 06:02:57.292902 28442 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I0927 06:02:57.292771 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0927 06:02:57.292987 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:57.292939 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0927 06:02:57.293008 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0927 06:02:57.293022 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok I0927 06:02:57.293023 28442 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok I0927 06:02:57.293058 28442 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok autoscaling-config:lt-3 ok I0927 06:02:57.293060 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I0927 06:02:57.293168 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } I0927 06:02:57.293196 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } volume:vol-1 ok iam-instance-profile:nodes.private-shared-ip.example.com ok I0927 06:02:57.293249 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0927 06:02:57.293111 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:57.293347 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.private-shared-ip.example.com. ok I0927 06:02:57.293418 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0927 06:02:57.293586 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:57.293616 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0927 06:02:57.293686 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0927 06:02:57.293764 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0927 06:02:57.293935 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:57.293962 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0927 06:02:57.294009 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0927 06:02:57.294131 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:57.294181 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I0927 06:02:57.294261 28442 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0927 06:02:57.294281 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0927 06:02:57.294205 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0927 06:02:57.294321 28442 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok W0927 06:02:57.294338 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:02:57.294362 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0927 06:02:57.294364 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0927 06:02:57.294472 28442 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0927 06:02:57.294420 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0927 06:02:57.294493 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0927 06:02:57.294533 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0927 06:02:57.294523 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0927 06:02:57.294574 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I0927 06:02:57.294619 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0927 06:02:57.294632 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0927 06:02:57.294660 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I0927 06:02:57.294749 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0927 06:02:57.294818 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (2.54s) === RUN TestLifecycleManyAddons I0927 06:02:57.295324 28442 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:02:57.295464 28442 internetgateways.go:66] CreateInternetGateway: { } I0927 06:02:57.295502 28442 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:02:57.295542 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:02:57.295581 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:02:57.295630 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:02:57.295671 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:02:57.295700 28442 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:02:57.295738 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:02:57.295766 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0927 06:02:57.323501 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:57.327006 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:57.327108 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:58.077772 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:58.925557 28442 iamrole.go:89] ListRoles: { } I0927 06:02:58.926559 28442 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0927 06:02:58.926771 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:02:58.926897 28442 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I0927 06:02:58.927034 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:58.927203 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:58.928562 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:02:58.927192 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0927 06:02:58.929144 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:58.929192 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0927 06:02:58.929305 28442 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0927 06:02:58.929385 28442 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0927 06:02:58.929452 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:02:58.929466 28442 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0927 06:02:58.929519 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:58.929717 28442 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0927 06:02:58.929847 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:02:58.930623 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:58.931263 28442 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:58.933745 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0927 06:02:58.933800 28442 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0927 06:02:58.933857 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:02:58.933885 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:02:58.933947 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:58.935951 28442 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0927 06:02:58.936165 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:58.936299 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0927 06:02:58.936333 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0927 06:02:58.936400 28442 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0927 06:02:58.936435 28442 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0927 06:02:58.936422 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0927 06:02:58.936527 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0927 06:02:58.936629 28442 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0927 06:02:58.936657 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0927 06:02:58.936870 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }], VpcId: "vpc-1" } I0927 06:02:58.936978 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:02:58.937035 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:02:58.937078 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:58.937274 28442 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" } ] }], VpcId: "vpc-1" } I0927 06:02:58.937232 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0927 06:02:58.937284 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:02:58.937553 28442 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I0927 06:02:58.937668 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:58.937798 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:02:58.937932 28442 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0927 06:02:58.938111 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:02:58.938188 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:02:58.938237 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:02:58.938286 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:02:58.938330 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:02:58.938415 28442 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] } I0927 06:02:58.938504 28442 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0927 06:02:58.938586 28442 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0927 06:02:58.938639 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:02:58.938980 28442 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0927 06:02:58.941908 28442 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0927 06:02:58.942056 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:58.942175 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:58.942272 28442 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:58.942469 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:58.942657 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:58.942794 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:02:58.942971 28442 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0927 06:02:58.943162 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0927 06:02:58.943330 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0927 06:02:58.943379 28442 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0927 06:02:58.943439 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" }] }] } I0927 06:02:58.943639 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:58.943912 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:58.944085 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0927 06:02:58.944262 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:58.944395 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I0927 06:02:58.944602 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:58.944763 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:58.944964 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:58.945105 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0927 06:02:58.945237 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0927 06:02:58.945369 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0927 06:02:58.945511 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:58.945606 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:58.945809 28442 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:58.946008 28442 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0927 06:02:58.946328 28442 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0927 06:02:58.946624 28442 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0927 06:02:58.946935 28442 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0927 06:02:58.946985 28442 zones.go:93] ListHostedZonesPages { } I0927 06:02:58.947023 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:58.947090 28442 dns.go:235] Pre-creating DNS records I0927 06:02:58.947120 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:02:58.953493 28442 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0927 06:02:58.957119 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:58.957208 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:02:59.717489 28442 zones.go:93] ListHostedZonesPages { } I0927 06:03:00.577710 28442 iamrole.go:89] ListRoles: { } I0927 06:03:00.578894 28442 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0927 06:03:00.579107 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.579252 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:03:00.579299 28442 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:03:00.579367 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:03:00.579351 28442 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0927 06:03:00.579629 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.579862 28442 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0927 06:03:00.580026 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.580194 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.582836 28442 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0927 06:03:00.583073 28442 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0927 06:03:00.582997 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0927 06:03:00.583127 28442 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0927 06:03:00.583175 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0927 06:03:00.583369 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:03:00.583415 28442 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:03:00.583459 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0927 06:03:00.583571 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0927 06:03:00.583616 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.583709 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.583801 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:03:00.583860 28442 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:03:00.590080 28442 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0927 06:03:00.590238 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:03:00.590467 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:03:00.590709 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0927 06:03:00.591136 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:03:00.591324 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:03:00.591620 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:03:00.591822 28442 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0927 06:03:00.592572 28442 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0927 06:03:00.592843 28442 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0927 06:03:00.593119 28442 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0927 06:03:00.596085 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0927 06:03:00.596156 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0927 06:03:00.596207 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0927 06:03:00.596242 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0927 06:03:00.596280 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0927 06:03:00.596311 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0927 06:03:00.596346 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0927 06:03:00.596385 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0927 06:03:00.596421 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0927 06:03:00.596464 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0927 06:03:00.596503 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0927 06:03:00.596535 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0927 06:03:00.596568 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0927 06:03:00.596603 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0927 06:03:00.596636 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:03:00.596672 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0927 06:03:00.596707 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:03:00.596744 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0927 06:03:00.596778 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0927 06:03:00.596810 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0927 06:03:00.596844 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0927 06:03:00.596883 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0927 06:03:00.596921 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:03:00.596958 28442 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0927 06:03:00.598628 28442 delete_cluster.go:128] Looking for cloud resources to delete W0927 06:03:00.598694 28442 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0927 06:03:00.598717 28442 keypairs.go:95] DescribeKeyPairs: { } I0927 06:03:00.598761 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.598813 28442 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0927 06:03:00.598873 28442 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.598936 28442 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.598984 28442 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.599040 28442 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.599085 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.599124 28442 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0927 06:03:00.599170 28442 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.599223 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0927 06:03:00.599267 28442 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0927 06:03:00.599314 28442 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0927 06:03:00.599354 28442 api.go:53] PageSize not implemented I0927 06:03:00.599376 28442 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0927 06:03:00.599405 28442 loadbalancers.go:35] PageSize not implemented I0927 06:03:00.599424 28442 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0927 06:03:00.599449 28442 targetgroups.go:35] PageSize not implemented I0927 06:03:00.599468 28442 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0927 06:03:00.599521 28442 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0927 06:03:00.599556 28442 iamrole.go:89] ListRoles: { } I0927 06:03:00.599598 28442 zones.go:93] ListHostedZonesPages { } I0927 06:03:00.599630 28442 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0927 06:03:00.599674 28442 internetgateways.go:101] DescribeInternetGateways: { } I0927 06:03:00.599719 28442 routetable.go:53] DescribeRouteTables: { } I0927 06:03:00.599754 28442 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-config:lt-1 ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0927 06:03:00.600221 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.minimal.example.com ok I0927 06:03:00.600250 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0927 06:03:00.600352 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0927 06:03:00.600280 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } iam-instance-profile:nodes.minimal.example.com ok W0927 06:03:00.600408 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:03:00.600430 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0927 06:03:00.600490 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0927 06:03:00.600550 28442 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0927 06:03:00.600513 28442 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0927 06:03:00.600617 28442 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0927 06:03:00.600617 28442 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0927 06:03:00.600400 28442 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I0927 06:03:00.600651 28442 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0927 06:03:00.600742 28442 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0927 06:03:00.600798 28442 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0927 06:03:00.600854 28442 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0927 06:03:00.601076 28442 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0927 06:03:00.601092 28442 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0927 06:03:00.601206 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0927 06:03:00.601259 28442 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0927 06:03:00.601253 28442 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0927 06:03:00.601276 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0927 06:03:00.601338 28442 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0927 06:03:00.601377 28442 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0927 06:03:00.601428 28442 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0927 06:03:00.601442 28442 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0927 06:03:00.601471 28442 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0927 06:03:00.601538 28442 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0927 06:03:00.601615 28442 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0927 06:03:00.601694 28442 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (3.31s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 150.390s === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.005s === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0927 06:00:31.187787 28555 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.004s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I0927 06:00:31.215270 28559 pod.go:59] starting pod controller I0927 06:00:31.215425 28559 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS I0927 06:00:31.215508 28559 pod.go:107] Got stop signal I0927 06:00:31.215532 28559 pod.go:65] shutting down pod controller ok k8s.io/kops/dns-controller/pkg/watchers 0.033s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000117330} route53_test.go:93: Got zone list: [0xc000117360] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001180c0} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000117490} route53_test.go:93: Got zone list: [0xc0001174c0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001180d8} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc0001175c0} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003be5d0 0xc0001180f8} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000117780} route53_test.go:93: Got zone list: [0xc0001177b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000118118} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000117910} route53_test.go:93: Got zone list: [0xc000117940] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000118140} route53_test.go:187: Successfully added resource record set: {0xc00016e700 0xc000118160} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000117c20} route53_test.go:93: Got zone list: [0xc000117c50] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001181f0} route53_test.go:199: Successfully added resource record set: {0xc00016e880 0xc000118210} route53_test.go:118: Got 1 recordsets: [0xc000117df0] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000117f80} route53_test.go:93: Got zone list: [0xc000117fb0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001182b0} route53_test.go:221: Successfully added resource record set: {0xc00016ea00 0xc0001182d0} route53_test.go:228: Correctly failed to add duplicate resource record {0xc00016ea00 0xc0001182d0}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d0370} route53_test.go:93: Got zone list: [0xc0003d03a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000118390} route53_test.go:246: Successfully removed resource set {0xc00016ec00 0xc0001183b0} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d0680} route53_test.go:93: Got zone list: [0xc0003d06b0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000118440} route53_test.go:264: Successfully removed resource set {0xc00016ed80 0xc000118460} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d09c0} route53_test.go:93: Got zone list: [0xc0003d09f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc0001184f8} commontests.go:192: Successfully added resource record set: {0xc00016ef00 0xc000118518} commontests.go:45: Correctly replaced resource record {0xc00016ef00 0xc000118518} -> {0xc00016f000 0xc000118568} commontests.go:142: Got 1 recordsets: [0xc0003d0d00] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d0f30} route53_test.go:93: Got zone list: [0xc0003d0f60] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000118620} commontests.go:192: Successfully added resource record set: {0xc00016f280 0xc000118640} commontests.go:70: Correctly replaced resource record {0xc00016f280 0xc000118640} -> {0xc00016f380 0xc000118690} commontests.go:142: Got 1 recordsets: [0xc0003d1270] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d14f0} route53_test.go:93: Got zone list: [0xc0003d1520] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000118758} commontests.go:192: Successfully added resource record set: {0xc00016f600 0xc000118778} commontests.go:142: Got 2 recordsets: [0xc0003d1790 0xc0003d17b0] commontests.go:142: Got 2 recordsets: [0xc0003d1820 0xc0003d1840] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003d1a40} route53_test.go:93: Got zone list: [0xc0003d1a70] route53_test.go:98: Got at least 1 zone in list:&{0xc0003be390 0xc000118880} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.014s === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.005s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc0007221e0} clouddns_test.go:71: Got zone list: [0xc0003a2258] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a2228} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc0007222e0} clouddns_test.go:71: Got zone list: [0xc0003a2318] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a22e8} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc0007223e0} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc000465040 0xc0003a23d8} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc0007224a0} clouddns_test.go:71: Got zone list: [0xc0003a2498] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a2468} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc0007225c0} clouddns_test.go:71: Got zone list: [0xc0003a2600] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a25d0} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc000722700} clouddns_test.go:71: Got zone list: [0xc0003a2768] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a2738} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc000722860} clouddns_test.go:71: Got zone list: [0xc0003a2978] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a2948} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc0007229c0} clouddns_test.go:71: Got zone list: [0xc0003a2b10] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a2ae0} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc000722b00} clouddns_test.go:71: Got zone list: [0xc0003a2c78] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a2c48} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc000722c60} clouddns_test.go:71: Got zone list: [0xc0003a2e40] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a2e10} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc000722dc0} clouddns_test.go:71: Got zone list: [0xc0003a3110] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a30e0} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc000722f40} clouddns_test.go:71: Got zone list: [0xc0003a3440] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a3410} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00071a020 0xc000723120} clouddns_test.go:71: Got zone list: [0xc0003a3818] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000464e80 0xc0003a37e8} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.070s === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.034s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.007s === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.049s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0927 06:00:38.154114 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.154317 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.154375 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.154446 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.154508 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.154589 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.154644 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.154675 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.154734 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.154774 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.168166 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.02s) === RUN TestContainerdBuilder_Docker_19_03_14 I0927 06:00:38.174777 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.174969 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.175025 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.175097 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.175140 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.175190 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.175232 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.175306 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.175364 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.175401 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.177860 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.01s) === RUN TestContainerdBuilder_Simple I0927 06:00:38.182891 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.182993 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.183029 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.183074 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.183110 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.183155 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.183188 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.183217 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.183252 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.183276 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.184440 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:38.186555 29268 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0927 06:00:38.186584 29268 assetstore.go:111] bin/containerd I0927 06:00:38.186600 29268 assetstore.go:111] bin/containerd-shim I0927 06:00:38.186619 29268 assetstore.go:111] bin/containerd-shim-runc-v1 I0927 06:00:38.186632 29268 assetstore.go:111] bin/containerd-shim-runc-v2 I0927 06:00:38.186644 29268 assetstore.go:111] bin/containerd-stress I0927 06:00:38.186657 29268 assetstore.go:111] bin/ctr I0927 06:00:38.186724 29268 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0927 06:00:38.186748 29268 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I0927 06:00:38.190962 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.191078 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.191107 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.191158 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.191186 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.191224 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.191265 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.191286 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.191318 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.191336 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.192530 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:38.194229 29268 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0927 06:00:38.195215 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.195306 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.195331 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.195365 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.195395 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.195425 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.195490 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.195508 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.195531 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.195547 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.196611 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:38.198658 29268 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0927 06:00:38.199494 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.199582 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.199609 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.199636 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.199678 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.199712 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.199769 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.199790 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.199820 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.199840 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.201053 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:38.203713 29268 assetstore.go:108] Matching assets for "^docker/": I0927 06:00:38.203746 29268 assetstore.go:111] docker/containerd I0927 06:00:38.203760 29268 assetstore.go:111] docker/containerd-shim I0927 06:00:38.203773 29268 assetstore.go:111] docker/ctr I0927 06:00:38.203785 29268 assetstore.go:111] docker/docker I0927 06:00:38.203797 29268 assetstore.go:111] docker/docker-init I0927 06:00:38.203809 29268 assetstore.go:111] docker/docker-proxy I0927 06:00:38.203821 29268 assetstore.go:111] docker/dockerd I0927 06:00:38.203848 29268 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.01s) === RUN TestDockerBuilder_LogFlags I0927 06:00:38.209782 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.209877 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.209904 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.209934 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.209960 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.209992 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.210043 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.210065 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.210096 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.210113 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.211210 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:38.213319 29268 assetstore.go:108] Matching assets for "^docker/": I0927 06:00:38.213347 29268 assetstore.go:111] docker/containerd I0927 06:00:38.213367 29268 assetstore.go:111] docker/containerd-shim I0927 06:00:38.213382 29268 assetstore.go:111] docker/ctr I0927 06:00:38.213396 29268 assetstore.go:111] docker/docker I0927 06:00:38.213408 29268 assetstore.go:111] docker/docker-init I0927 06:00:38.213421 29268 assetstore.go:111] docker/docker-proxy I0927 06:00:38.213433 29268 assetstore.go:111] docker/dockerd I0927 06:00:38.213446 29268 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.01s) === RUN TestDockerBuilder_SkipInstall I0927 06:00:38.216916 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.217001 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.217028 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.217058 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.217087 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.217133 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.217192 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.217223 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.217266 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.217291 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.218418 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:38.220052 29268 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0927 06:00:38.220251 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.220333 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.220362 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.220399 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.220432 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.220473 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.220527 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.220557 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.220591 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.220614 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.221888 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:38.224503 29268 assetstore.go:108] Matching assets for "^docker/": I0927 06:00:38.224524 29268 assetstore.go:111] docker/docker I0927 06:00:38.224534 29268 assetstore.go:111] docker/docker-containerd I0927 06:00:38.224542 29268 assetstore.go:111] docker/docker-containerd-ctr I0927 06:00:38.224549 29268 assetstore.go:111] docker/docker-containerd-shim I0927 06:00:38.224557 29268 assetstore.go:111] docker/docker-init I0927 06:00:38.224564 29268 assetstore.go:111] docker/docker-proxy I0927 06:00:38.224571 29268 assetstore.go:111] docker/docker-runc I0927 06:00:38.224578 29268 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.01s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0927 06:00:38.232591 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.232683 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.232709 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.232759 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.232786 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.232815 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.232839 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.232855 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.232875 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.232890 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.235396 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.01s) === RUN TestDockerHooksBuilder I0927 06:00:38.238956 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.239082 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.239118 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.239160 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.239200 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.239247 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.239285 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.239312 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.239347 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.239369 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.241898 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I0927 06:00:38.245560 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.245680 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.246363 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.246406 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.246429 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.246460 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.246484 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.246512 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.246536 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.246553 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.248526 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.01s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0927 06:00:38.256840 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.256968 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.257006 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.257049 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.257091 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.257140 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.257181 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.257211 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.257246 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.257272 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.260066 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.02s) === RUN TestAuditConfigAPIServerBuilder I0927 06:00:38.274309 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.274426 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.274473 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.274513 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.274548 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.274591 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.274626 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.274653 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.274685 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.274710 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.278004 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.02s) === RUN TestOIDCConfigAPIServerBuilder I0927 06:00:38.291018 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.291146 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.291186 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.291233 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.291271 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.291317 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.291353 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.291382 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.291420 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.291446 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.293598 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I0927 06:00:38.302634 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.302753 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.302796 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.302841 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.302884 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.302933 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.302974 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.303003 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.303040 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.303069 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.306068 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0927 06:00:38.316676 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.316799 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.316836 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.316878 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.316914 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.316962 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.317001 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.317031 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.317065 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.317092 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.319603 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I0927 06:00:38.329682 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.329798 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.329835 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.329876 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.329914 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.329966 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.330005 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.330035 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.330071 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.330101 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.335071 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.02s) === RUN TestKubeAPIServerBuilderAMD64 I0927 06:00:38.347890 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:38.348020 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:38.348066 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:38.348123 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:38.348173 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:38.348230 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:38.348279 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:38.348314 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:38.348353 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:38.348390 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:38.351249 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.32s) === RUN TestKubeAPIServerBuilderARM64 I0927 06:00:39.668702 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:39.668795 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:39.668821 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:39.668854 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:39.668888 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:39.668936 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:39.668972 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:39.668993 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:39.669017 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:39.669033 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:39.670819 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.22s) === RUN TestKubeControllerManagerBuilder I0927 06:00:40.890333 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:40.890452 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:40.890484 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:40.890521 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:40.890548 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:40.890581 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:40.890611 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:40.890629 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:40.890653 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:40.890671 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:40.892586 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0927 06:00:40.899045 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:40.899133 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:40.899160 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:40.899189 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:40.899214 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:40.899244 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:40.899272 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:40.899290 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:40.899311 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:40.899327 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:40.901039 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.19s) === RUN TestKubeControllerManagerBuilderARM64 I0927 06:00:42.093804 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:42.093894 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:42.093921 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:42.093956 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:42.093983 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:42.094017 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:42.094042 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:42.094058 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:42.094081 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:42.094096 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:42.095886 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.20s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0927 06:00:43.298773 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:43.298858 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:43.298884 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:43.298912 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:43.298938 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:43.298971 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:43.298997 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:43.299013 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:43.299034 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:43.299051 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:43.302675 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I0927 06:00:43.308549 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:43.308667 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:43.308700 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:43.308742 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:43.308778 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:43.308823 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:43.308862 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:43.308891 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:43.308926 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:43.308952 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:43.311674 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.20s) === RUN TestKubeProxyBuilderARM64 I0927 06:00:44.513645 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:44.513807 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:44.513880 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:44.513967 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:44.514041 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:44.514124 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:44.514196 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:44.514263 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:44.514332 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:44.514389 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:44.517333 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.20s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0927 06:00:45.710354 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:45.710441 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:45.710467 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:45.710498 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:45.710522 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:45.710553 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:45.710576 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:45.710595 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:45.710618 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:45.710634 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:45.712243 29268 zones.go:93] ListHostedZonesPages { } W0927 06:00:45.714615 29268 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0927 06:00:45.716162 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:45.716224 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:45.716247 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:45.716276 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:45.716299 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:45.716326 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:45.716349 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:45.716367 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:45.716388 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:45.716401 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:45.717953 29268 zones.go:93] ListHostedZonesPages { } W0927 06:00:46.911936 29268 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.20s) === RUN TestKubeSchedulerBuilderARM64 I0927 06:00:46.915477 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:46.915583 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:46.915620 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:46.915665 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:46.915700 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:46.915748 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:46.915785 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:46.915813 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:46.915849 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:46.915874 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:46.917670 29268 zones.go:93] ListHostedZonesPages { } W0927 06:00:48.110087 29268 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.20s) === RUN TestKubectlBuilder I0927 06:00:48.111823 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:48.111906 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:48.111932 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:48.111961 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:48.111985 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:48.112015 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:48.112041 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:48.112057 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:48.112078 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:48.112096 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:48.113703 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:48.115515 29268 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.00s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0927 06:00:48.117253 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:48.117311 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:48.117344 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:48.117368 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:48.117390 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:48.117415 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:48.117435 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:48.117452 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:48.117473 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:48.117487 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:48.118728 29268 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.00s) === RUN Test_RunKubeletBuilderWarmPool I0927 06:00:48.122006 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:48.122057 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:48.122088 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:48.122109 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:48.122131 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:48.122159 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:48.122180 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:48.122195 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:48.122214 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:48.122228 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:48.123375 29268 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.00s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0927 06:00:48.126530 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:48.126593 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:48.126613 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:48.126633 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:48.126656 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:48.126678 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:48.126700 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:48.126719 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:48.126737 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:48.126750 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:48.128298 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:48.129917 29268 assetstore.go:108] Matching assets for "protokube$": I0927 06:00:48.129933 29268 assetstore.go:111] /opt/kops/bin/protokube I0927 06:00:48.129951 29268 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0927 06:00:48.129972 29268 assetstore.go:108] Matching assets for "channels$": I0927 06:00:48.129981 29268 assetstore.go:111] /opt/kops/bin/channels I0927 06:00:48.129988 29268 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.00s) === RUN TestSecretBuilder I0927 06:00:48.131281 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:48.131340 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:48.131359 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:48.131382 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:48.131402 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:48.131429 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:48.131450 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:48.131465 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:48.131486 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:48.131498 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:48.132965 29268 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.00s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0927 06:00:48.135005 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:48.135066 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:48.135085 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:48.135105 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:48.135124 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:48.135149 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:48.135168 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:48.135183 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:48.135201 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:48.135215 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:48.136679 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:48.138320 29268 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.00s) === RUN TestUpdateServiceBuilderExternal I0927 06:00:48.138661 29268 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:00:48.138722 29268 internetgateways.go:66] CreateInternetGateway: { } I0927 06:00:48.138742 29268 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:00:48.138765 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:00:48.138788 29268 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:00:48.138814 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:00:48.138835 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:00:48.138851 29268 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:00:48.138871 29268 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:00:48.138885 29268 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:00:48.142241 29268 zones.go:93] ListHostedZonesPages { } I0927 06:00:48.144150 29268 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.01s) PASS ok k8s.io/kops/nodeup/pkg/model 10.083s === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.033s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.025s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.025s === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0927 06:00:38.079425 29272 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0927 06:00:38.079552 29272 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.010s === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0927 06:00:38.128297 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.128392 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.128468 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.128559 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.128603 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0927 06:00:38.128892 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.128944 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.128977 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129011 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129050 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129083 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129123 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129143 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129165 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129185 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129205 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129230 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129249 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129265 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129284 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129312 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129331 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129349 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0927 06:00:38.129366 29274 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0927 06:00:38.129503 29274 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0927 06:00:38.129565 29274 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.073s === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.013s === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0927 06:00:38.105269 29275 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0927 06:00:38.106124 29275 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0927 06:00:38.108600 29275 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0927 06:00:38.109507 29275 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0927 06:00:38.110274 29275 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0927 06:00:38.111065 29275 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host W0927 06:00:38.111703 29275 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0927 06:00:38.112289 29275 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0927 06:00:38.112298 29275 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0927 06:00:38.112303 29275 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0927 06:00:38.112308 29275 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.043s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.004s === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.097s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.026s === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.105s === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.095s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.024s === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.004s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.004s === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.040s === RUN TestFlagToFalse I0927 06:00:46.108900 30641 featureflag_test.go:32] Created flag Unittest1 I0927 06:00:46.108944 30641 featureflag.go:164] FeatureFlag "UnitTest1"=false I0927 06:00:46.108954 30641 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0927 06:00:46.109022 30641 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.042s === RUN TestRenderInstanceGroupZones W0927 06:00:46.127228 30643 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.023s === RUN TestWarmPoolOnlyRoll I0927 06:00:58.068552 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.068689 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.068720 31181 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0927 06:00:58.069436 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.069466 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.070627 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.070667 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.075871 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.075929 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.075951 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.075970 31181 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0927 06:00:58.078008 31181 instancegroups.go:431] Draining the node: "master-1a.local". I0927 06:00:58.078811 31181 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0927 06:00:58.078930 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.078967 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.080104 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.080126 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.085329 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.085394 31181 instancegroups.go:431] Draining the node: "master-1b.local". I0927 06:00:58.086233 31181 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0927 06:00:58.086296 31181 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0927 06:00:58.086323 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.087454 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.087482 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.092677 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.092715 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.092728 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.092746 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.093392 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.093877 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.093902 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.095045 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.095064 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.100264 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.100370 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.101450 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.101489 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.102592 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.102618 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.107825 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.107868 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:58.108490 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.108516 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.109642 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.109668 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.114902 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.114934 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.114947 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.114959 31181 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0927 06:00:58.115680 31181 instancegroups.go:431] Draining the node: "node-2a.local". I0927 06:00:58.116143 31181 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0927 06:00:58.116169 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.117282 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.117301 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.122430 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.122482 31181 instancegroups.go:431] Draining the node: "node-2b.local". I0927 06:00:58.123056 31181 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0927 06:00:58.123082 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.124219 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.124240 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.129415 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.129466 31181 instancegroups.go:431] Draining the node: "node-2c.local". I0927 06:00:58.130352 31181 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0927 06:00:58.130388 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.131521 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.131550 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.136762 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.136816 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0927 06:00:58.137419 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.137453 31181 instancegroups.go:469] waiting for 1ms after terminating instance W0927 06:00:58.138598 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.138647 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.138693 31181 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0927 06:00:58.138711 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.138739 31181 instancegroups.go:469] waiting for 1ms after terminating instance W0927 06:00:58.139867 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.139897 31181 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0927 06:00:58.139907 31181 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0927 06:00:58.139923 31181 instancegroups.go:469] waiting for 1ms after terminating instance W0927 06:00:58.141044 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.141072 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.141111 31181 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0927 06:00:58.141140 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.141167 31181 instancegroups.go:469] waiting for 1ms after terminating instance W0927 06:00:58.142315 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.142344 31181 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0927 06:00:58.142359 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.142376 31181 instancegroups.go:469] waiting for 1ms after terminating instance W0927 06:00:58.143492 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.143529 31181 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0927 06:00:58.143546 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.143574 31181 instancegroups.go:469] waiting for 1ms after terminating instance W0927 06:00:58.144719 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.144741 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.144770 31181 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0927 06:00:58.144779 31181 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0927 06:00:58.144796 31181 instancegroups.go:469] waiting for 1ms after terminating instance W0927 06:00:58.145911 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.145945 31181 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0927 06:00:58.145959 31181 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0927 06:00:58.145984 31181 instancegroups.go:469] waiting for 1ms after terminating instance W0927 06:00:58.147120 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0927 06:00:58.147149 31181 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0927 06:00:58.147159 31181 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0927 06:00:58.147175 31181 instancegroups.go:469] waiting for 1ms after terminating instance W0927 06:00:58.148288 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0927 06:00:58.148315 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0927 06:00:58.148652 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.148683 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.149832 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.149860 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.149873 31181 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.149911 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.149925 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.149934 31181 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.149942 31181 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0927 06:00:58.150494 31181 instancegroups.go:431] Draining the node: "master-1a.local". I0927 06:00:58.150917 31181 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0927 06:00:58.150969 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.150986 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.152104 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.152130 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.152148 31181 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.152178 31181 instancegroups.go:431] Draining the node: "master-1b.local". I0927 06:00:58.152925 31181 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0927 06:00:58.152976 31181 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0927 06:00:58.153004 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.154149 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.154173 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.154186 31181 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.154201 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.154212 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.154237 31181 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.154248 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.154847 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.155290 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.155311 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.156440 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.156478 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.156504 31181 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.156546 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.157612 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.157654 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.158824 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.158873 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.158893 31181 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.158928 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:58.159540 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.159568 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.160702 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.160737 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.160761 31181 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.160783 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.160811 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.160831 31181 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.160851 31181 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0927 06:00:58.162045 31181 instancegroups.go:431] Draining the node: "node-2a.local". I0927 06:00:58.162987 31181 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0927 06:00:58.163029 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.164200 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.164230 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.164246 31181 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.164279 31181 instancegroups.go:431] Draining the node: "node-2b.local". I0927 06:00:58.165033 31181 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0927 06:00:58.165062 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.166198 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.166236 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.166274 31181 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.166318 31181 instancegroups.go:431] Draining the node: "node-2c.local". I0927 06:00:58.167336 31181 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0927 06:00:58.167378 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.168517 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.168547 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0927 06:00:58.168564 31181 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0927 06:00:58.168581 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I0927 06:00:58.168827 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0927 06:00:58.169029 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.169063 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.170221 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.170253 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.175512 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.175585 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.175613 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.175640 31181 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0927 06:00:58.176562 31181 instancegroups.go:431] Draining the node: "master-1a.local". I0927 06:00:58.177469 31181 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0927 06:00:58.177554 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.177595 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.178749 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.178782 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.184000 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.184055 31181 instancegroups.go:431] Draining the node: "master-1b.local". I0927 06:00:58.185190 31181 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0927 06:00:58.185269 31181 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0927 06:00:58.185325 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.186476 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.186510 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.191758 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.191815 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.191846 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.191889 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.193224 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.194265 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.194309 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.195461 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.195493 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.200701 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.200746 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.201459 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.201489 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.202629 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.202664 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.207935 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.208010 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:58.208627 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.208659 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.209798 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.209843 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.215077 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.215113 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.215126 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.215136 31181 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0927 06:00:58.215876 31181 instancegroups.go:431] Draining the node: "node-2a.local". I0927 06:00:58.216407 31181 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0927 06:00:58.216435 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.217566 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.217593 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.222827 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.222875 31181 instancegroups.go:431] Draining the node: "node-2b.local". I0927 06:00:58.223494 31181 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0927 06:00:58.223520 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.224638 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.224664 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.229869 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.229929 31181 instancegroups.go:431] Draining the node: "node-2c.local". I0927 06:00:58.230795 31181 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0927 06:00:58.230822 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.231943 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.231967 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.237171 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.237203 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.07s) === RUN TestRollingUpdateEmptyGroup I0927 06:00:58.237333 31181 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0927 06:00:58.238995 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.239044 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.240192 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.240244 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0927 06:00:58.240265 31181 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0927 06:00:58.240565 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.240588 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.241703 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.241725 31181 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0927 06:00:58.241739 31181 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0927 06:00:58.241903 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.241919 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0927 06:00:58.241928 31181 instancegroups.go:509] Cluster did not validate within 0s E0927 06:00:58.241936 31181 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0927 06:00:58.242031 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.242044 31181 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0927 06:00:58.242053 31181 instancegroups.go:509] Cluster did not validate within 0s E0927 06:00:58.242061 31181 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0927 06:00:58.242196 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.242213 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.243354 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.243376 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.248571 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.248622 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.248636 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.248645 31181 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0927 06:00:58.249208 31181 instancegroups.go:431] Draining the node: "master-1a.local". I0927 06:00:58.249648 31181 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0927 06:00:58.249704 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.249723 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.250859 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.250889 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0927 06:00:58.250902 31181 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0927 06:00:58.251117 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.251153 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.252278 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.252308 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.257537 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.257602 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.257621 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.257630 31181 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0927 06:00:58.258198 31181 instancegroups.go:431] Draining the node: "master-1a.local". I0927 06:00:58.258639 31181 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0927 06:00:58.258697 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.258717 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.259861 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.259885 31181 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0927 06:00:58.259900 31181 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0927 06:00:58.260137 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.260153 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.260160 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.260745 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.261204 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.261226 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.262372 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.262392 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.267565 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.267633 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.268674 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.268714 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.269849 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.269876 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.275098 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.275169 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:58.276202 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.276238 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.277368 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.277395 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.282625 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.282679 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0927 06:00:58.283078 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.283109 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0927 06:00:58.283133 31181 instancegroups.go:509] Cluster did not validate within 0s E0927 06:00:58.283150 31181 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0927 06:00:58.283433 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.283459 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0927 06:00:58.283476 31181 instancegroups.go:509] Cluster did not validate within 0s E0927 06:00:58.283492 31181 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0927 06:00:58.283743 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.283769 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0927 06:00:58.283785 31181 instancegroups.go:509] Cluster did not validate within 0s E0927 06:00:58.283799 31181 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0927 06:00:58.284062 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.284084 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.284102 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.285306 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.286136 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.286174 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.287309 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.287340 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.292557 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.292621 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.293588 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.293622 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.294728 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.294756 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.299966 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.300027 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:58.300971 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.301011 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.302131 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.302152 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.307366 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.307406 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.307431 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0927 06:00:58.307456 31181 instancegroups.go:509] Cluster did not validate within 0s E0927 06:00:58.307472 31181 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0927 06:00:58.307776 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.307817 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.307829 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.308791 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.309455 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.309486 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.310620 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.310663 31181 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0927 06:00:58.310676 31181 instancegroups.go:509] Cluster did not validate within 0s E0927 06:00:58.310688 31181 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0927 06:00:58.310889 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.310907 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.310916 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.311563 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.312020 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.312042 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.313176 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.313206 31181 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0927 06:00:58.313222 31181 instancegroups.go:509] Cluster did not validate within 0s E0927 06:00:58.313232 31181 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0927 06:00:58.313414 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.313432 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.314556 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.314594 31181 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0927 06:00:58.315700 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.320918 31181 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0927 06:00:58.322066 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.327302 31181 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0927 06:00:58.328435 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.333646 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.333721 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.333740 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.333750 31181 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0927 06:00:58.334302 31181 instancegroups.go:431] Draining the node: "master-1a.local". I0927 06:00:58.334960 31181 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0927 06:00:58.335034 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.335061 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.336198 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.336243 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.341513 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.341589 31181 instancegroups.go:431] Draining the node: "master-1b.local". I0927 06:00:58.342516 31181 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0927 06:00:58.342594 31181 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0927 06:00:58.342625 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.343767 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.343828 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.349069 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.349123 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.349157 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.349176 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.350242 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.351038 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.351072 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.352206 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.352261 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.357494 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.357560 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.358220 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.358246 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.359370 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.359410 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.364676 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.364751 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:58.365671 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.365703 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.366834 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.366879 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.372105 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.372150 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.372187 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.372202 31181 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0927 06:00:58.373134 31181 instancegroups.go:431] Draining the node: "node-2a.local". I0927 06:00:58.373901 31181 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0927 06:00:58.373933 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.375073 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.375131 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.380362 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.380429 31181 instancegroups.go:431] Draining the node: "node-2b.local". I0927 06:00:58.381089 31181 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0927 06:00:58.381117 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.382260 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.382302 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.387514 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.387570 31181 instancegroups.go:431] Draining the node: "node-2c.local". I0927 06:00:58.388203 31181 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0927 06:00:58.388227 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.389356 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.389399 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.394665 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.394707 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0927 06:00:58.394978 31181 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0927 06:00:58.395001 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.396129 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.396162 31181 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0927 06:00:58.397306 31181 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0927 06:00:58.398431 31181 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0927 06:00:58.399537 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.404749 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.404850 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.404883 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.404903 31181 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0927 06:00:58.406092 31181 instancegroups.go:431] Draining the node: "master-1a.local". I0927 06:00:58.406867 31181 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0927 06:00:58.406940 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.406973 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.408599 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.408654 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.416761 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.416835 31181 instancegroups.go:431] Draining the node: "master-1b.local". I0927 06:00:58.417545 31181 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0927 06:00:58.417615 31181 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0927 06:00:58.417645 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.418843 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.418896 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.424126 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.424186 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.424210 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.424230 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.425339 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.426143 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.426180 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.427353 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.427390 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.432603 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.432686 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.433625 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.433661 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.434825 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.434868 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.440078 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.440140 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:58.440740 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.440764 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.441917 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.441944 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.447154 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.447196 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.447210 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.447221 31181 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0927 06:00:58.447979 31181 instancegroups.go:431] Draining the node: "node-2a.local". I0927 06:00:58.448700 31181 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0927 06:00:58.448781 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.449971 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.450023 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.455211 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.455256 31181 instancegroups.go:431] Draining the node: "node-2b.local". I0927 06:00:58.455907 31181 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0927 06:00:58.455934 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.457076 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.457104 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.463061 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.463130 31181 instancegroups.go:431] Draining the node: "node-2c.local". I0927 06:00:58.463779 31181 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0927 06:00:58.463805 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.464955 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.464980 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.470175 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.470219 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.08s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0927 06:00:58.470660 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.470675 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.470683 31181 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0927 06:00:58.471213 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.471663 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.471685 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.472829 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.472849 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.478053 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.478116 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.479071 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.479111 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.480251 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.480283 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.485502 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.485545 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.02s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0927 06:00:58.485846 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.485868 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.485880 31181 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0927 06:00:58.486595 31181 instancegroups.go:431] Draining the node: "master-1a.local". I0927 06:00:58.487234 31181 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0927 06:00:58.487298 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.487324 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.488472 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.488492 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.493677 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.493742 31181 instancegroups.go:431] Draining the node: "master-1b.local". I0927 06:00:58.494516 31181 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0927 06:00:58.494579 31181 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0927 06:00:58.494606 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.495757 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.495777 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.500981 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.501023 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.02s) === RUN TestRollingUpdateDisabled I0927 06:00:58.501396 31181 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0927 06:00:58.501433 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0927 06:00:58.501454 31181 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0927 06:00:58.501468 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0927 06:00:58.501485 31181 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0927 06:00:58.501497 31181 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0927 06:00:58.501515 31181 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0927 06:00:58.501530 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0927 06:00:58.501760 31181 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0927 06:00:58.501809 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:58.502965 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.502995 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.508192 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.508244 31181 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0927 06:00:58.508297 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.508318 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.508331 31181 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0927 06:00:58.509083 31181 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0927 06:00:58.509106 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.509122 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.509135 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:58.509909 31181 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0927 06:00:58.509966 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:58.511097 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.511132 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.516323 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.516358 31181 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0927 06:00:58.516378 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.516399 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.516413 31181 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0927 06:00:58.517309 31181 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0927 06:00:58.517366 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:58.518488 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.518513 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:58.523705 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.523738 31181 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0927 06:00:58.523759 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0927 06:00:58.524048 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.524076 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.524089 31181 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0927 06:00:58.525998 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.526668 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.526707 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.527829 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.527866 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.527904 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:58.527923 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.528920 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.529146 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.529181 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.530290 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.530332 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.630697 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.630759 31181 instancegroups.go:431] Draining the node: "node-1e.local". I0927 06:00:58.630783 31181 instancegroups.go:431] Draining the node: "node-1d.local". I0927 06:00:58.631702 31181 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0927 06:00:58.631935 31181 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0927 06:00:58.631975 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.633110 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.633147 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.633180 31181 instancegroups.go:431] Draining the node: "node-1f.local". I0927 06:00:58.633950 31181 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0927 06:00:58.633990 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.635105 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.635150 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.735585 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.735646 31181 instancegroups.go:431] Draining the node: "node-1g.local". I0927 06:00:58.736293 31181 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0927 06:00:58.736329 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.737479 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.737508 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.737521 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0927 06:00:58.737694 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.737712 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.737720 31181 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0927 06:00:58.738757 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:58.738787 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:58.739515 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:58.739673 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:58.739699 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.740854 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.740900 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.841313 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.841382 31181 instancegroups.go:431] Draining the node: "node-1d.local". I0927 06:00:58.841429 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:58.842015 31181 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0927 06:00:58.842388 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:58.842417 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.843567 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.843595 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.843617 31181 instancegroups.go:431] Draining the node: "node-1e.local". I0927 06:00:58.844065 31181 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0927 06:00:58.844090 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.845234 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.845279 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.945769 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.945847 31181 instancegroups.go:431] Draining the node: "node-1f.local". I0927 06:00:58.946716 31181 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0927 06:00:58.946766 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.947923 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.947947 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.947960 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0927 06:00:58.948130 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.948150 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.948158 31181 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0927 06:00:58.951608 31181 instancegroups.go:431] Draining the node: "master-1a.local". I0927 06:00:58.952250 31181 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0927 06:00:58.952318 31181 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0927 06:00:58.952359 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.953482 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.953512 31181 instancegroups.go:540] Cluster validated. I0927 06:00:58.953537 31181 instancegroups.go:431] Draining the node: "master-1c.local". I0927 06:00:58.953586 31181 instancegroups.go:431] Draining the node: "master-1b.local". I0927 06:00:58.953997 31181 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0927 06:00:58.954031 31181 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0927 06:00:58.954360 31181 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0927 06:00:58.954391 31181 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0927 06:00:58.954410 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:58.955494 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:58.955527 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.055946 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.056017 31181 instancegroups.go:431] Draining the node: "master-1e.local". I0927 06:00:59.056048 31181 instancegroups.go:431] Draining the node: "master-1d.local". I0927 06:00:59.057156 31181 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0927 06:00:59.057263 31181 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0927 06:00:59.057415 31181 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0927 06:00:59.057445 31181 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0927 06:00:59.057469 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.058635 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.058665 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.058703 31181 instancegroups.go:431] Draining the node: "master-1f.local". I0927 06:00:59.059167 31181 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0927 06:00:59.059202 31181 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0927 06:00:59.059222 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.060333 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.060369 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.160805 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.160882 31181 instancegroups.go:431] Draining the node: "master-1g.local". I0927 06:00:59.161733 31181 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0927 06:00:59.161798 31181 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0927 06:00:59.161845 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.162984 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.163013 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.163026 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.22s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0927 06:00:59.163212 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.163233 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.163241 31181 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0927 06:00:59.164243 31181 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0927 06:00:59.164284 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:59.165399 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.165432 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.165444 31181 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0927 06:00:59.165491 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:59.166638 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.166672 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.166710 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:59.166747 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:59.167291 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:59.167681 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:59.167709 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.168822 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.168868 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.269331 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.269405 31181 instancegroups.go:431] Draining the node: "node-1d.local". I0927 06:00:59.269418 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:59.270585 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:59.270823 31181 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0927 06:00:59.270862 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.272003 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.272043 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.272080 31181 instancegroups.go:431] Draining the node: "node-1e.local". I0927 06:00:59.272864 31181 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0927 06:00:59.272913 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.274035 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.274083 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.374527 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.374604 31181 instancegroups.go:431] Draining the node: "node-1f.local". I0927 06:00:59.375576 31181 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0927 06:00:59.375633 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.376769 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.376813 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.376829 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0927 06:00:59.377057 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.377079 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.377088 31181 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0927 06:00:59.378244 31181 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0927 06:00:59.378279 31181 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0927 06:00:59.378305 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:59.379452 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.379499 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.379550 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:59.379561 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:59.380639 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:59.380901 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:59.380946 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.382102 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.382148 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.482571 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.482635 31181 instancegroups.go:431] Draining the node: "node-1d.local". I0927 06:00:59.482683 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:59.483261 31181 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0927 06:00:59.483623 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:59.483651 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.484795 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.484824 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.484845 31181 instancegroups.go:431] Draining the node: "node-1e.local". I0927 06:00:59.485327 31181 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0927 06:00:59.485358 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.486501 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.486542 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.587175 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.587238 31181 instancegroups.go:431] Draining the node: "node-1f.local". I0927 06:00:59.587892 31181 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0927 06:00:59.587933 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.589056 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.589084 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.589097 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0927 06:00:59.589248 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.589261 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.589269 31181 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0927 06:00:59.589668 31181 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0927 06:00:59.589688 31181 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0927 06:00:59.589709 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:59.590847 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.590867 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:59.596046 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.596097 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:59.596122 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:59.597069 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:59.597096 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.597322 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:59.597352 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.598222 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.598248 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:59.603482 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.603522 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0927 06:00:59.603800 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.603823 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.603836 31181 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0927 06:00:59.604581 31181 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0927 06:00:59.604634 31181 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0927 06:00:59.604649 31181 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0927 06:00:59.604689 31181 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0927 06:00:59.604722 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:59.605841 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.605864 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:59.611066 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.611136 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:59.611151 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:59.612077 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:59.612104 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.612308 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:59.612338 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.613240 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.613260 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:59.618472 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.618505 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0927 06:00:59.618741 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.618769 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.618782 31181 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0927 06:00:59.619899 31181 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0927 06:00:59.619956 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:59.621102 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.621142 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.621153 31181 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0927 06:00:59.621185 31181 instancegroups.go:203] waiting for 1ms after detaching instance I0927 06:00:59.622291 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.622323 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.622361 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:59.622374 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:59.622417 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:59.623629 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:59.623677 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.623868 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:59.623907 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.624128 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:59.624168 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.624790 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.725395 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.725469 31181 instancegroups.go:431] Draining the node: "node-1d.local". I0927 06:00:59.726414 31181 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0927 06:00:59.726464 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.727614 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.727656 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.727677 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0927 06:00:59.727944 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.727972 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.727986 31181 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0927 06:00:59.729948 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:59.730637 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:59.730679 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.731810 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.731845 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.731879 31181 instancegroups.go:431] Draining the node: "node-1e.local". I0927 06:00:59.731902 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:59.732767 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:59.732946 31181 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0927 06:00:59.732982 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.734112 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.734168 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.834801 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.834870 31181 instancegroups.go:431] Draining the node: "node-1g.local". I0927 06:00:59.834886 31181 instancegroups.go:431] Draining the node: "node-1f.local". I0927 06:00:59.835840 31181 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0927 06:00:59.836096 31181 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0927 06:00:59.836139 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.837292 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.837319 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.837340 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:59.837872 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:59.837899 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.839012 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.839055 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.939667 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.939726 31181 instancegroups.go:431] Draining the node: "node-1d.local". I0927 06:00:59.940326 31181 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0927 06:00:59.940361 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.941501 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.941529 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.941543 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0927 06:00:59.941702 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.941716 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.941726 31181 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0927 06:00:59.941739 31181 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0927 06:00:59.941751 31181 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0927 06:00:59.941764 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0927 06:00:59.941847 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.941860 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.941867 31181 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0927 06:00:59.942412 31181 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0927 06:00:59.942429 31181 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0927 06:00:59.942440 31181 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0927 06:00:59.942463 31181 instancegroups.go:431] Draining the node: "node-1a.local". I0927 06:00:59.942870 31181 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0927 06:00:59.942889 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.944029 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.944048 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:59.952642 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.952702 31181 instancegroups.go:431] Draining the node: "node-1b.local". I0927 06:00:59.953298 31181 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0927 06:00:59.953324 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.954806 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.954835 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:59.960079 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.960127 31181 instancegroups.go:431] Draining the node: "node-1c.local". I0927 06:00:59.960685 31181 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0927 06:00:59.960709 31181 instancegroups.go:469] waiting for 1ms after terminating instance I0927 06:00:59.961830 31181 instancegroups.go:504] Validating the cluster. I0927 06:00:59.961854 31181 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0927 06:00:59.967056 31181 instancegroups.go:540] Cluster validated. I0927 06:00:59.967085 31181 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.03s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 2.008s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.103s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) PASS ok k8s.io/kops/pkg/k8scodecs 0.109s === RUN TestParse E0927 06:00:58.068611 31184 versions.go:96] unable to parse Kubernetes version "" E0927 06:00:58.068742 31184 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.104s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.113s === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.15s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.253s === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.121s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.111s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.110s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0927 06:00:58.069535 31190 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.109s === RUN Test_RunEtcdManagerBuilder I0927 06:00:58.068521 31191 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0927 06:00:58.122643 31191 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0927 06:00:58.125732 31191 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.06s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.02s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.170s === RUN Test_RunKubeApiserverBuilder I0927 06:00:58.068473 31192 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.121s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.119s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.104s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.060s === RUN TestServerGroupBuilder I0927 06:01:06.063896 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.076381 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.089866 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.112568 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.180938 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.198366 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.221866 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.237551 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.254233 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.330659 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.342829 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.351953 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.360765 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.370121 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.378020 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.386841 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.392554 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.398498 32117 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.39s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.480s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.041s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.041s === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.032s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.01s) --- PASS: TestGenerateCertificate/selfsigned (0.01s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (1.44s) --- PASS: TestIssueCert/ca (0.60s) --- PASS: TestIssueCert/client (0.54s) --- PASS: TestIssueCert/clientOneYear (0.30s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 1.458s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.004s === RUN TestAddUntaggedRouteTables I0927 06:01:06.055392 32125 routetable.go:53] DescribeRouteTables: { } I0927 06:01:06.055530 32125 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") W0927 06:01:06.055553 32125 tags.go:67] cluster tag not found on route-table:rtb-1234 --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0927 06:01:06.055700 32125 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0927 06:01:06.055808 32125 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0927 06:01:06.055926 32125 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0927 06:01:06.056075 32125 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0927 06:01:06.056179 32125 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0927 06:01:06.056308 32125 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0927 06:01:06.056436 32125 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0927 06:01:06.056493 32125 volumes.go:128] DescribeVolumes: { } W0927 06:01:06.056564 32125 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0927 06:01:06.056767 32125 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:06.056893 32125 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:06.056948 32125 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:06.057040 32125 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:06.057087 32125 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:06.057172 32125 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:06.057230 32125 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:06.057266 32125 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:06.057311 32125 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:06.057344 32125 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:06.057385 32125 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0927 06:01:06.057427 32125 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0927 06:01:06.057477 32125 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0927 06:01:06.057541 32125 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0927 06:01:06.057586 32125 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0927 06:01:06.057645 32125 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0927 06:01:06.057699 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0927 06:01:06.057749 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0927 06:01:06.057785 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0927 06:01:06.057837 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0927 06:01:06.057876 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0927 06:01:06.057916 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0927 06:01:06.057963 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0927 06:01:06.058002 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0927 06:01:06.058045 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0927 06:01:06.058082 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0927 06:01:06.058127 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0927 06:01:06.058165 32125 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.080s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.042s === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.070s === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.004s === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.003s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.003s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.003s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.01s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.052s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.093s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.007s === RUN TestRemovesDuplicateGuardedBlocks W0927 06:01:13.272293 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.272346 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.272353 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.272360 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.272366 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.272373 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.272379 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.272385 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.272391 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.272397 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.272403 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.272409 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.272415 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.272421 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.272428 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.272434 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.279870 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.279912 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.280018 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.280037 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.280129 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.280147 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.280244 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.280261 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.280354 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.280371 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.280481 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.280499 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.280598 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.280615 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.280731 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.280748 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.281188 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.281225 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.281349 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.281368 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.281469 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.281487 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.281577 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.281593 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.281685 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.281702 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.281789 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.281806 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.281895 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.281912 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.282001 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.282018 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.282107 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.282134 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.282223 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.282239 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.282326 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.282344 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.282430 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.282447 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.282583 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.282601 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.282690 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.282707 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.282795 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.282812 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.282900 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.282917 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283004 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283039 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283128 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283144 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283233 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283251 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283340 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283357 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283446 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283464 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283563 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283578 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283656 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283667 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283768 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283787 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283873 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283890 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.283981 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.283997 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.284083 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.284099 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.284203 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.284222 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.284323 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.284339 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.284429 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.284446 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.284570 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.284588 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.284691 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.284708 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.284796 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.284814 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.284906 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.284925 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285054 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285068 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285122 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285134 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285186 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285197 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285250 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285261 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285315 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285340 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285409 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285420 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285475 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285485 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285537 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285547 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285601 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285612 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285663 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285674 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285730 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285743 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285796 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285806 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285859 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285870 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285925 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285936 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.285988 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.285999 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286052 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286063 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286115 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286185 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286267 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286283 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286351 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286366 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286435 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286449 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286516 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286530 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286601 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286615 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286703 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286718 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286786 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286801 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286882 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286898 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.286965 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.286979 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287047 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287062 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287129 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287144 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287210 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287224 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287293 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287307 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287375 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287389 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287459 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287474 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287540 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287555 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287621 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287635 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287704 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287718 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287802 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287822 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.287914 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.287970 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288135 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288156 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288242 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288261 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288346 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288358 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288413 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288424 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288477 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288487 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288542 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288553 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288606 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288616 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288694 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288706 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288760 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288771 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.288823 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.288833 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.289476 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.289489 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.289555 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.289566 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.289629 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.289640 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.289702 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.289713 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.289780 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.289791 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.289854 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.289866 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.289929 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.289940 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.289999 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290010 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.290071 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290082 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.290164 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290185 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W0927 06:01:13.290598 33380 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0927 06:01:13.290609 33380 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0927 06:01:13.290621 33380 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0927 06:01:13.290632 33380 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0927 06:01:13.290639 33380 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0927 06:01:13.290645 33380 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0927 06:01:13.290651 33380 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0927 06:01:13.290674 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290684 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290694 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.290707 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290719 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.290728 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290735 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.290742 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290749 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.290755 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290762 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290769 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290776 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290784 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.290799 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.290811 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.308437 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.308466 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.308533 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.308554 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.308615 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.308626 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.308686 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.308696 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.308753 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.308763 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.308819 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.308829 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.308882 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.308893 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.308994 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309005 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309068 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309078 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309134 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309145 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309208 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309218 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309275 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309288 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309359 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309375 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309436 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309452 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309515 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309538 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309589 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309599 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309644 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309653 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309695 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309705 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309750 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309760 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309805 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309814 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309860 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309870 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309912 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309921 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.309964 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.309973 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310017 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310026 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310068 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310077 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310130 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310140 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310184 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310193 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310238 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310247 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310290 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310299 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310342 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310350 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310392 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310401 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310459 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310469 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310513 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310522 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310566 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310576 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310618 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310628 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310670 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310679 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310723 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310733 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310775 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310784 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310833 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310842 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310885 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310894 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.310938 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.310947 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311003 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311014 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311059 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311067 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311111 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311131 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311180 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311188 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311243 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311256 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311304 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311313 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311356 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311365 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311407 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311417 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311461 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311470 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311512 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311521 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311566 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311575 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311618 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311627 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311671 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311680 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311722 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311731 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311789 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311799 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311842 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311849 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311894 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311903 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311945 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.311954 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.311998 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312008 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312050 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312059 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312101 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312110 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312155 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312164 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312208 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312217 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312261 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312270 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312312 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312322 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312364 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312373 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312415 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312424 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312466 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312475 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312517 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312526 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312569 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312578 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312619 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312628 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312670 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312679 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312721 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312730 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312772 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312781 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312842 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312852 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312896 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312905 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312948 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.312957 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.312999 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313009 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313065 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313075 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313138 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313148 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313192 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313201 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313244 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313254 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313298 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313308 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313350 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313360 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313402 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313411 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313453 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313462 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313504 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313514 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313558 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313567 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313611 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313620 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313662 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313671 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313716 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313725 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313768 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313777 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313828 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313842 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313888 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313897 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313940 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.313949 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.313991 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.314000 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.314042 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.314051 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0927 06:01:13.314092 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0927 06:01:13.314101 33380 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.02s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.046s === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.040s === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.03s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.01s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.077s === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.042s === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0927 06:01:13.302518 33384 files.go:57] Writing file "/tmp/TestWriteFile916054883/001/SubDir/test1.tmp" I0927 06:01:13.302654 33384 files.go:113] Changing file mode for "/tmp/TestWriteFile916054883/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.042s === RUN TestBootstrapChannelBuilder_BuildTasks I0927 06:01:17.114254 34200 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:17.114478 34200 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:17.114531 34200 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:17.114576 34200 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:17.114625 34200 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:17.114691 34200 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:17.114739 34200 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:17.114768 34200 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:17.114822 34200 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:17.114864 34200 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:17.128123 34200 zones.go:93] ListHostedZonesPages { } I0927 06:01:17.298176 34200 zones.go:93] ListHostedZonesPages { } I0927 06:01:17.477302 34200 zones.go:93] ListHostedZonesPages { } I0927 06:01:17.626452 34200 zones.go:93] ListHostedZonesPages { } I0927 06:01:17.781344 34200 zones.go:93] ListHostedZonesPages { } I0927 06:01:17.918663 34200 zones.go:93] ListHostedZonesPages { } I0927 06:01:18.025465 34200 zones.go:93] ListHostedZonesPages { } I0927 06:01:18.202079 34200 zones.go:93] ListHostedZonesPages { } I0927 06:01:18.741944 34200 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.75s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0927 06:01:18.866993 34200 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:18.867079 34200 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:18.867128 34200 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:18.867162 34200 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:18.867187 34200 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:18.867221 34200 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:18.867247 34200 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:18.867263 34200 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:18.867287 34200 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:18.867305 34200 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:18.867327 34200 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0927 06:01:18.868527 34200 zones.go:93] ListHostedZonesPages { } I0927 06:01:19.009926 34200 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.14s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0927 06:01:19.010085 34200 featureflag.go:164] FeatureFlag "ImageDigest"=false I0927 06:01:19.010180 34200 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:19.010243 34200 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0927 06:01:19.010291 34200 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0927 06:01:19.010339 34200 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0927 06:01:19.010387 34200 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0927 06:01:19.010425 34200 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0927 06:01:19.010458 34200 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0927 06:01:19.010497 34200 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0927 06:01:19.010524 34200 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0927 06:01:19.012395 34200 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.12s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.08s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0927 06:01:19.229056 34200 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0927 06:01:19.261425 34200 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0927 06:01:19.261483 34200 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0927 06:01:19.261498 34200 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0927 06:01:19.261550 34200 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0927 06:01:19.261565 34200 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0927 06:01:19.261617 34200 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0927 06:01:19.261670 34200 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0927 06:01:19.261731 34200 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0927 06:01:19.261756 34200 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0927 06:01:19.261867 34200 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0927 06:01:19.261884 34200 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0927 06:01:19.261965 34200 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0927 06:01:19.262048 34200 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0927 06:01:19.262104 34200 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0927 06:01:19.262117 34200 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0927 06:01:19.262130 34200 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0927 06:01:19.262142 34200 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0927 06:01:19.262155 34200 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0927 06:01:19.262169 34200 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0927 06:01:19.262182 34200 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0927 06:01:19.262195 34200 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0927 06:01:19.263207 34200 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0927 06:01:19.263386 34200 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.245s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0927 06:01:17.089793 34201 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3704335985/001 I0927 06:01:17.090094 34201 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3704335985/001 I0927 06:01:17.090317 34201 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3704335985/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0927 06:01:17.094899 34201 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0927 06:01:17.094988 34201 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0927 06:01:17.095054 34201 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0927 06:01:17.095171 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.095344 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.095416 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.095447 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.095664 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:01:17.095697 34201 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0927 06:01:17.095729 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.095793 34201 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0927 06:01:17.095885 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0927 06:01:17.095939 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.095986 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.096022 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.096037 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.096066 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.096098 34201 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0927 06:01:17.096147 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0927 06:01:17.096268 34201 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0927 06:01:17.096310 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.096407 34201 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0927 06:01:17.096442 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:01:17.096462 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.096483 34201 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0927 06:01:17.096548 34201 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0927 06:01:17.096705 34201 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0927 06:01:17.096769 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:01:17.096800 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.096824 34201 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0927 06:01:17.096876 34201 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:01:17.097019 34201 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0927 06:01:17.097071 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:01:17.097092 34201 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" },{ Key: "AssociatedElasticIp", Value: "192.0.2.1" }] } I0927 06:01:17.097128 34201 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0927 06:01:17.097192 34201 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0927 06:01:17.097228 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.097267 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.097282 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.097305 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.097327 34201 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0927 06:01:17.097363 34201 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0927 06:01:17.097413 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.097435 34201 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0927 06:01:17.097470 34201 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:01:17.097514 34201 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0927 06:01:17.097538 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0927 06:01:17.097573 34201 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0927 06:01:17.097623 34201 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0927 06:01:17.097662 34201 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0927 06:01:17.097683 34201 internetgateways.go:66] CreateInternetGateway: { } I0927 06:01:17.097698 34201 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0927 06:01:17.097744 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.097779 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.097832 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.097846 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.097908 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:01:17.097930 34201 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0927 06:01:17.097958 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.098012 34201 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0927 06:01:17.098079 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0927 06:01:17.098128 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.098161 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.098195 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.098210 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.098238 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.098270 34201 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0927 06:01:17.098321 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0927 06:01:17.098752 34201 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender4013139079/001 I0927 06:01:17.098974 34201 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender4013139079/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0927 06:01:17.099303 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.099342 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.099421 34201 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0927 06:01:17.099456 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:01:17.099476 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.099497 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.099554 34201 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0927 06:01:17.099738 34201 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0927 06:01:17.099790 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0927 06:01:17.099821 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0927 06:01:17.099876 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.099913 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.099955 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.099970 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.099993 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.100014 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.100048 34201 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0927 06:01:17.100125 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0927 06:01:17.100336 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.100373 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.100449 34201 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0927 06:01:17.100512 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:01:17.100536 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.100557 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.100594 34201 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0927 06:01:17.100680 34201 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0927 06:01:17.100717 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:01:17.100736 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.100757 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0927 06:01:17.100819 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.100855 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.100893 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.100907 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.100931 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.100952 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.100984 34201 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0927 06:01:17.101032 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.101055 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0927 06:01:17.101190 34201 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0927 06:01:17.101231 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.101303 34201 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0927 06:01:17.101339 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:01:17.101361 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.101383 34201 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0927 06:01:17.101418 34201 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0927 06:01:17.101512 34201 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0927 06:01:17.101530 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.101715 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:01:17.101754 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.101775 34201 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0927 06:01:17.101833 34201 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0927 06:01:17.101905 34201 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0927 06:01:17.101952 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.101995 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.102010 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.102035 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.102058 34201 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0927 06:01:17.102093 34201 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0927 06:01:17.102146 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.102210 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.102328 34201 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0927 06:01:17.102483 34201 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0927 06:01:17.102527 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.102623 34201 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0927 06:01:17.102669 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:01:17.102692 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.102717 34201 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0927 06:01:17.102763 34201 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0927 06:01:17.102891 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.102935 34201 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0927 06:01:17.102991 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:01:17.103016 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.103038 34201 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0927 06:01:17.103069 34201 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0927 06:01:17.103146 34201 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0927 06:01:17.103185 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.103227 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.103243 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.103268 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.103291 34201 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0927 06:01:17.103327 34201 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0927 06:01:17.103413 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.103438 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.103496 34201 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0927 06:01:17.103554 34201 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0927 06:01:17.103612 34201 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0927 06:01:17.103684 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.103722 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.103758 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.103773 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.103840 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:01:17.103866 34201 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0927 06:01:17.103895 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.103929 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.104024 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0927 06:01:17.104048 34201 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0927 06:01:17.104076 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0927 06:01:17.104149 34201 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0927 06:01:17.104185 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.104223 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.104240 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.104269 34201 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0927 06:01:17.104300 34201 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0927 06:01:17.104348 34201 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0927 06:01:17.104422 34201 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:17.104564 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.104646 34201 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0927 06:01:17.104681 34201 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0927 06:01:17.104703 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.104724 34201 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0927 06:01:17.104784 34201 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:17.104822 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0927 06:01:17.104860 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.104873 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.104897 34201 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0927 06:01:17.104919 34201 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0927 06:01:17.105013 34201 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0927 06:01:17.105068 34201 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:17.105102 34201 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0927 06:01:17.105139 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0927 06:01:17.105152 34201 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0927 06:01:17.105180 34201 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.069s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.086s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.035s === RUN TestDiskRenderAzure I0927 06:01:17.187773 34275 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0927 06:01:17.188532 34275 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0927 06:01:17.189012 34275 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0927 06:01:17.190124 34275 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0927 06:01:17.190552 34275 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0927 06:01:17.191015 34275 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0927 06:01:17.191442 34275 resourcegroup.go:108] Creating a new Resource Group with name: rg I0927 06:01:17.191478 34275 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0927 06:01:17.191829 34275 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0927 06:01:17.192805 34275 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0927 06:01:17.193246 34275 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0927 06:01:17.193617 34275 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0927 06:01:17.194180 34275 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0927 06:01:17.194649 34275 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.052s === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.037s === RUN TestProjectIAMBinding I0927 06:01:19.503850 35169 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:19.504378 35169 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0927 06:01:19.504401 35169 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:19.504893 35169 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0927 06:01:19.504920 35169 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:19.505052 35169 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0927 06:01:19.505149 35169 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:19.505235 35169 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0927 06:01:19.505272 35169 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:19.505388 35169 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0927 06:01:19.505410 35169 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:19.505453 35169 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0927 06:01:19.505554 35169 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:19.505803 35169 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0927 06:01:19.505824 35169 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:19.506150 35169 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0927 06:01:19.506176 35169 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0927 06:01:19.506302 35169 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.063s === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.01s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.02s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.089s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.044s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.033s === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.028s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.004s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.028s === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0927 06:01:21.968832 35465 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0927 06:01:21.968903 35465 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0927 06:01:21.968914 35465 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0927 06:01:21.968929 35465 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0927 06:01:21.968939 35465 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0927 06:01:21.968949 35465 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0927 06:01:21.968959 35465 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0927 06:01:21.969420 35465 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.063s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.004s === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.005s === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.004s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.005s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.005s === RUN TestGetProxyEnvVars W0927 06:01:21.932955 35471 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.023s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.026s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.004s === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.004s === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.023s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0927 06:01:25.523284 35566 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.064s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... >>> kops*: Package size: 144.4 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.0-r0.apk >>> kops: Build complete at Wed, 27 Sep 2023 06:03:06 +0000 elapsed time 0h 5m 17s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/5) Purging .makedepends-kops (20230927.055751) (2/5) Purging kubernetes (1.28.2-r0) (3/5) Purging go (1.21.1-r0) (4/5) Purging bash (5.2.15-r5) Executing bash-5.2.15-r5.pre-deinstall (5/5) Purging readline (8.2.1-r2) Executing busybox-1.36.1-r8.trigger OK: 379 MiB in 110 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...