>>> kops: Building testing/kops 1.28.1-r0 (using abuild 3.12.0-r0) started Mon, 18 Dec 2023 12:12:04 +0000 >>> kops: Checking sanity of /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/5) Installing kubernetes (1.29.0-r0) (2/5) Installing go (1.21.5-r0) (3/5) Installing readline (8.2.7-r0) (4/5) Installing bash (5.2.21-r0) Executing bash-5.2.21-r0.post-install (5/5) Installing .makedepends-kops (20231218.121206) Executing busybox-1.36.1-r17.trigger OK: 555 MiB in 111 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.1.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 146 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (22) The requested URL returned error: 404 >>> kops: Fetching kops-1.28.1.tar.gz::https://github.com/kubernetes/kops/archive/v1.28.1.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 40348 0 40348 0 0 66890 0 --:--:-- --:--:-- --:--:-- 66890 100 11.1M 0 11.1M 0 0 7136k 0 --:--:-- 0:00:01 --:--:-- 11.1M 100 16.6M 0 16.6M 0 0 6533k 0 --:--:-- 0:00:02 --:--:-- 8484k 100 22.9M 0 22.9M 0 0 6512k 0 --:--:-- 0:00:03 --:--:-- 7808k 100 27.5M 0 27.5M 0 0 6124k 0 --:--:-- 0:00:04 --:--:-- 7037k 100 32.6M 0 32.6M 0 0 6010k 0 --:--:-- 0:00:05 --:--:-- 6733k >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.1.tar.gz >>> kops: Checking sha512sums... kops-1.28.1.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.1.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.1/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.1/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.1 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading k8s.io/apimachinery v0.28.1 go: downloading go.uber.org/multierr v1.11.0 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading github.com/aws/aws-sdk-go v1.45.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading github.com/spf13/pflag v1.0.5 go: downloading github.com/spf13/viper v1.16.0 go: downloading golang.org/x/crypto v0.14.0 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/api v0.28.1 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading k8s.io/client-go v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/net v0.17.0 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/imdario/mergo v0.3.15 go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading golang.org/x/sys v0.13.0 go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading golang.org/x/term v0.13.0 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/kr/fs v0.1.0 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading golang.org/x/text v0.13.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/moby/locker v1.0.1 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I1218 12:14:48.378082 27551 addon.go:250] addon test wants to update all nodes I1218 12:14:48.379460 27551 addon.go:250] addon test wants to update workers nodes I1218 12:14:48.379748 27551 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I1218 12:14:48.380142 27551 addon.go:283] installing PKI for "test" I1218 12:14:48.767132 27551 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.77s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.821s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.052s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] ? k8s.io/kops/pkg/apis/kops/registry [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] ? k8s.io/kops/pkg/commands/commandutils [no test files] ? k8s.io/kops/pkg/configserver [no test files] ? k8s.io/kops/pkg/dump [no test files] ? k8s.io/kops/pkg/kopscontrollerclient [no test files] ? k8s.io/kops/pkg/kubemanifest [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] ? k8s.io/kops/pkg/resources/digitalocean [no test files] ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] ? k8s.io/kops/pkg/try [no test files] ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] ? k8s.io/kops/tests/fuzz [no test files] ? k8s.io/kops/tests/integration/channel/simple [no test files] ? k8s.io/kops/upup/models [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] ? k8s.io/kops/upup/pkg/fi/secrets [no test files] ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] ? k8s.io/kops/util/pkg/env [no test files] ? k8s.io/kops/util/pkg/mirrors [no test files] ? k8s.io/kops/util/pkg/tables [no test files] ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestCreateClusterMinimal I1218 12:14:55.250785 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.250956 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.251003 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.251041 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.251080 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.251133 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.251170 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.251187 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.251224 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.251258 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.259074 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.259143 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.329837 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:55.330124 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:55.330734 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:55.344088 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.344167 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.344196 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.344225 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.344247 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.344282 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.344307 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.344323 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.344346 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.344362 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.352749 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.352824 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.400254 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:55.400442 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:55.400897 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:55.406393 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.406469 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.406494 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.406521 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.406544 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.406573 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.406597 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.406614 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.406639 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.406656 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.410268 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.410318 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.455632 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:55.455902 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:55.456323 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:55.465584 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.465676 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.465710 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.465755 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.465796 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.465840 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.465881 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.465913 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.465951 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.465980 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.492220 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.492276 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.537881 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:55.538051 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:55.538328 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:55.546478 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.546572 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.546609 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.546656 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.546702 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.546764 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.546806 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.546842 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.546885 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.546914 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.550986 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.551053 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.585736 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:55.585923 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:55.586254 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:55.592852 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.592943 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.592980 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.593011 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.593041 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.593075 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.593102 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.593120 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.593143 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.593160 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.597299 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.597386 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.663340 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:55.663455 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:55.663836 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:55.669424 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.669505 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.669531 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.669562 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.669588 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.669620 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.669648 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.669666 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.669691 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.669709 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.674054 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.674112 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.735744 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:55.735929 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:55.736226 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.49s) === RUN TestCreateClusterHetzner I1218 12:14:55.742107 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.742203 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.742228 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.742256 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.742279 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.742309 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.742336 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.742354 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.742376 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.742393 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.746001 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.746043 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1218 12:14:55.799114 29482 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1218 12:14:55.799157 29482 new_cluster.go:1373] Cloud Provider ID: "hetzner" I1218 12:14:55.808271 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.808369 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.808415 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.808465 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.808505 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.808550 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.808590 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.808620 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.808655 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.808681 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.880992 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.881077 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.979600 29482 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.25s) === RUN TestCreateClusterOpenStack I1218 12:14:55.988511 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:55.988605 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:55.988651 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:55.988687 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:55.988713 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:55.988747 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:55.988773 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:55.988790 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:55.988814 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:55.988832 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:55.992838 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:55.992890 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1218 12:14:56.087595 29482 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1218 12:14:56.087729 29482 new_cluster.go:1373] Cloud Provider ID: "openstack" I1218 12:14:56.090035 29482 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.11s) === RUN TestCreateClusterOpenStackOctavia I1218 12:14:56.102692 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.102846 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.102914 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.102996 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.103066 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.103146 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.103223 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.103288 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.103357 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.103415 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.108965 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.109034 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1218 12:14:56.165015 29482 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1218 12:14:56.165090 29482 new_cluster.go:1373] Cloud Provider ID: "openstack" I1218 12:14:56.167696 29482 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1218 12:14:56.167743 29482 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.08s) === RUN TestCreateClusterOpenStackNoDNS I1218 12:14:56.182792 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.182939 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.182986 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.183038 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.183077 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.183131 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.183183 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.183221 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.183269 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.183302 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.187191 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.187244 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1218 12:14:56.289156 29482 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1218 12:14:56.289211 29482 new_cluster.go:1373] Cloud Provider ID: "openstack" I1218 12:14:56.289273 29482 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1218 12:14:56.289300 29482 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.12s) === RUN TestCreateClusterCilium I1218 12:14:56.300430 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.300572 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.300613 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.300660 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.300703 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.300752 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.300801 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.300834 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.300879 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.300911 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.307590 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.307646 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.365877 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:56.366074 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:56.366431 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.07s) === RUN TestCreateClusterOverride I1218 12:14:56.372236 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.372332 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.372362 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.372402 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.372438 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.372483 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.372520 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.372549 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.372587 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.372612 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.376474 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.376530 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.428415 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:56.428943 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:56.429287 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.06s) === RUN TestCreateClusterKubernetesFeatureGates I1218 12:14:56.435484 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.435603 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.435640 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.435682 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.435719 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.435773 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.435804 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.435826 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.435872 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.435893 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.439808 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.439872 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.529197 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:56.529385 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:56.529853 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.10s) === RUN TestCreateClusterComplex I1218 12:14:56.538415 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.538528 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.538564 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.538613 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.538650 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.538700 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.538738 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.538765 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.538790 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.538808 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.542349 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.542397 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.598910 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:56.599251 29482 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I1218 12:14:56.599270 29482 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I1218 12:14:56.599284 29482 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I1218 12:14:56.599706 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.07s) === RUN TestCreateClusterComplexPrivate I1218 12:14:56.609779 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.609874 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.609901 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.609932 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.609956 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.609987 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.610014 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.610032 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.610055 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.610072 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.614100 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.614159 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.671048 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:56.671763 29482 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I1218 12:14:56.671783 29482 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I1218 12:14:56.671795 29482 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I1218 12:14:56.671807 29482 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I1218 12:14:56.671818 29482 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I1218 12:14:56.671830 29482 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I1218 12:14:56.671843 29482 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I1218 12:14:56.671858 29482 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I1218 12:14:56.671870 29482 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I1218 12:14:56.671884 29482 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I1218 12:14:56.672389 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.07s) === RUN TestCreateClusterHA I1218 12:14:56.684317 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.684409 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.684438 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.684469 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.684494 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.684526 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.684553 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.684570 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.684592 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.684611 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.720465 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.720527 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.757024 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:56.757385 29482 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1218 12:14:56.757406 29482 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1218 12:14:56.757419 29482 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1218 12:14:56.757812 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:56.767089 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.767179 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.767207 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.767242 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.767267 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.767301 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.767328 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.767346 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.767370 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.767387 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.771645 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.771706 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.804121 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:56.804494 29482 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1218 12:14:56.804515 29482 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1218 12:14:56.804528 29482 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1218 12:14:56.804840 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.13s) === RUN TestCreateClusterMinimalGCE I1218 12:14:56.814009 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.814090 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.814114 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.814142 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.814164 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.814193 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.814227 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.814245 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.814268 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.814286 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.819380 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.819425 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.865956 29482 new_cluster.go:1373] Cloud Provider ID: "gce" I1218 12:14:56.866094 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I1218 12:14:56.871694 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.871762 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.871785 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.871814 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.871839 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.871870 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.871898 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.871917 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.871940 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.871958 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.876991 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.877096 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.931685 29482 new_cluster.go:1373] Cloud Provider ID: "gce" I1218 12:14:56.931892 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.13s) === RUN TestCreateClusterHAGCE I1218 12:14:56.941565 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:56.941673 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:56.941704 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:56.941764 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:56.941802 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:56.941841 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:56.941876 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:56.941900 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:56.941943 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:56.941962 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:56.946658 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:56.946728 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.000970 29482 new_cluster.go:1373] Cloud Provider ID: "gce" I1218 12:14:57.001141 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.07s) === RUN TestCreateClusterGCE I1218 12:14:57.010817 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.010926 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.010954 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.010996 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.011025 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.011059 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.011089 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.011107 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.011134 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.011154 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.015669 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.015765 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.128063 29482 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1218 12:14:57.128172 29482 new_cluster.go:1373] Cloud Provider ID: "gce" I1218 12:14:57.128286 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.12s) === RUN TestCreateClusterHASharedZone I1218 12:14:57.134457 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.134549 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.134576 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.134607 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.134633 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.134664 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.134691 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.134709 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.134733 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.134751 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.139414 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.139488 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1218 12:14:57.197958 29482 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1218 12:14:57.197998 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.198257 29482 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1218 12:14:57.198615 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.08s) === RUN TestCreateClusterHASharedZones I1218 12:14:57.214104 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.214237 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.214280 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.214327 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.214367 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.214423 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.214474 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.214511 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.214556 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.214588 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.219515 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.219568 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1218 12:14:57.260951 29482 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1218 12:14:57.261001 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.261349 29482 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I1218 12:14:57.261367 29482 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I1218 12:14:57.261741 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.06s) === RUN TestCreateClusterPrivate I1218 12:14:57.273869 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.274011 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.274054 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.274107 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.274152 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.274229 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.274275 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.274313 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.274358 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.274393 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.281397 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.281476 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.370636 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.370867 29482 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1218 12:14:57.370887 29482 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1218 12:14:57.371265 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:57.371298 29482 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.12s) === RUN TestCreateClusterPrivateGCE I1218 12:14:57.395035 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.395125 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.395151 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.395179 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.395202 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.395233 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.395262 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.395279 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.395302 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.395320 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.399041 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.399104 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.452610 29482 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1218 12:14:57.452696 29482 new_cluster.go:1373] Cloud Provider ID: "gce" I1218 12:14:57.452794 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.06s) === RUN TestCreateClusterWithNGWSpecified I1218 12:14:57.459671 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.459763 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.459789 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.459822 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.459847 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.459879 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.459922 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.459940 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.459963 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.459980 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.464062 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.464120 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.517482 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.517698 29482 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1218 12:14:57.517718 29482 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1218 12:14:57.518083 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:57.518115 29482 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.07s) === RUN TestCreateClusterWithINGWSpecified I1218 12:14:57.524744 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.524825 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.524850 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.524878 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.524900 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.524932 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.524959 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.524977 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.525001 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.525019 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.528722 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.528775 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.564821 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.565039 29482 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1218 12:14:57.565058 29482 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1218 12:14:57.565373 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:57.565403 29482 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.05s) === RUN TestCreateClusterSharedVPC I1218 12:14:57.571985 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.572068 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.572091 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.572118 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.572141 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.572171 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.572197 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.572214 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.572236 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.572254 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.575677 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.575714 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.657692 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.657946 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.658016 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.658071 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.658099 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.658161 29482 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I1218 12:14:57.658621 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.10s) === RUN TestCreateClusterSharedSubnets I1218 12:14:57.670988 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.671481 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.671538 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.671591 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.671633 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.671687 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.671731 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.671760 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.671797 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.671827 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.677939 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.677989 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.736825 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.736859 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.736935 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.737085 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.737107 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.737129 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.737145 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.737478 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.07s) === RUN TestCreateClusterSharedSubnetsVpcLookup I1218 12:14:57.742855 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.742920 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.742940 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.742962 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.742984 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.743011 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.743034 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.743051 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.743072 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.743087 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.747521 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.747579 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.796510 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:14:57.796564 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.796586 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.796669 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.796810 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.796833 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.796857 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.796875 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.797251 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.06s) === RUN TestCreateClusterPrivateSharedSubnets I1218 12:14:57.802934 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.803018 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.803043 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.803068 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.803090 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.803121 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.803148 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.803167 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.803190 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.803206 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.806900 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.806945 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.837386 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.837439 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.837509 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.837548 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.837634 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.837870 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.837901 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.837931 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:14:57.837951 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:14:57.838445 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.04s) === RUN TestCreateClusterIPv6 I1218 12:14:57.845921 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.846027 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.846057 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.846086 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.846115 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.846152 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.846183 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.846205 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.846233 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.846254 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.850938 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.850994 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.876400 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.876594 29482 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I1218 12:14:57.876614 29482 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I1218 12:14:57.877140 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.04s) === RUN TestCreateClusterDifferentAMIs I1218 12:14:57.884119 29482 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1218 12:14:57.884142 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.884225 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.884249 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.884285 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.884311 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.884347 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.884373 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.884398 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.884421 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.884445 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.890345 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.890488 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.915729 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.915838 29482 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1218 12:14:57.915856 29482 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1218 12:14:57.916228 29482 zones.go:93] ListHostedZonesPages { } I1218 12:14:57.923831 29482 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.04s) === RUN TestCreateClusterKarpenter I1218 12:14:57.923919 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.924002 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.924026 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.924054 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.924079 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.924110 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.924138 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.924154 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.924177 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.924196 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.929319 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.929363 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1218 12:14:57.975578 29482 new_cluster.go:1373] Cloud Provider ID: "aws" I1218 12:14:57.975762 29482 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1218 12:14:57.975782 29482 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1218 12:14:57.975795 29482 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1218 12:14:57.976157 29482 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.06s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I1218 12:14:57.982339 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.982403 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.982426 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.982488 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.982513 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.982544 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.982570 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.982592 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.982617 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.982634 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:57.988088 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I1218 12:14:57.989251 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:14:57.989319 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:14:57.989338 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:14:57.989359 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:14:57.989380 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:14:57.989405 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:14:57.989463 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:14:57.989480 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:14:57.989500 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:14:57.989517 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:14:58.003401 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1218 12:14:58.005141 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:14:58.005192 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1218 12:15:03.149305 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:06.465967 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:15:06.468227 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:06.468310 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:06.468417 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:06.468687 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:15:06.474707 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:15:06.475895 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:06.476215 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:06.476392 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:06.476677 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:06.476899 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:15:06.477417 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:15:06.477865 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:15:06.481110 29482 target.go:111] Terraform output is in /tmp/test330541319/out --- PASS: TestMinimal (8.49s) === RUN TestMinimal_v1_23 I1218 12:15:06.483910 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:06.484021 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:06.484056 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:06.484092 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:06.484124 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:06.484162 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:06.484221 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:06.484240 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:06.484268 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:06.484286 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:06.504223 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1218 12:15:06.506338 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:06.506408 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:08.981225 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:09.108006 29482 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1218 12:15:09.111524 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:09.111573 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:09.111665 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:09.116924 29482 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1218 12:15:09.128073 29482 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1218 12:15:09.128514 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:09.129042 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:09.129286 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:09.129401 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:09.129479 29482 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1218 12:15:09.129763 29482 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1218 12:15:09.129970 29482 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1218 12:15:09.133439 29482 target.go:111] Terraform output is in /tmp/test3601871524/out --- PASS: TestMinimal_v1_23 (2.65s) === RUN TestMinimal_v1_24 I1218 12:15:09.136076 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:09.136163 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:09.136193 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:09.136226 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:09.136251 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:09.136285 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:09.136341 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:09.136360 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:09.136383 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:09.136400 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:09.152075 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:15:09.154100 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:09.154161 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:11.380350 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:11.501508 29482 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1218 12:15:11.506856 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:11.506891 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:11.506953 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:11.509036 29482 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1218 12:15:11.512430 29482 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1218 12:15:11.512635 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:11.512819 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:11.513055 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:11.513180 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:11.513260 29482 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1218 12:15:11.513430 29482 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1218 12:15:11.513610 29482 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1218 12:15:11.516856 29482 target.go:111] Terraform output is in /tmp/test2846958530/out --- PASS: TestMinimal_v1_24 (2.38s) === RUN TestMinimal_v1_25 I1218 12:15:11.519488 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:11.519567 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:11.519594 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:11.519622 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:11.519647 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:11.519680 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:11.519731 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:11.519750 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:11.519777 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:11.519794 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:11.535300 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1218 12:15:11.539737 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:11.539802 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:13.958212 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:14.095189 29482 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1218 12:15:14.096573 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:14.096593 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:14.096649 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:14.098264 29482 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1218 12:15:14.101582 29482 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1218 12:15:14.101922 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:14.102163 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:14.102581 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:14.102725 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:14.102829 29482 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1218 12:15:14.103073 29482 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1218 12:15:14.103306 29482 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1218 12:15:14.106511 29482 target.go:111] Terraform output is in /tmp/test3212758766/out --- PASS: TestMinimal_v1_25 (2.59s) === RUN TestMinimal_v1_26 I1218 12:15:14.109138 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:14.109221 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:14.109248 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:14.109277 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:14.109305 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:14.109336 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:14.109389 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:14.109407 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:14.109430 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:14.109447 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:14.127671 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1218 12:15:14.129987 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:14.130048 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:16.255820 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:16.354347 29482 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1218 12:15:16.355499 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:16.355516 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:16.355578 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:16.356347 29482 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1218 12:15:16.362163 29482 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1218 12:15:16.362508 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:16.362699 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:16.363076 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:16.363364 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:16.364394 29482 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1218 12:15:16.364769 29482 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1218 12:15:16.365203 29482 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1218 12:15:16.381044 29482 target.go:111] Terraform output is in /tmp/test3746600840/out --- PASS: TestMinimal_v1_26 (2.28s) === RUN TestMinimal_v1_27 I1218 12:15:16.385393 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:16.385540 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:16.385586 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:16.385638 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:16.385683 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:16.385737 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:16.385825 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:16.385859 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:16.385898 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:16.385928 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:16.405721 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1218 12:15:16.408833 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:16.408906 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:19.336017 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:19.468093 29482 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1218 12:15:19.468351 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:19.468367 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:19.468433 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:19.472101 29482 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1218 12:15:19.479432 29482 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1218 12:15:19.479742 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:19.479918 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:19.480487 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:19.480622 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:19.480731 29482 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1218 12:15:19.481027 29482 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1218 12:15:19.481433 29482 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1218 12:15:19.486707 29482 target.go:111] Terraform output is in /tmp/test1975650330/out --- PASS: TestMinimal_v1_27 (3.11s) === RUN TestMinimal_NoneDNS I1218 12:15:19.491127 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:19.491248 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:19.491287 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:19.491329 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:19.491375 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:19.491427 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:19.491506 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:19.491536 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:19.491571 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:19.491597 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1218 12:15:19.519832 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:19.519904 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:20.933618 29482 executor.go:111] Tasks: 0 done / 110 total; 43 can run I1218 12:15:20.938310 29482 executor.go:111] Tasks: 43 done / 110 total; 24 can run I1218 12:15:20.943836 29482 executor.go:111] Tasks: 67 done / 110 total; 29 can run I1218 12:15:20.944486 29482 executor.go:111] Tasks: 96 done / 110 total; 2 can run I1218 12:15:20.944562 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:20.944647 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:20.944763 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:20.944854 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:20.950429 29482 executor.go:111] Tasks: 98 done / 110 total; 4 can run I1218 12:15:20.950622 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:20.950759 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:20.951301 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:20.951365 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:20.951477 29482 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1218 12:15:20.951789 29482 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1218 12:15:20.952043 29482 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1218 12:15:20.957842 29482 target.go:111] Terraform output is in /tmp/test915987493/out --- PASS: TestMinimal_NoneDNS (1.47s) === RUN TestHetzner I1218 12:15:20.962193 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:15:22.994435 29482 executor.go:111] Tasks: 0 done / 46 total; 37 can run I1218 12:15:22.996878 29482 executor.go:111] Tasks: 37 done / 46 total; 3 can run I1218 12:15:22.997293 29482 executor.go:111] Tasks: 40 done / 46 total; 2 can run I1218 12:15:23.003030 29482 executor.go:111] Tasks: 42 done / 46 total; 4 can run I1218 12:15:23.004027 29482 executor.go:111] Tasks: 46 done / 46 total; 0 can run I1218 12:15:23.006357 29482 target.go:111] Terraform output is in /tmp/test2429053406/out --- PASS: TestHetzner (2.05s) === RUN TestNvidia I1218 12:15:23.009382 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:23.009502 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:23.009544 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:23.009598 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:23.009646 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:23.009703 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:23.009788 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:23.009826 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:23.009873 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:23.009905 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:23.032267 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:15:23.034186 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:23.034251 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:24.912205 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:25.060008 29482 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1218 12:15:25.060662 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:25.060700 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:25.060775 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:25.066594 29482 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1218 12:15:25.072982 29482 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1218 12:15:25.073477 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:25.073692 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:25.074014 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:25.074391 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:25.074508 29482 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1218 12:15:25.074743 29482 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1218 12:15:25.075074 29482 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1218 12:15:25.083187 29482 target.go:111] Terraform output is in /tmp/test4230881018/out --- PASS: TestNvidia (2.08s) === RUN TestMinimalGossip I1218 12:15:25.088762 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:25.088929 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:25.088984 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:25.089043 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:25.089092 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:25.089151 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:25.089276 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:25.089320 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:25.089374 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:25.089412 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:15:25.125460 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:25.125558 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:26.486294 29482 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1218 12:15:26.488538 29482 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1218 12:15:26.492123 29482 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1218 12:15:26.492291 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:26.493153 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:26.493753 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:26.493962 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:26.494100 29482 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1218 12:15:26.494610 29482 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1218 12:15:26.495651 29482 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1218 12:15:26.499455 29482 target.go:111] Terraform output is in /tmp/test3752991505/out --- PASS: TestMinimalGossip (1.41s) === RUN TestMinimalGossipIRSA I1218 12:15:26.502153 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:26.502239 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:26.502267 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:26.502297 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:26.502322 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:26.502354 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:26.502405 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:26.502423 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:26.502446 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:26.502463 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:15:26.518930 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:26.518988 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:28.102490 29482 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1218 12:15:28.105327 29482 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1218 12:15:28.110345 29482 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1218 12:15:28.111294 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:28.111725 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:28.112529 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:28.112867 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:28.113623 29482 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1218 12:15:28.114111 29482 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1218 12:15:28.114608 29482 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1218 12:15:28.120035 29482 target.go:111] Terraform output is in /tmp/test2515646380/out --- PASS: TestMinimalGossipIRSA (1.62s) === RUN TestMinimalGCE I1218 12:15:28.124874 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:28.134985 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:15:30.180828 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:15:30.180932 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:15:30.181081 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1218 12:15:30.181122 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1218 12:15:30.181149 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1218 12:15:30.181220 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1218 12:15:30.182841 29482 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1218 12:15:30.186076 29482 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1218 12:15:30.189551 29482 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1218 12:15:30.191744 29482 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1218 12:15:30.192278 29482 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1218 12:15:30.197352 29482 target.go:111] Terraform output is in /tmp/test1024945693/out --- PASS: TestMinimalGCE (2.08s) === RUN TestMinimalGCEPrivate I1218 12:15:30.200640 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:30.202626 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:15:31.814733 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:15:31.814810 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:15:31.814908 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W1218 12:15:31.814931 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W1218 12:15:31.814946 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W1218 12:15:31.814986 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1218 12:15:31.815915 29482 executor.go:111] Tasks: 0 done / 65 total; 41 can run I1218 12:15:31.818392 29482 executor.go:111] Tasks: 41 done / 65 total; 17 can run I1218 12:15:31.823581 29482 executor.go:111] Tasks: 58 done / 65 total; 5 can run I1218 12:15:31.824196 29482 executor.go:111] Tasks: 63 done / 65 total; 2 can run I1218 12:15:31.824323 29482 executor.go:111] Tasks: 65 done / 65 total; 0 can run I1218 12:15:31.826374 29482 target.go:111] Terraform output is in /tmp/test3704549680/out --- PASS: TestMinimalGCEPrivate (1.63s) === RUN TestMinimalGCEInternalLoadBalancer I1218 12:15:31.830022 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.832364 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:15:33.223603 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:15:33.223661 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:15:33.223757 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W1218 12:15:33.223780 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W1218 12:15:33.223795 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W1218 12:15:33.223835 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1218 12:15:33.223866 29482 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1218 12:15:33.224820 29482 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1218 12:15:33.226929 29482 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1218 12:15:33.227272 29482 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1218 12:15:33.227491 29482 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1218 12:15:33.230659 29482 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1218 12:15:33.231228 29482 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1218 12:15:33.231350 29482 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1218 12:15:33.231521 29482 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1218 12:15:33.231685 29482 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1218 12:15:33.233745 29482 target.go:111] Terraform output is in /tmp/test825337016/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.41s) === RUN TestMinimalGCEPublicLoadBalancer I1218 12:15:33.238555 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:33.239696 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:15:35.063523 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:15:35.063581 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:15:35.063663 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W1218 12:15:35.063684 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W1218 12:15:35.063699 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W1218 12:15:35.063748 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1218 12:15:35.064768 29482 executor.go:111] Tasks: 0 done / 71 total; 43 can run I1218 12:15:35.066514 29482 executor.go:111] Tasks: 43 done / 71 total; 19 can run I1218 12:15:35.069939 29482 executor.go:111] Tasks: 62 done / 71 total; 7 can run I1218 12:15:35.070596 29482 executor.go:111] Tasks: 69 done / 71 total; 2 can run I1218 12:15:35.070740 29482 executor.go:111] Tasks: 71 done / 71 total; 0 can run I1218 12:15:35.072833 29482 target.go:111] Terraform output is in /tmp/test3305700799/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.84s) === RUN TestMinimalGCELongClusterName I1218 12:15:35.077189 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:35.078634 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:15:36.726921 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:15:36.727045 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:15:36.727190 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1218 12:15:36.727221 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1218 12:15:36.727249 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1218 12:15:36.727313 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1218 12:15:36.728210 29482 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1218 12:15:36.730054 29482 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1218 12:15:36.733524 29482 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1218 12:15:36.734076 29482 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1218 12:15:36.734194 29482 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1218 12:15:36.736150 29482 target.go:111] Terraform output is in /tmp/test1121766268/out --- PASS: TestMinimalGCELongClusterName (1.66s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I1218 12:15:36.740263 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:36.741956 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:15:38.382149 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:15:38.382204 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:15:38.382290 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1218 12:15:38.382308 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1218 12:15:38.382320 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1218 12:15:38.382356 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1218 12:15:38.382381 29482 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1218 12:15:38.383179 29482 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1218 12:15:38.385019 29482 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1218 12:15:38.385388 29482 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1218 12:15:38.385529 29482 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1218 12:15:38.388893 29482 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1218 12:15:38.390603 29482 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1218 12:15:38.390925 29482 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1218 12:15:38.391120 29482 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1218 12:15:38.391321 29482 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1218 12:15:38.394555 29482 target.go:111] Terraform output is in /tmp/test4239531694/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.66s) === RUN TestMinimalGCEDNSNone I1218 12:15:38.396429 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:38.397511 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:15:40.463290 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:15:40.463412 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:15:40.463555 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1218 12:15:40.463594 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1218 12:15:40.463624 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1218 12:15:40.463699 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1218 12:15:40.463763 29482 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1218 12:15:40.465595 29482 executor.go:111] Tasks: 0 done / 72 total; 41 can run I1218 12:15:40.470049 29482 executor.go:111] Tasks: 41 done / 72 total; 18 can run I1218 12:15:40.470585 29482 executor.go:111] Tasks: 59 done / 72 total; 2 can run I1218 12:15:40.470739 29482 executor.go:111] Tasks: 61 done / 72 total; 2 can run I1218 12:15:40.475700 29482 executor.go:111] Tasks: 63 done / 72 total; 4 can run I1218 12:15:40.476669 29482 executor.go:111] Tasks: 67 done / 72 total; 2 can run I1218 12:15:40.476821 29482 executor.go:111] Tasks: 69 done / 72 total; 1 can run I1218 12:15:40.477035 29482 executor.go:111] Tasks: 70 done / 72 total; 2 can run I1218 12:15:40.477255 29482 executor.go:111] Tasks: 72 done / 72 total; 0 can run I1218 12:15:40.480844 29482 target.go:111] Terraform output is in /tmp/test248300852/out --- PASS: TestMinimalGCEDNSNone (2.09s) === RUN TestMinimalScaleway I1218 12:15:40.483748 29482 featureflag.go:164] FeatureFlag "Scaleway"=true I1218 12:15:40.483771 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:15:42.664749 29482 executor.go:111] Tasks: 0 done / 49 total; 37 can run I1218 12:15:42.667113 29482 executor.go:111] Tasks: 37 done / 49 total; 6 can run I1218 12:15:42.670489 29482 executor.go:111] Tasks: 43 done / 49 total; 6 can run I1218 12:15:42.671264 29482 executor.go:111] Tasks: 49 done / 49 total; 0 can run I1218 12:15:42.673094 29482 target.go:111] Terraform output is in /tmp/test3357233908/out I1218 12:15:42.675189 29482 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (2.19s) === RUN TestHA I1218 12:15:42.675318 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:42.675435 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:42.675475 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:42.675526 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:42.675564 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:42.675612 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:42.675692 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:42.675726 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:42.675764 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:42.675790 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:42.697364 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:15:42.699669 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:42.699738 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:42.699772 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:42.699805 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:43.964893 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:44.103203 29482 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1218 12:15:44.104045 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:44.104068 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:44.104129 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:44.105835 29482 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1218 12:15:44.111736 29482 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1218 12:15:44.112023 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:44.112178 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:44.112341 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:44.112477 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:44.112537 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:44.112597 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:44.112738 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:44.112968 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:44.113032 29482 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1218 12:15:44.113281 29482 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1218 12:15:44.113484 29482 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1218 12:15:44.121606 29482 target.go:111] Terraform output is in /tmp/test2665806648/out --- PASS: TestHA (1.45s) === RUN TestHighAvailabilityGCE I1218 12:15:44.126465 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:44.128431 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:15:45.823471 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:15:45.823577 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:15:45.823700 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W1218 12:15:45.823744 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W1218 12:15:45.823774 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W1218 12:15:45.823840 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1218 12:15:45.823925 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1218 12:15:45.823997 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1218 12:15:45.826169 29482 executor.go:111] Tasks: 0 done / 82 total; 49 can run I1218 12:15:45.829900 29482 executor.go:111] Tasks: 49 done / 82 total; 19 can run I1218 12:15:45.836321 29482 executor.go:111] Tasks: 68 done / 82 total; 8 can run I1218 12:15:45.836907 29482 executor.go:111] Tasks: 76 done / 82 total; 6 can run I1218 12:15:45.837053 29482 executor.go:111] Tasks: 82 done / 82 total; 0 can run I1218 12:15:45.840666 29482 target.go:111] Terraform output is in /tmp/test88372514/out --- PASS: TestHighAvailabilityGCE (1.72s) === RUN TestComplex I1218 12:15:45.843454 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:45.843568 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:45.843603 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:45.843681 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:45.843716 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:45.843774 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:45.843811 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:45.843843 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:45.843876 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:45.843899 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:45.876125 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:15:45.880072 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:45.880165 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:47.752314 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:47.885613 29482 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1218 12:15:47.886521 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:47.886550 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:47.886630 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:47.889218 29482 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1218 12:15:47.892400 29482 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1218 12:15:47.893177 29482 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1218 12:15:47.893459 29482 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1218 12:15:47.893666 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:47.893777 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:47.893879 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:47.893947 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:47.899499 29482 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1218 12:15:47.899694 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:47.899819 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:47.900222 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:47.900589 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:47.900692 29482 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1218 12:15:47.901002 29482 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1218 12:15:47.901327 29482 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1218 12:15:47.909970 29482 target.go:111] Terraform output is in /tmp/test3980962698/out I1218 12:15:47.912667 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:47.912742 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:47.912773 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:47.912809 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:47.912836 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:47.912872 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:47.912900 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:47.912918 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:47.912940 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:47.912962 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:47.943286 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:15:47.946507 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:47.946578 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:49.226547 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:49.369081 29482 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1218 12:15:49.370104 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:49.370139 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:49.370240 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:49.371980 29482 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1218 12:15:49.374678 29482 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1218 12:15:49.375381 29482 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1218 12:15:49.375706 29482 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1218 12:15:49.375814 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:49.375925 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:49.376040 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:49.376130 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:49.382977 29482 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1218 12:15:49.383203 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:49.383438 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:49.383956 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:49.384046 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:49.384128 29482 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1218 12:15:49.384429 29482 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1218 12:15:49.384727 29482 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1218 12:15:49.391364 29482 target.go:111] Terraform output is in /tmp/test457463367/out --- PASS: TestComplex (3.55s) === RUN TestCompress I1218 12:15:49.395673 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:49.395790 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:49.395830 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:49.395874 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:49.395913 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:49.395959 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:49.396039 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:49.396068 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:49.396107 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:49.396135 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:49.416298 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:15:49.418670 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:49.418739 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:50.682056 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:50.860198 29482 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1218 12:15:50.861114 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:50.861172 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:50.861263 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:50.864056 29482 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1218 12:15:50.870162 29482 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1218 12:15:50.870809 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:50.871123 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:50.874547 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:50.874688 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:50.874891 29482 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1218 12:15:50.875733 29482 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1218 12:15:50.877237 29482 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1218 12:15:50.883268 29482 target.go:111] Terraform output is in /tmp/test2839034462/out --- PASS: TestCompress (1.49s) === RUN TestExternalPolicies I1218 12:15:50.887668 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:50.887798 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:50.887843 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:50.887893 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:50.887936 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:50.887994 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:50.888080 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:50.888112 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:50.888151 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:50.888181 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:50.916385 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:15:50.920009 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:50.920105 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:52.377826 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:52.556579 29482 executor.go:111] Tasks: 0 done / 115 total; 47 can run I1218 12:15:52.557330 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:52.557389 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:52.557495 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:52.561247 29482 executor.go:111] Tasks: 47 done / 115 total; 22 can run I1218 12:15:52.566843 29482 executor.go:111] Tasks: 69 done / 115 total; 30 can run I1218 12:15:52.567967 29482 executor.go:111] Tasks: 99 done / 115 total; 4 can run W1218 12:15:52.568054 29482 api.go:53] PageSize not implemented W1218 12:15:52.568229 29482 api.go:53] PageSize not implemented I1218 12:15:52.573809 29482 executor.go:111] Tasks: 103 done / 115 total; 4 can run I1218 12:15:52.574003 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:52.574132 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:52.574643 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:52.574709 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:52.574811 29482 executor.go:111] Tasks: 107 done / 115 total; 2 can run I1218 12:15:52.575111 29482 executor.go:111] Tasks: 109 done / 115 total; 6 can run I1218 12:15:52.575401 29482 executor.go:111] Tasks: 115 done / 115 total; 0 can run I1218 12:15:52.581457 29482 target.go:111] Terraform output is in /tmp/test3754104740/out --- PASS: TestExternalPolicies (1.70s) === RUN TestMinimalIPv6 I1218 12:15:52.586042 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:52.586170 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:52.586211 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:52.586257 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:52.586297 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:52.586350 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:52.586430 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:52.586460 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:52.586498 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:52.586529 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:52.616284 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:15:52.619618 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:52.619698 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:53.880608 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:54.071286 29482 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1218 12:15:54.072305 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:54.072341 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:54.072505 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:54.074582 29482 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1218 12:15:54.077854 29482 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1218 12:15:54.081050 29482 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1218 12:15:54.081946 29482 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1218 12:15:54.082226 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:54.082409 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:54.082578 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:54.082808 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:54.090329 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:15:54.090566 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:54.090849 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:54.091095 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:54.091658 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:54.091784 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:15:54.092118 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:15:54.092507 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:15:54.099706 29482 target.go:111] Terraform output is in /tmp/test2239073509/out --- PASS: TestMinimalIPv6 (1.52s) === RUN TestMinimalIPv6Calico I1218 12:15:54.105538 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:54.105664 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:54.105707 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:54.105756 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:54.105798 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:54.105850 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:54.105931 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:54.105961 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:54.106000 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:54.106029 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:54.134032 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:15:54.136867 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:54.136934 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:55.442014 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:55.888896 29482 executor.go:111] Tasks: 0 done / 138 total; 47 can run I1218 12:15:55.890277 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:55.890304 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:55.890383 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:55.892395 29482 executor.go:111] Tasks: 47 done / 138 total; 25 can run I1218 12:15:55.896008 29482 executor.go:111] Tasks: 72 done / 138 total; 37 can run I1218 12:15:55.896884 29482 executor.go:111] Tasks: 109 done / 138 total; 9 can run I1218 12:15:55.897452 29482 executor.go:111] Tasks: 118 done / 138 total; 8 can run I1218 12:15:55.897597 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:55.897680 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:55.897869 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:55.897950 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:55.908105 29482 executor.go:111] Tasks: 126 done / 138 total; 4 can run I1218 12:15:55.908442 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:55.908755 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:55.909261 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:55.909354 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:55.909449 29482 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1218 12:15:55.909764 29482 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1218 12:15:55.910178 29482 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1218 12:15:55.917403 29482 target.go:111] Terraform output is in /tmp/test60538625/out --- PASS: TestMinimalIPv6Calico (1.82s) === RUN TestMinimalIPv6Cilium I1218 12:15:55.923382 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:55.923537 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:55.923590 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:55.923715 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:55.923815 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:55.923908 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:55.923971 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:55.924024 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:55.924091 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:55.924139 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:55.954289 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:15:55.958018 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:55.958113 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:57.272041 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:57.491575 29482 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1218 12:15:57.492425 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:57.492469 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:57.492625 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:57.496006 29482 executor.go:111] Tasks: 47 done / 137 total; 25 can run I1218 12:15:57.499114 29482 executor.go:111] Tasks: 72 done / 137 total; 36 can run I1218 12:15:57.499968 29482 executor.go:111] Tasks: 108 done / 137 total; 9 can run I1218 12:15:57.500428 29482 executor.go:111] Tasks: 117 done / 137 total; 8 can run I1218 12:15:57.500585 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:57.500671 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:57.500773 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:57.500855 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:57.506571 29482 executor.go:111] Tasks: 125 done / 137 total; 4 can run I1218 12:15:57.506727 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:57.506932 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:57.507192 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:57.507692 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:57.507799 29482 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1218 12:15:57.509106 29482 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1218 12:15:57.509714 29482 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1218 12:15:57.519588 29482 target.go:111] Terraform output is in /tmp/test2098185364/out --- PASS: TestMinimalIPv6Cilium (1.60s) === RUN TestMinimalIPv6NoSubnetPrefix I1218 12:15:57.524050 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:57.524175 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:57.524214 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:57.524298 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:57.524338 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:57.524388 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:57.524429 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:57.524456 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:57.524492 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:57.524521 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:57.552833 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:15:57.556185 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:57.556260 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:58.856758 29482 zones.go:93] ListHostedZonesPages { } I1218 12:15:59.034382 29482 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1218 12:15:59.038398 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:15:59.038552 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:15:59.038800 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:15:59.043709 29482 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1218 12:15:59.046834 29482 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1218 12:15:59.048218 29482 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1218 12:15:59.048664 29482 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1218 12:15:59.048764 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:59.048885 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:59.049004 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:15:59.049099 29482 loadbalancers.go:35] PageSize not implemented I1218 12:15:59.055691 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:15:59.055915 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:59.056193 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:59.056653 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:59.056749 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:59.056831 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:15:59.057244 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:15:59.057657 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:15:59.064376 29482 target.go:111] Terraform output is in /tmp/test3663404964/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.54s) === RUN TestMinimalWarmPool I1218 12:15:59.069129 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:59.069260 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:59.069301 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:59.069346 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:59.069392 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:59.069449 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:59.069533 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:59.069565 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:59.069604 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:59.069634 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:59.094967 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:15:59.098125 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:15:59.098200 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:00.354380 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:00.584941 29482 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1218 12:16:00.585421 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:00.585468 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:00.585624 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:00.588848 29482 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1218 12:16:00.599690 29482 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1218 12:16:00.600220 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:00.600523 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:00.601251 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:00.601331 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:00.601446 29482 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1218 12:16:00.601802 29482 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1218 12:16:00.602338 29482 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1218 12:16:00.608200 29482 target.go:111] Terraform output is in /tmp/test382681733/out --- PASS: TestMinimalWarmPool (1.54s) === RUN TestMinimalEtcd I1218 12:16:00.612854 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:00.612984 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:00.613027 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:00.613076 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:00.613128 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:00.613183 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:00.613271 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:00.613305 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:00.613344 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:00.613374 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:00.639263 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:00.642227 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:00.642304 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:01.930252 29482 zones.go:93] ListHostedZonesPages { } W1218 12:16:02.094823 29482 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W1218 12:16:02.094873 29482 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W1218 12:16:02.096815 29482 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I1218 12:16:02.107147 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:16:02.107922 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:02.107968 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:02.108088 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:02.114126 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:16:02.122763 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:16:02.123049 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:02.123254 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:02.123663 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:02.123986 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:02.124114 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:16:02.124463 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:16:02.124834 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:16:02.130300 29482 target.go:111] Terraform output is in /tmp/test1379331726/out --- PASS: TestMinimalEtcd (1.52s) === RUN TestMinimalGp3 I1218 12:16:02.134954 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:02.135080 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:02.135120 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:02.135167 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:02.135217 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:02.135283 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:02.135370 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:02.135399 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:02.135440 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:02.135468 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:02.201466 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:02.204882 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:02.204975 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:03.674206 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:03.861949 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:16:03.862493 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:03.862532 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:03.862644 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:03.869913 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:16:03.876644 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:16:03.876868 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:03.877409 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:03.877516 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:03.878152 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:03.878275 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:16:03.878655 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:16:03.878995 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:16:03.884558 29482 target.go:111] Terraform output is in /tmp/test387731526/out --- PASS: TestMinimalGp3 (1.75s) === RUN TestMinimalLongClusterName I1218 12:16:03.888965 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:03.889094 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:03.889137 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:03.889187 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:03.889231 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:03.889284 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:03.889370 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:03.889400 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:03.889439 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:03.889469 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:03.914082 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:03.917348 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:03.917436 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1218 12:16:05.201389 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:05.385578 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:16:05.388453 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:05.388506 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:05.388614 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:05.392931 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:16:05.399119 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:16:05.399435 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:05.399743 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:05.400278 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:05.400377 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:05.400498 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:16:05.400803 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:16:05.401212 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:16:05.407358 29482 target.go:111] Terraform output is in /tmp/test3566929712/out --- PASS: TestMinimalLongClusterName (1.52s) === RUN TestExistingSG I1218 12:16:05.412099 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:05.412259 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:05.412308 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:05.412356 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:05.412415 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:05.412481 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:05.412590 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:05.412626 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:05.412677 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:05.412712 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:05.446466 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:05.449936 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:05.450031 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:05.450092 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:05.450170 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.698421 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:06.900032 29482 executor.go:111] Tasks: 0 done / 163 total; 53 can run I1218 12:16:06.900332 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:06.900369 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:06.900506 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:06.902936 29482 executor.go:111] Tasks: 53 done / 163 total; 26 can run I1218 12:16:06.905843 29482 executor.go:111] Tasks: 79 done / 163 total; 54 can run I1218 12:16:06.906798 29482 executor.go:111] Tasks: 133 done / 163 total; 6 can run W1218 12:16:06.906862 29482 api.go:53] PageSize not implemented W1218 12:16:06.906934 29482 api.go:53] PageSize not implemented W1218 12:16:06.907106 29482 api.go:53] PageSize not implemented W1218 12:16:06.907244 29482 api.go:53] PageSize not implemented I1218 12:16:06.912819 29482 executor.go:111] Tasks: 139 done / 163 total; 8 can run I1218 12:16:06.912988 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.913257 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.913390 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.913625 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.913858 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.913947 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.914009 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.914131 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.914246 29482 executor.go:111] Tasks: 147 done / 163 total; 4 can run I1218 12:16:06.914659 29482 executor.go:111] Tasks: 151 done / 163 total; 12 can run I1218 12:16:06.915057 29482 executor.go:111] Tasks: 163 done / 163 total; 0 can run I1218 12:16:06.929354 29482 target.go:111] Terraform output is in /tmp/test1590005808/out --- PASS: TestExistingSG (1.52s) === RUN TestBastionAdditionalUserData I1218 12:16:06.935562 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:06.935701 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:06.935742 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:06.935793 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:06.935836 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:06.935890 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:06.935975 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:06.936006 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:06.936048 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:06.936079 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:06.965335 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:06.968546 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.968626 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:06.968683 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:08.203397 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:08.384966 29482 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1218 12:16:08.385989 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:08.386033 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:08.387373 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:08.393811 29482 executor.go:111] Tasks: 47 done / 137 total; 30 can run I1218 12:16:08.397024 29482 executor.go:111] Tasks: 77 done / 137 total; 35 can run I1218 12:16:08.397886 29482 executor.go:111] Tasks: 112 done / 137 total; 6 can run W1218 12:16:08.397955 29482 api.go:53] PageSize not implemented W1218 12:16:08.398122 29482 api.go:53] PageSize not implemented W1218 12:16:08.398260 29482 api.go:53] PageSize not implemented I1218 12:16:08.403898 29482 executor.go:111] Tasks: 118 done / 137 total; 7 can run I1218 12:16:08.404095 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:08.404242 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:08.404534 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:08.404807 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:08.405107 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:08.405200 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:08.405282 29482 executor.go:111] Tasks: 125 done / 137 total; 3 can run I1218 12:16:08.405720 29482 executor.go:111] Tasks: 128 done / 137 total; 9 can run I1218 12:16:08.406135 29482 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1218 12:16:08.413069 29482 target.go:111] Terraform output is in /tmp/test1392119062/out --- PASS: TestBastionAdditionalUserData (1.48s) === RUN TestPrivateFlannel I1218 12:16:08.418145 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:08.418267 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:08.418307 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:08.418351 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:08.418395 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:08.418455 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:08.418537 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:08.418567 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:08.418605 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:08.418636 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:08.447047 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:16:08.450189 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:08.450266 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:08.450334 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:09.677418 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:09.891643 29482 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1218 12:16:09.892290 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:09.892337 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:09.892473 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:09.895405 29482 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1218 12:16:09.898691 29482 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1218 12:16:09.898975 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:09.899150 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:09.899552 29482 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1218 12:16:09.899612 29482 api.go:53] PageSize not implemented W1218 12:16:09.899822 29482 api.go:53] PageSize not implemented I1218 12:16:09.905249 29482 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1218 12:16:09.905404 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:09.905622 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:09.906894 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:09.908046 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:09.908282 29482 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1218 12:16:09.909019 29482 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1218 12:16:09.911081 29482 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1218 12:16:09.919104 29482 target.go:111] Terraform output is in /tmp/test514173384/out --- PASS: TestPrivateFlannel (1.51s) === RUN TestPrivateCalico I1218 12:16:09.924777 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:09.924926 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:09.924984 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:09.925098 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:09.925158 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:09.925221 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:09.925274 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:09.925316 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:09.925368 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:09.925408 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:09.954817 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:16:09.958167 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:09.958246 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:09.958301 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:11.216753 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:11.653843 29482 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1218 12:16:11.656640 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:11.656685 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:11.656841 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:11.662056 29482 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1218 12:16:11.665559 29482 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1218 12:16:11.666158 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:11.666330 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:11.667041 29482 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1218 12:16:11.667136 29482 api.go:53] PageSize not implemented W1218 12:16:11.667191 29482 api.go:53] PageSize not implemented I1218 12:16:11.673359 29482 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1218 12:16:11.673740 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:11.674040 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:11.674541 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:11.674631 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:11.674715 29482 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1218 12:16:11.675063 29482 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1218 12:16:11.675379 29482 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1218 12:16:11.682766 29482 target.go:111] Terraform output is in /tmp/test1174310547/out --- PASS: TestPrivateCalico (1.76s) === RUN TestPrivateCilium I1218 12:16:11.688521 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:11.688651 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:11.688693 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:11.688750 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:11.688793 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:11.688848 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:11.688931 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:11.688968 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:11.689008 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:11.689037 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:11.718613 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:11.722301 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:11.722386 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:11.722445 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:12.998669 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:13.232859 29482 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1218 12:16:13.233609 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:13.233648 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:13.233779 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:13.238415 29482 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1218 12:16:13.244268 29482 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1218 12:16:13.244990 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:13.245183 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:13.245298 29482 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1218 12:16:13.245372 29482 api.go:53] PageSize not implemented W1218 12:16:13.245420 29482 api.go:53] PageSize not implemented I1218 12:16:13.251123 29482 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1218 12:16:13.251480 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:13.251783 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:13.252164 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:13.252670 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:13.252789 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:16:13.253152 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:16:13.253470 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:16:13.260505 29482 target.go:111] Terraform output is in /tmp/test440872587/out --- PASS: TestPrivateCilium (1.58s) === RUN TestPrivateCilium2 I1218 12:16:13.265387 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:13.265517 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:13.265561 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:13.265609 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:13.265652 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:13.265704 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:13.265791 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:13.265822 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:13.265862 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:13.265891 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:13.295133 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:16:13.299298 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:13.299384 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:13.299444 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:14.570972 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:15.257172 29482 executor.go:111] Tasks: 0 done / 138 total; 50 can run I1218 12:16:15.258037 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:15.258080 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:15.258233 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:15.261732 29482 executor.go:111] Tasks: 50 done / 138 total; 30 can run I1218 12:16:15.264801 29482 executor.go:111] Tasks: 80 done / 138 total; 36 can run I1218 12:16:15.265411 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:15.265554 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:15.265710 29482 executor.go:111] Tasks: 116 done / 138 total; 6 can run W1218 12:16:15.265788 29482 api.go:53] PageSize not implemented W1218 12:16:15.266049 29482 api.go:53] PageSize not implemented I1218 12:16:15.271440 29482 executor.go:111] Tasks: 122 done / 138 total; 8 can run I1218 12:16:15.271766 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:15.271990 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:15.272277 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:15.272799 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:15.272923 29482 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1218 12:16:15.273249 29482 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1218 12:16:15.273599 29482 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1218 12:16:15.285420 29482 target.go:111] Terraform output is in /tmp/test1041783551/out --- PASS: TestPrivateCilium2 (2.03s) === RUN TestPrivateCiliumAdvanced I1218 12:16:15.292764 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:15.292907 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:15.292954 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:15.293048 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:15.293093 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:15.293143 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:15.293188 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:15.293217 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:15.293256 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:15.293285 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:15.327696 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:15.331008 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:15.331081 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:15.331130 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:16.587049 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:16.811545 29482 executor.go:111] Tasks: 0 done / 142 total; 54 can run I1218 12:16:16.812067 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:16.812108 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:16.812205 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:16.815305 29482 executor.go:111] Tasks: 54 done / 142 total; 30 can run I1218 12:16:16.818656 29482 executor.go:111] Tasks: 84 done / 142 total; 36 can run I1218 12:16:16.818884 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:16.819078 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:16.819540 29482 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1218 12:16:16.819617 29482 api.go:53] PageSize not implemented W1218 12:16:16.819712 29482 api.go:53] PageSize not implemented I1218 12:16:16.826280 29482 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1218 12:16:16.826485 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:16.826702 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:16.827189 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:16.827297 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:16.827440 29482 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1218 12:16:16.828704 29482 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1218 12:16:16.829232 29482 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1218 12:16:16.849262 29482 target.go:111] Terraform output is in /tmp/test3730760172/out --- PASS: TestPrivateCiliumAdvanced (1.56s) === RUN TestPrivateCiliumENI I1218 12:16:16.856593 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:16.856729 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:16.856773 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:16.856823 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:16.856866 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:16.856922 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:16.857008 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:16.857039 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:16.857102 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:16.857133 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:16.885138 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:16.888722 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:16.888809 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:16.888867 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:18.183120 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:18.399226 29482 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1218 12:16:18.399571 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:18.399609 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:18.399712 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:18.402744 29482 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1218 12:16:18.405956 29482 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1218 12:16:18.406661 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:18.406837 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:18.406950 29482 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1218 12:16:18.406998 29482 api.go:53] PageSize not implemented W1218 12:16:18.407229 29482 api.go:53] PageSize not implemented I1218 12:16:18.412486 29482 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1218 12:16:18.412646 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:18.412751 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:18.413065 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:18.413472 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:18.413575 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:16:18.413875 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:16:18.414209 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:16:18.421111 29482 target.go:111] Terraform output is in /tmp/test2352867375/out --- PASS: TestPrivateCiliumENI (1.57s) === RUN TestPrivateCanal I1218 12:16:18.431457 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:18.431594 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:18.431637 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:18.431687 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:18.431731 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:18.431784 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:18.431868 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:18.431898 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:18.431937 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:18.431966 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:18.460025 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:16:18.463413 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:18.463498 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:18.463561 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:19.721469 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:20.154993 29482 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1218 12:16:20.155921 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:20.155956 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:20.156019 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:20.158097 29482 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1218 12:16:20.160974 29482 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1218 12:16:20.161528 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:20.161675 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:20.161798 29482 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1218 12:16:20.161858 29482 api.go:53] PageSize not implemented W1218 12:16:20.161973 29482 api.go:53] PageSize not implemented I1218 12:16:20.167834 29482 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1218 12:16:20.168073 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:20.168285 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:20.170045 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:20.170387 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:20.170625 29482 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1218 12:16:20.171330 29482 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1218 12:16:20.171930 29482 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1218 12:16:20.181483 29482 target.go:111] Terraform output is in /tmp/test3901771909/out --- PASS: TestPrivateCanal (1.76s) === RUN TestPrivateKopeio I1218 12:16:20.187542 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:20.187724 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:20.187770 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:20.187819 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:20.187861 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:20.187914 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:20.187997 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:20.188027 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:20.188066 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:20.188095 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:20.217356 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:20.220925 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:20.221016 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:20.221077 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:21.258115 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:21.435486 29482 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1218 12:16:21.436202 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:21.436258 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:21.436387 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:21.438342 29482 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1218 12:16:21.441340 29482 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1218 12:16:21.441981 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:21.442197 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:21.442322 29482 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1218 12:16:21.442371 29482 api.go:53] PageSize not implemented W1218 12:16:21.442431 29482 api.go:53] PageSize not implemented I1218 12:16:21.448206 29482 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1218 12:16:21.448481 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:21.448604 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:21.448995 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:21.449336 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:21.449452 29482 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1218 12:16:21.449758 29482 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1218 12:16:21.450094 29482 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1218 12:16:21.457264 29482 target.go:111] Terraform output is in /tmp/test663961824/out --- PASS: TestPrivateKopeio (1.27s) === RUN TestUnmanaged I1218 12:16:21.462095 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:21.462219 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:21.462259 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:21.462303 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:21.462342 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:21.462396 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:21.462478 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:21.462508 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:21.462545 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:21.462577 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:21.492218 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:21.495589 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:21.495664 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:21.495718 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:22.802982 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:22.983167 29482 executor.go:111] Tasks: 0 done / 126 total; 46 can run I1218 12:16:22.984093 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:22.984147 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:22.984251 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:22.987075 29482 executor.go:111] Tasks: 46 done / 126 total; 27 can run I1218 12:16:22.990137 29482 executor.go:111] Tasks: 73 done / 126 total; 33 can run I1218 12:16:22.990489 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:22.990670 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:22.990859 29482 executor.go:111] Tasks: 106 done / 126 total; 5 can run W1218 12:16:22.990994 29482 api.go:53] PageSize not implemented W1218 12:16:22.991132 29482 api.go:53] PageSize not implemented I1218 12:16:22.996687 29482 executor.go:111] Tasks: 111 done / 126 total; 7 can run I1218 12:16:22.996872 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:22.997107 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:22.997599 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:22.997693 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:22.997778 29482 executor.go:111] Tasks: 118 done / 126 total; 2 can run I1218 12:16:22.998157 29482 executor.go:111] Tasks: 120 done / 126 total; 6 can run I1218 12:16:22.998545 29482 executor.go:111] Tasks: 126 done / 126 total; 0 can run I1218 12:16:23.005170 29482 target.go:111] Terraform output is in /tmp/test2261599338/out --- PASS: TestUnmanaged (1.55s) === RUN TestPrivateSharedSubnet I1218 12:16:23.013949 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:23.014093 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:23.014138 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:23.014189 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:23.014234 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:23.014284 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:23.014369 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:23.014400 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:23.014439 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:23.014469 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:23.043912 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:23.047818 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:23.047909 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:23.047967 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:24.279198 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:24.455868 29482 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1218 12:16:24.456447 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:24.456475 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:24.456564 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:24.460522 29482 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1218 12:16:24.461384 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:16:24.466429 29482 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1218 12:16:24.467039 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:24.467297 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:24.467595 29482 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1218 12:16:24.467670 29482 api.go:53] PageSize not implemented W1218 12:16:24.467765 29482 api.go:53] PageSize not implemented I1218 12:16:24.473455 29482 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1218 12:16:24.473632 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:24.473862 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:24.474094 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:24.474599 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:24.474714 29482 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1218 12:16:24.475002 29482 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1218 12:16:24.475341 29482 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1218 12:16:24.481716 29482 target.go:111] Terraform output is in /tmp/test2026692833/out --- PASS: TestPrivateSharedSubnet (1.47s) === RUN TestPrivateSharedIP I1218 12:16:24.486442 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:24.486565 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:24.486607 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:24.486657 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:24.486700 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:24.486750 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:24.486830 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:24.486859 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:24.486902 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:24.486930 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:24.515158 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:24.518328 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:24.518411 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:24.518469 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:25.766272 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:25.957526 29482 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1218 12:16:25.958847 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:25.958896 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:25.959033 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:25.960554 29482 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1218 12:16:25.960935 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:16:25.963777 29482 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1218 12:16:25.964661 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:25.964815 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:25.964920 29482 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1218 12:16:25.964998 29482 api.go:53] PageSize not implemented W1218 12:16:25.965061 29482 api.go:53] PageSize not implemented I1218 12:16:25.970667 29482 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1218 12:16:25.970922 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:25.971120 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:25.972760 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:25.972961 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:25.973215 29482 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1218 12:16:25.974100 29482 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1218 12:16:25.975300 29482 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1218 12:16:25.983849 29482 target.go:111] Terraform output is in /tmp/test1888229465/out --- PASS: TestPrivateSharedIP (1.50s) === RUN TestPrivateDns1 I1218 12:16:25.988790 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:25.989017 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:25.989092 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:25.989173 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:25.989260 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:25.989350 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:25.989471 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:25.989503 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:25.989542 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:25.989572 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1218 12:16:26.021329 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:26.021412 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:26.021471 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:27.518369 29482 executor.go:111] Tasks: 0 done / 135 total; 46 can run I1218 12:16:27.522007 29482 executor.go:111] Tasks: 46 done / 135 total; 28 can run I1218 12:16:27.522308 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I1218 12:16:27.522370 29482 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I1218 12:16:27.522495 29482 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I1218 12:16:27.522526 29482 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I1218 12:16:27.522779 29482 executor.go:111] Tasks: 74 done / 135 total; 39 can run I1218 12:16:27.523362 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:27.523528 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:27.526113 29482 executor.go:111] Tasks: 113 done / 135 total; 6 can run W1218 12:16:27.526357 29482 api.go:53] PageSize not implemented W1218 12:16:27.526480 29482 api.go:53] PageSize not implemented I1218 12:16:27.531997 29482 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1218 12:16:27.532187 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:27.532357 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:27.532769 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:27.532899 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:27.533000 29482 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1218 12:16:27.533312 29482 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1218 12:16:27.534506 29482 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1218 12:16:27.544693 29482 target.go:111] Terraform output is in /tmp/test1880638510/out --- PASS: TestPrivateDns1 (1.56s) === RUN TestPrivateDns2 I1218 12:16:27.550060 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:27.550189 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:27.550234 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:27.550281 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:27.550325 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:27.550376 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:27.550495 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:27.550529 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:27.550566 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:27.550593 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:27.581798 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:27.581881 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:27.581937 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:29.029997 29482 executor.go:111] Tasks: 0 done / 132 total; 45 can run I1218 12:16:29.033892 29482 executor.go:111] Tasks: 45 done / 132 total; 26 can run I1218 12:16:29.034209 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:16:29.034404 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I1218 12:16:29.034451 29482 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I1218 12:16:29.034551 29482 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I1218 12:16:29.034572 29482 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I1218 12:16:29.034655 29482 executor.go:111] Tasks: 71 done / 132 total; 39 can run I1218 12:16:29.035338 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:29.035483 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:29.037808 29482 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1218 12:16:29.037889 29482 api.go:53] PageSize not implemented W1218 12:16:29.038106 29482 api.go:53] PageSize not implemented I1218 12:16:29.043355 29482 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1218 12:16:29.043534 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:29.043756 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:29.044082 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:29.044556 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:29.044659 29482 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1218 12:16:29.044947 29482 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1218 12:16:29.045304 29482 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1218 12:16:29.057122 29482 target.go:111] Terraform output is in /tmp/test1317987205/out --- PASS: TestPrivateDns2 (1.51s) === RUN TestDiscoveryFeatureGate I1218 12:16:29.061996 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:29.062205 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:29.062278 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:29.062428 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:29.062516 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:29.062615 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:29.062687 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:29.062745 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:29.062825 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:29.062883 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:29.088739 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:16:29.092288 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:29.092385 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:30.382894 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:30.590062 29482 executor.go:111] Tasks: 0 done / 113 total; 52 can run I1218 12:16:30.595307 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:30.595354 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:30.595527 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:30.599195 29482 executor.go:111] Tasks: 52 done / 113 total; 28 can run I1218 12:16:30.605923 29482 executor.go:111] Tasks: 80 done / 113 total; 25 can run I1218 12:16:30.606259 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:30.606595 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:30.607126 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:30.607229 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:30.607355 29482 executor.go:111] Tasks: 105 done / 113 total; 2 can run I1218 12:16:30.607740 29482 executor.go:111] Tasks: 107 done / 113 total; 6 can run I1218 12:16:30.608139 29482 executor.go:111] Tasks: 113 done / 113 total; 0 can run I1218 12:16:30.614437 29482 target.go:111] Terraform output is in /tmp/test2362619621/out --- PASS: TestDiscoveryFeatureGate (1.56s) === RUN TestVFSServiceAccountIssuerDiscovery I1218 12:16:30.620158 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:30.620270 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:30.620317 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:30.620367 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:30.620417 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:30.620473 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:30.620543 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:30.620561 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:30.620585 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:30.620603 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:30.634699 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:30.638078 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:30.638168 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:31.904657 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:32.099369 29482 executor.go:111] Tasks: 0 done / 104 total; 47 can run I1218 12:16:32.099899 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:32.099944 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:32.100119 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:32.103830 29482 executor.go:111] Tasks: 47 done / 104 total; 24 can run I1218 12:16:32.109720 29482 executor.go:111] Tasks: 71 done / 104 total; 25 can run I1218 12:16:32.109973 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:32.111447 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:32.112525 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:32.112683 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:32.112916 29482 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1218 12:16:32.114163 29482 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1218 12:16:32.115228 29482 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1218 12:16:32.122130 29482 target.go:111] Terraform output is in /tmp/test223441895/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.51s) === RUN TestAWSLBController I1218 12:16:32.126788 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:32.126916 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:32.126959 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:32.127050 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:32.127116 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:32.127167 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:32.127213 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:32.127243 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:32.127282 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:32.127311 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:32.153066 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:32.156340 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:32.156431 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:33.432767 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:34.181552 29482 executor.go:111] Tasks: 0 done / 116 total; 54 can run I1218 12:16:34.182832 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:34.182860 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:34.182989 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:34.191268 29482 executor.go:111] Tasks: 54 done / 116 total; 29 can run I1218 12:16:34.198674 29482 executor.go:111] Tasks: 83 done / 116 total; 25 can run I1218 12:16:34.198895 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:34.199171 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:34.199583 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:34.199651 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:34.199759 29482 executor.go:111] Tasks: 108 done / 116 total; 2 can run I1218 12:16:34.200033 29482 executor.go:111] Tasks: 110 done / 116 total; 6 can run I1218 12:16:34.200352 29482 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1218 12:16:34.207523 29482 target.go:111] Terraform output is in /tmp/test1073878782/out --- PASS: TestAWSLBController (2.21s) === RUN TestManyAddons I1218 12:16:34.332046 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:34.332179 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:34.332224 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:34.332277 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:34.332324 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:34.332376 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:34.332472 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:34.332504 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:34.332543 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:34.332572 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:34.365844 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:34.370053 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:34.370150 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:35.800286 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:36.652814 29482 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1218 12:16:36.653118 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:36.653140 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:36.653215 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:36.658532 29482 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1218 12:16:36.666174 29482 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1218 12:16:36.666637 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:36.667723 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:36.667842 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:36.668273 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:36.668390 29482 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1218 12:16:36.668769 29482 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1218 12:16:36.669055 29482 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1218 12:16:36.676778 29482 target.go:111] Terraform output is in /tmp/test1752676481/out --- PASS: TestManyAddons (2.35s) === RUN TestManyAddonsCCMIRSA I1218 12:16:36.686303 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:36.686434 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:36.686480 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:36.686531 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:36.686576 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:36.686627 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:36.686712 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:36.686743 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:36.686787 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:36.686817 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:36.718967 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:36.722668 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:36.722769 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:37.989827 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:38.892310 29482 executor.go:111] Tasks: 0 done / 123 total; 59 can run I1218 12:16:38.892725 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:38.892776 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:38.892899 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:38.901437 29482 executor.go:111] Tasks: 59 done / 123 total; 30 can run I1218 12:16:38.908431 29482 executor.go:111] Tasks: 89 done / 123 total; 26 can run I1218 12:16:38.908794 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:38.909064 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:38.909343 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:38.909612 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:38.909779 29482 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1218 12:16:38.910100 29482 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1218 12:16:38.910428 29482 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1218 12:16:38.918223 29482 target.go:111] Terraform output is in /tmp/test1772422983/out --- PASS: TestManyAddonsCCMIRSA (2.24s) === RUN TestManyAddonsCCMIRSA23 I1218 12:16:38.928521 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:38.928651 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:38.928696 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:38.928743 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:38.928787 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:38.928841 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:38.928922 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:38.928953 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:38.929005 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:38.929037 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:38.964378 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1218 12:16:38.968331 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:38.968434 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:40.227804 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:41.160241 29482 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1218 12:16:41.161827 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:41.161863 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:41.161957 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:41.165333 29482 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1218 12:16:41.171564 29482 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1218 12:16:41.172133 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:41.173630 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:41.174395 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:41.174797 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:41.175013 29482 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1218 12:16:41.175575 29482 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1218 12:16:41.177180 29482 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1218 12:16:41.186471 29482 target.go:111] Terraform output is in /tmp/test1040767461/out --- PASS: TestManyAddonsCCMIRSA23 (2.27s) === RUN TestManyAddonsCCMIRSA24 I1218 12:16:41.197561 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:41.197699 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:41.197745 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:41.197841 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:41.197887 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:41.197939 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:41.197982 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:41.198016 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:41.198056 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:41.198086 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:41.225114 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:16:41.228124 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:41.228207 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:42.485141 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:43.396061 29482 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1218 12:16:43.396882 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:43.396910 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:43.396980 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:43.401362 29482 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1218 12:16:43.410557 29482 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1218 12:16:43.410821 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:43.410992 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:43.411429 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:43.411667 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:43.411799 29482 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1218 12:16:43.412174 29482 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1218 12:16:43.412522 29482 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1218 12:16:43.420330 29482 target.go:111] Terraform output is in /tmp/test1112852727/out --- PASS: TestManyAddonsCCMIRSA24 (2.23s) === RUN TestManyAddonsCCMIRSA25 I1218 12:16:43.429857 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:43.429981 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:43.430026 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:43.430071 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:43.430115 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:43.430167 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:43.430246 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:43.430277 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:43.430316 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:43.430347 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:43.467699 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1218 12:16:43.471340 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:43.471442 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:44.763003 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:45.691949 29482 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1218 12:16:45.692713 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:45.692762 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:45.692907 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:45.697487 29482 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1218 12:16:45.703524 29482 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1218 12:16:45.704120 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:45.704359 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:45.704572 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:45.705119 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:45.705242 29482 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1218 12:16:45.705562 29482 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1218 12:16:45.705841 29482 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1218 12:16:45.717366 29482 target.go:111] Terraform output is in /tmp/test2729475660/out --- PASS: TestManyAddonsCCMIRSA25 (2.30s) === RUN TestManyAddonsCCMIRSA26 I1218 12:16:45.727683 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:45.727808 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:45.727854 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:45.727902 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:45.727948 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:45.728000 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:45.728084 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:45.728115 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:45.728154 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:45.728183 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:45.756372 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1218 12:16:45.759475 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:45.759549 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:47.001306 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:47.902997 29482 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1218 12:16:47.905667 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:47.905757 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:47.905904 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:47.912024 29482 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1218 12:16:47.918857 29482 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1218 12:16:47.919095 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:47.919572 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:47.919813 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:47.920441 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:47.920555 29482 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1218 12:16:47.920902 29482 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1218 12:16:47.921245 29482 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1218 12:16:47.929663 29482 target.go:111] Terraform output is in /tmp/test516315277/out --- PASS: TestManyAddonsCCMIRSA26 (2.22s) === RUN TestManyAddonsGCE I1218 12:16:47.943974 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:16:50.157970 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:16:50.158086 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:16:50.158210 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W1218 12:16:50.158244 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W1218 12:16:50.158271 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W1218 12:16:50.158339 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1218 12:16:50.159851 29482 executor.go:111] Tasks: 0 done / 67 total; 44 can run I1218 12:16:50.164978 29482 executor.go:111] Tasks: 44 done / 67 total; 17 can run I1218 12:16:50.170716 29482 executor.go:111] Tasks: 61 done / 67 total; 4 can run I1218 12:16:50.171709 29482 executor.go:111] Tasks: 65 done / 67 total; 2 can run I1218 12:16:50.171913 29482 executor.go:111] Tasks: 67 done / 67 total; 0 can run I1218 12:16:50.176440 29482 target.go:111] Terraform output is in /tmp/test4142994013/out --- PASS: TestManyAddonsGCE (2.24s) === RUN TestCCM I1218 12:16:50.186356 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:50.186495 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:50.186543 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:50.186638 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:50.186682 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:50.186732 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:50.186777 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:50.186807 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:50.186846 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:50.186876 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:50.214831 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:50.218454 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:50.218564 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:51.734769 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:52.582839 29482 executor.go:111] Tasks: 0 done / 110 total; 51 can run I1218 12:16:52.583861 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:52.583901 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:52.583967 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:52.586370 29482 executor.go:111] Tasks: 51 done / 110 total; 24 can run I1218 12:16:52.595263 29482 executor.go:111] Tasks: 75 done / 110 total; 27 can run I1218 12:16:52.595690 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:52.595886 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:52.596431 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:52.596542 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:52.597351 29482 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1218 12:16:52.597765 29482 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1218 12:16:52.598113 29482 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1218 12:16:52.604737 29482 target.go:111] Terraform output is in /tmp/test916224118/out --- PASS: TestCCM (2.43s) === RUN TestExternalDNS I1218 12:16:52.613638 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:52.613805 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:52.613853 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:52.613903 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:52.613950 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:52.614005 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:52.614092 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:52.614122 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:52.614163 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:52.614193 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:52.639090 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:52.642052 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:52.642137 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:53.880113 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:54.072840 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:16:54.074395 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:54.074434 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:54.074530 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:54.079902 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:16:54.089605 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:16:54.089965 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:54.090494 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:54.090707 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:54.091338 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:54.091547 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:16:54.091903 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:16:54.092329 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:16:54.097805 29482 target.go:111] Terraform output is in /tmp/test3051744093/out --- PASS: TestExternalDNS (1.49s) === RUN TestExternalDNSIRSA I1218 12:16:54.102293 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:54.102415 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:54.102457 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:54.102503 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:54.102543 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:54.102594 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:54.102677 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:54.102707 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:54.102747 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:54.102778 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:54.128184 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:54.131591 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:54.131675 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:55.393069 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:55.622090 29482 executor.go:111] Tasks: 0 done / 112 total; 51 can run I1218 12:16:55.622756 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:55.622816 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:55.622968 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:55.628658 29482 executor.go:111] Tasks: 51 done / 112 total; 28 can run I1218 12:16:55.636186 29482 executor.go:111] Tasks: 79 done / 112 total; 25 can run I1218 12:16:55.636624 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:55.636848 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:55.637380 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:55.637485 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:55.637596 29482 executor.go:111] Tasks: 104 done / 112 total; 2 can run I1218 12:16:55.637947 29482 executor.go:111] Tasks: 106 done / 112 total; 6 can run I1218 12:16:55.638251 29482 executor.go:111] Tasks: 112 done / 112 total; 0 can run I1218 12:16:55.644597 29482 target.go:111] Terraform output is in /tmp/test3000900129/out --- PASS: TestExternalDNSIRSA (1.55s) === RUN TestKarpenter I1218 12:16:55.650162 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:55.650292 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:55.650339 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:55.650408 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:55.650455 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:55.650508 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:55.650594 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:55.650625 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:55.650666 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:55.650696 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:55.686504 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:16:55.690357 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:55.690502 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:55.690568 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:56.964257 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:57.177633 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.177748 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.177842 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1218 12:16:57.317166 29482 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W1218 12:16:57.317254 29482 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1218 12:16:57.317275 29482 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W1218 12:16:57.317291 29482 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1218 12:16:57.317306 29482 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I1218 12:16:57.340637 29482 executor.go:111] Tasks: 0 done / 122 total; 54 can run I1218 12:16:57.341421 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:57.341452 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:57.341551 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:57.349131 29482 executor.go:111] Tasks: 54 done / 122 total; 31 can run I1218 12:16:57.355613 29482 executor.go:111] Tasks: 85 done / 122 total; 29 can run I1218 12:16:57.355889 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.356319 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.356633 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.356937 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.357185 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.357269 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.357445 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.357737 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.357858 29482 executor.go:111] Tasks: 114 done / 122 total; 2 can run I1218 12:16:57.358199 29482 executor.go:111] Tasks: 116 done / 122 total; 6 can run I1218 12:16:57.358577 29482 executor.go:111] Tasks: 122 done / 122 total; 0 can run I1218 12:16:57.366107 29482 target.go:111] Terraform output is in /tmp/test3857536755/out --- PASS: TestKarpenter (1.72s) === RUN TestSharedSubnet I1218 12:16:57.372832 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:57.372960 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:57.372999 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:57.373045 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:57.373085 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:57.373139 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:57.373219 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:57.373248 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:57.373289 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:57.373318 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:57.404398 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:57.407575 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:57.407663 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:58.647153 29482 zones.go:93] ListHostedZonesPages { } I1218 12:16:58.839478 29482 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1218 12:16:58.840924 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:16:58.840964 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:16:58.841065 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:16:58.844404 29482 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1218 12:16:58.844820 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:16:58.852446 29482 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1218 12:16:58.852965 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:58.853519 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:58.853599 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:58.854393 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:58.854502 29482 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1218 12:16:58.854744 29482 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1218 12:16:58.855075 29482 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1218 12:16:58.860086 29482 target.go:111] Terraform output is in /tmp/test2382467479/out --- PASS: TestSharedSubnet (1.49s) === RUN TestSharedVPC I1218 12:16:58.864627 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:16:58.864763 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:16:58.864806 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:16:58.864855 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:16:58.864896 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:16:58.864949 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:16:58.865033 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:16:58.865063 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:16:58.865106 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:16:58.865135 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:16:58.889783 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:16:58.893031 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:16:58.893121 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:00.129814 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:00.321853 29482 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1218 12:17:00.324092 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:00.324141 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:00.324240 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:00.327701 29482 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1218 12:17:00.330776 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:17:00.336432 29482 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1218 12:17:00.336795 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:00.337276 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:00.337605 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:00.338158 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:00.338287 29482 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1218 12:17:00.338624 29482 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1218 12:17:00.338988 29482 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1218 12:17:00.344410 29482 target.go:111] Terraform output is in /tmp/test1277901691/out --- PASS: TestSharedVPC (1.48s) === RUN TestSharedVPCIPv6 I1218 12:17:00.348835 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:00.348953 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:00.348994 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:00.349040 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:00.349083 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:00.349138 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:00.349218 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:00.349249 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:00.349288 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:00.349316 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:00.351369 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:17:00.351427 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:17:00.378913 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:17:00.378963 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1218 12:17:00.379061 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:17:00.382629 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:00.382706 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:01.883675 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:02.079689 29482 executor.go:111] Tasks: 0 done / 133 total; 45 can run I1218 12:17:02.080035 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:02.080080 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:02.080250 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:02.083681 29482 executor.go:111] Tasks: 45 done / 133 total; 29 can run I1218 12:17:02.083922 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:17:02.084314 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:17:02.086907 29482 executor.go:111] Tasks: 74 done / 133 total; 37 can run I1218 12:17:02.087699 29482 executor.go:111] Tasks: 111 done / 133 total; 6 can run I1218 12:17:02.087783 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:02.087866 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:02.088005 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:02.088092 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:02.093446 29482 executor.go:111] Tasks: 117 done / 133 total; 8 can run I1218 12:17:02.093636 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:02.093872 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:02.094367 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:02.094457 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:02.094547 29482 executor.go:111] Tasks: 125 done / 133 total; 2 can run I1218 12:17:02.094870 29482 executor.go:111] Tasks: 127 done / 133 total; 6 can run I1218 12:17:02.095285 29482 executor.go:111] Tasks: 133 done / 133 total; 0 can run I1218 12:17:02.107461 29482 target.go:111] Terraform output is in /tmp/test2798000305/out --- PASS: TestSharedVPCIPv6 (1.76s) === RUN TestExistingIAM I1218 12:17:02.112061 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:02.112188 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:02.112229 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:02.112276 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:02.112324 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:02.112376 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:02.112457 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:02.112486 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:02.112524 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:02.112553 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:02.145611 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:02.149102 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:02.149191 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:02.149245 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:02.149297 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.425479 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:03.620885 29482 executor.go:111] Tasks: 0 done / 117 total; 51 can run I1218 12:17:03.621665 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:03.621718 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:03.621819 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:03.624694 29482 executor.go:111] Tasks: 51 done / 117 total; 19 can run I1218 12:17:03.630690 29482 executor.go:111] Tasks: 70 done / 117 total; 31 can run I1218 12:17:03.630969 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.631154 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.631355 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.631595 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.631838 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.631963 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.632031 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.632440 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.632560 29482 executor.go:111] Tasks: 101 done / 117 total; 4 can run I1218 12:17:03.633011 29482 executor.go:111] Tasks: 105 done / 117 total; 12 can run I1218 12:17:03.633567 29482 executor.go:111] Tasks: 117 done / 117 total; 0 can run I1218 12:17:03.644515 29482 target.go:111] Terraform output is in /tmp/test3784065867/out --- PASS: TestExistingIAM (1.54s) === RUN TestPhaseNetwork I1218 12:17:03.649610 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:03.649741 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:03.649787 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:03.649841 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:03.649887 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:03.649941 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:03.649985 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:03.650013 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:03.650051 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:03.650081 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:03.679058 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:03.682467 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.682555 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:03.682617 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:04.968500 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:05.150451 29482 executor.go:111] Tasks: 0 done / 135 total; 47 can run I1218 12:17:05.151135 29482 executor.go:111] Tasks: 47 done / 135 total; 30 can run I1218 12:17:05.151875 29482 executor.go:111] Tasks: 77 done / 135 total; 36 can run I1218 12:17:05.152295 29482 executor.go:111] Tasks: 113 done / 135 total; 6 can run I1218 12:17:05.152519 29482 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1218 12:17:05.152697 29482 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1218 12:17:05.152751 29482 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1218 12:17:05.152811 29482 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1218 12:17:05.153901 29482 target.go:111] Terraform output is in /tmp/test2235552474/out --- PASS: TestPhaseNetwork (1.50s) === RUN TestExternalLoadBalancer I1218 12:17:05.154537 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:05.154671 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:05.154715 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:05.154764 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:05.154812 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:05.154866 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:05.154960 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:05.154991 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:05.155031 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:05.155061 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:05.181028 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:05.184329 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:05.184428 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.442026 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:06.622903 29482 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1218 12:17:06.624956 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:06.624997 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:06.625099 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:06.627764 29482 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1218 12:17:06.633833 29482 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1218 12:17:06.634386 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.634691 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.635162 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.635255 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.635336 29482 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1218 12:17:06.635638 29482 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1218 12:17:06.636035 29482 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1218 12:17:06.641281 29482 target.go:111] Terraform output is in /tmp/test2033697632/out --- PASS: TestExternalLoadBalancer (1.49s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I1218 12:17:06.645974 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:06.646097 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:06.646136 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:06.646181 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:06.646220 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:06.646273 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:06.646353 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:06.646383 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:06.646421 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:06.646451 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:06.679741 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:06.683022 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.683095 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.683151 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.683204 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.683251 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.683293 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:06.683339 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.032615 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:11.223172 29482 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1218 12:17:11.230009 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:11.230062 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:11.230181 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:11.233689 29482 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1218 12:17:11.239972 29482 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1218 12:17:11.240297 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.240597 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.240902 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.241175 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.241315 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.241457 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.241580 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.241686 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.241816 29482 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1218 12:17:11.242296 29482 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1218 12:17:11.242733 29482 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1218 12:17:11.253468 29482 target.go:111] Terraform output is in /tmp/test4065399807/out --- PASS: TestMixedInstancesASG (4.61s) === RUN TestMixedInstancesSpotASG I1218 12:17:11.259024 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:11.259155 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:11.259199 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:11.259246 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:11.259290 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:11.259342 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:11.259424 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:11.259453 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:11.259491 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:11.259520 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:11.293281 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:11.296760 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.296843 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.296966 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.297017 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.297105 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.297152 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:11.297190 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.558179 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:12.752709 29482 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1218 12:17:12.753360 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:12.753410 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:12.753513 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:12.756079 29482 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1218 12:17:12.764547 29482 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1218 12:17:12.765712 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.766320 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.767842 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.767931 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.768143 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.768389 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.768492 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.768589 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.768703 29482 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1218 12:17:12.769045 29482 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1218 12:17:12.769497 29482 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1218 12:17:12.777290 29482 target.go:111] Terraform output is in /tmp/test3152547155/out --- PASS: TestMixedInstancesSpotASG (1.52s) === RUN TestAdditionalObjects I1218 12:17:12.782920 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:12.783050 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:12.783092 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:12.783141 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:12.783182 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:12.783235 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:12.783322 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:12.783353 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:12.783391 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:12.783421 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:12.811290 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1218 12:17:12.814393 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:12.814483 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:14.115737 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:14.293611 29482 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1218 12:17:14.298739 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:14.298927 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:14.299183 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:14.303688 29482 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1218 12:17:14.310511 29482 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1218 12:17:14.310867 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:14.311246 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:14.311496 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:14.312000 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:14.312117 29482 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1218 12:17:14.312460 29482 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1218 12:17:14.312717 29482 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1218 12:17:14.318330 29482 target.go:111] Terraform output is in /tmp/test3183931581/out --- PASS: TestAdditionalObjects (1.54s) === RUN TestContainerd I1218 12:17:14.322749 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:14.322881 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:14.322924 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:14.322969 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:14.323008 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:14.323059 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:14.323139 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:14.323171 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:14.323208 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:14.323237 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:14.348220 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:14.351319 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:14.351399 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:15.626870 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:15.822519 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:17:15.823141 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:15.823182 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:15.823320 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:15.826318 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:17:15.832442 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:17:15.833120 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:15.834424 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:15.835384 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:15.836270 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:15.836611 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:17:15.839249 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:17:15.839891 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:17:15.845778 29482 target.go:111] Terraform output is in /tmp/test3259691265/out --- PASS: TestContainerd (1.53s) === RUN TestContainerdCustom I1218 12:17:15.850144 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:15.850271 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:15.850311 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:15.850359 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:15.850418 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:15.850471 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:15.850552 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:15.850582 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:15.850621 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:15.850650 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:15.876784 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:15.880105 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:15.880193 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:16.365236 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:16.544696 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:17:16.548873 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:16.548952 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:16.549132 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:16.553803 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:17:16.560057 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:17:16.560550 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:16.560771 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:16.561062 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:16.561562 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:16.561678 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:17:16.561969 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:17:16.562303 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:17:16.567581 29482 target.go:111] Terraform output is in /tmp/test3164928838/out --- PASS: TestContainerdCustom (0.72s) === RUN TestDockerCustom I1218 12:17:16.572100 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:16.572225 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:16.572276 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:16.572320 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:16.572362 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:16.572413 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:16.572495 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:16.572524 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:16.572568 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:16.572605 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:16.603589 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1218 12:17:16.607553 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:16.607649 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:17.085796 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:17.268360 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:17:17.269189 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:17.269231 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:17.269366 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:17.271980 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:17:17.278208 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:17:17.278669 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:17.278867 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:17.279161 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:17.279638 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:17.279768 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:17:17.280122 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:17:17.280465 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:17:17.285786 29482 target.go:111] Terraform output is in /tmp/test3721874437/out --- PASS: TestDockerCustom (0.72s) === RUN TestAPIServerNodes I1218 12:17:17.290330 29482 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1218 12:17:17.290362 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:17.290503 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:17.290546 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:17.290592 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:17.290645 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:17.290698 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:17.290780 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:17.290809 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:17.290848 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:17.290879 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:17.323134 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1218 12:17:17.326395 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:17.326491 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:17.326553 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:18.645231 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:18.828121 29482 executor.go:111] Tasks: 0 done / 114 total; 47 can run I1218 12:17:18.830824 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:18.830853 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:18.830956 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:18.836636 29482 executor.go:111] Tasks: 47 done / 114 total; 28 can run I1218 12:17:18.842950 29482 executor.go:111] Tasks: 75 done / 114 total; 27 can run I1218 12:17:18.843396 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:18.843627 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:18.843913 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:18.844227 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:18.844572 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:18.844786 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:18.844919 29482 executor.go:111] Tasks: 102 done / 114 total; 3 can run I1218 12:17:18.845326 29482 executor.go:111] Tasks: 105 done / 114 total; 9 can run I1218 12:17:18.845805 29482 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1218 12:17:18.851935 29482 target.go:111] Terraform output is in /tmp/test3531258844/out I1218 12:17:18.856703 29482 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.57s) === RUN TestNTHIMDSProcessor I1218 12:17:18.856826 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:18.856945 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:18.856984 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:18.857026 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:18.857090 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:18.857148 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:18.857232 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:18.857262 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:18.857299 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:18.857327 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:18.888077 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:18.891370 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:18.891464 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:20.385346 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:20.560956 29482 executor.go:111] Tasks: 0 done / 90 total; 44 can run I1218 12:17:20.561429 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:20.561472 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:20.561625 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:20.564750 29482 executor.go:111] Tasks: 44 done / 90 total; 19 can run I1218 12:17:20.575479 29482 executor.go:111] Tasks: 63 done / 90 total; 21 can run I1218 12:17:20.575872 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:20.576040 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:20.576571 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:20.576643 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:20.576752 29482 executor.go:111] Tasks: 84 done / 90 total; 2 can run I1218 12:17:20.577045 29482 executor.go:111] Tasks: 86 done / 90 total; 4 can run I1218 12:17:20.577379 29482 executor.go:111] Tasks: 90 done / 90 total; 0 can run I1218 12:17:20.582452 29482 target.go:111] Terraform output is in /tmp/test635906821/out --- PASS: TestNTHIMDSProcessor (1.73s) === RUN TestNTHIMDSProcessorIRSA I1218 12:17:20.586674 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:20.586803 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:20.586844 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:20.586893 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:20.586936 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:20.586990 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:20.587095 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:20.587128 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:20.587168 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:20.587199 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:20.613353 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:20.616663 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:20.616751 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:21.874041 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:22.094056 29482 executor.go:111] Tasks: 0 done / 101 total; 50 can run I1218 12:17:22.095352 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:22.095395 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:22.095526 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:22.103576 29482 executor.go:111] Tasks: 50 done / 101 total; 24 can run I1218 12:17:22.110440 29482 executor.go:111] Tasks: 74 done / 101 total; 21 can run I1218 12:17:22.110779 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:22.111033 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:22.111531 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:22.111637 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:22.111739 29482 executor.go:111] Tasks: 95 done / 101 total; 2 can run I1218 12:17:22.112093 29482 executor.go:111] Tasks: 97 done / 101 total; 4 can run I1218 12:17:22.112380 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:17:22.118332 29482 target.go:111] Terraform output is in /tmp/test466647413/out --- PASS: TestNTHIMDSProcessorIRSA (1.54s) === RUN TestCustomIRSA I1218 12:17:22.123484 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:22.123610 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:22.123649 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:22.123693 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:22.123748 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:22.123803 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:22.123888 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:22.123927 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:22.123969 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:22.123999 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:22.152935 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:22.156354 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:22.156432 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:23.439734 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:24.133614 29482 executor.go:111] Tasks: 0 done / 114 total; 52 can run I1218 12:17:24.134426 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:24.134475 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:24.134578 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:24.141802 29482 executor.go:111] Tasks: 52 done / 114 total; 29 can run I1218 12:17:24.148451 29482 executor.go:111] Tasks: 81 done / 114 total; 25 can run I1218 12:17:24.148897 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:24.149186 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:24.149649 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:24.149721 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:24.149835 29482 executor.go:111] Tasks: 106 done / 114 total; 2 can run I1218 12:17:24.150144 29482 executor.go:111] Tasks: 108 done / 114 total; 6 can run I1218 12:17:24.150469 29482 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1218 12:17:24.157802 29482 target.go:111] Terraform output is in /tmp/test2914956912/out --- PASS: TestCustomIRSA (2.04s) === RUN TestClusterNameDigit I1218 12:17:24.165971 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:24.166098 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:24.166139 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:24.166184 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:24.166222 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:24.166274 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:24.166358 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:24.166387 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:24.166426 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:24.166455 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:24.196251 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:24.201325 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:24.201431 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:25.453203 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:25.631200 29482 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1218 12:17:25.633890 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:25.633946 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:25.634083 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:25.639861 29482 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1218 12:17:25.646065 29482 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1218 12:17:25.646729 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:25.647007 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:25.647282 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:25.647865 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:25.647984 29482 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1218 12:17:25.648294 29482 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1218 12:17:25.648635 29482 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1218 12:17:25.654694 29482 target.go:111] Terraform output is in /tmp/test1115809601/out --- PASS: TestClusterNameDigit (1.49s) === RUN TestCASPriorityExpander I1218 12:17:25.659702 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:25.659835 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:25.659876 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:25.659920 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:25.659967 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:25.660026 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:25.660110 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:25.660140 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:25.660179 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:25.660208 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:25.697583 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1218 12:17:25.701579 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:25.701670 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:25.701732 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:25.701787 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1218 12:17:27.699566 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:27.917076 29482 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1218 12:17:27.921848 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:27.921887 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:27.922367 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:27.926260 29482 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1218 12:17:27.933086 29482 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1218 12:17:27.933549 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.933820 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.934060 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.934160 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.934358 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.934875 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.934986 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.935436 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.935539 29482 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1218 12:17:27.936024 29482 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1218 12:17:27.936543 29482 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1218 12:17:27.943339 29482 target.go:111] Terraform output is in /tmp/test1508549523/out --- PASS: TestCASPriorityExpander (2.29s) === RUN TestCASPriorityExpanderCustom I1218 12:17:27.948695 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:27.948829 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:27.948871 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:27.948917 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:27.948958 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:27.949012 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:27.949096 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:27.949126 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:27.949165 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:27.949194 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:17:27.986821 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1218 12:17:27.990548 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.990648 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.990707 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:27.990762 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1218 12:17:29.012316 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:29.226891 29482 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1218 12:17:29.229734 29482 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1218 12:17:29.229773 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:29.229866 29482 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1218 12:17:29.236021 29482 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1218 12:17:29.241941 29482 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1218 12:17:29.242453 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:29.242645 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:29.242948 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:29.243174 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:29.243447 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:29.243711 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:29.243879 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:29.243959 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:29.244067 29482 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1218 12:17:29.244540 29482 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1218 12:17:29.245028 29482 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1218 12:17:29.251456 29482 target.go:111] Terraform output is in /tmp/test2456976884/out --- PASS: TestCASPriorityExpanderCustom (1.31s) === RUN TestLifecycleMinimalAWS I1218 12:17:29.256630 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:29.256753 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:29.256798 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:29.256845 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:29.256886 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:29.256938 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:29.256978 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:29.257007 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:29.257047 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:29.257111 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1218 12:17:29.286831 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1218 12:17:29.289860 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:29.289955 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1218 12:17:30.661391 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:30.846040 29482 iamrole.go:89] ListRoles: { } I1218 12:17:30.847260 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:17:30.847499 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:30.847650 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:17:30.847805 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:30.847809 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:30.847990 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:30.848075 29482 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:17:30.848171 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:30.848280 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:30.848334 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1218 12:17:30.848371 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:30.848550 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:30.848540 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1218 12:17:30.848730 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:30.848782 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" }] } I1218 12:17:30.848799 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:30.848984 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1218 12:17:30.849011 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1218 12:17:30.849050 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1218 12:17:30.849086 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:17:30.849158 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:30.849220 29482 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I1218 12:17:30.849309 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:17:30.853149 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:17:30.853870 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1218 12:17:30.854936 29482 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1218 12:17:30.854841 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1218 12:17:30.855037 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1218 12:17:30.855196 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1218 12:17:30.855336 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1218 12:17:30.855327 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:30.855548 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1218 12:17:30.855543 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:30.855689 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1218 12:17:30.855798 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:30.855834 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1218 12:17:30.855936 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:30.855988 29482 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1218 12:17:30.856081 29482 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:17:30.856173 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:17:30.856224 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }], VpcId: "vpc-1" } I1218 12:17:30.856326 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:30.856383 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:30.856429 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:30.856526 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:17:30.856622 29482 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1218 12:17:30.856684 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:30.856774 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:30.856823 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:30.856759 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:30.856907 29482 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1218 12:17:30.856976 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:30.857034 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:30.857039 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1218 12:17:30.860739 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:17:30.860999 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I1218 12:17:30.861211 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:30.861311 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:30.861436 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:30.861585 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:30.861749 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:17:30.861915 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:17:30.862090 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:17:30.862312 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:17:30.862468 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:17:30.862611 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:30.862697 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:17:30.862745 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:17:30.862884 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:17:30.863059 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:17:30.863198 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:17:30.863328 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" }] }] } I1218 12:17:30.863459 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" }] }] } I1218 12:17:30.863587 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1218 12:17:30.863635 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1218 12:17:30.863676 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:17:30.863833 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:30.863935 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:30.864024 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:17:30.864239 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:17:30.864482 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:17:30.864800 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:17:30.865177 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:17:30.865241 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:30.865281 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:30.865363 29482 dns.go:235] Pre-creating DNS records I1218 12:17:30.865395 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:30.871174 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1218 12:17:30.874230 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:30.874325 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1218 12:17:32.163863 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:32.351322 29482 iamrole.go:89] ListRoles: { } I1218 12:17:32.352709 29482 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1218 12:17:32.352995 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.353231 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:17:32.353319 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:17:32.353424 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:32.353498 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.353918 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:32.354117 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] }] } I1218 12:17:32.354392 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:32.354643 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.356843 29482 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1218 12:17:32.356976 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:32.357097 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1218 12:17:32.357148 29482 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1218 12:17:32.357112 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.357239 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1218 12:17:32.357435 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:32.357497 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1218 12:17:32.357634 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.357775 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:32.357814 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1218 12:17:32.357952 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:32.358009 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:32.362305 29482 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1218 12:17:32.362484 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:32.362734 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:32.362942 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:32.363065 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:32.363249 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:32.363477 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:32.363786 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:32.364026 29482 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1218 12:17:32.364296 29482 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1218 12:17:32.364620 29482 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1218 12:17:32.367255 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:17:32.367321 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:17:32.367361 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:17:32.367395 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:17:32.367430 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:17:32.367464 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:17:32.367497 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:17:32.367533 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:17:32.367569 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:17:32.367607 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:17:32.367648 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:17:32.367682 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:17:32.367713 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:32.367746 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:17:32.367777 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:32.367813 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:32.367851 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:32.367888 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:17:32.367918 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:17:32.367951 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:17:32.367984 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:32.368021 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:32.368058 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:17:32.368093 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:17:32.369316 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:17:32.369411 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:17:32.369437 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:17:32.369478 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.369532 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1218 12:17:32.369592 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.369654 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.369704 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.369762 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.369809 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.369849 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1218 12:17:32.369900 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.369954 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:17:32.369994 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1218 12:17:32.370039 29482 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1218 12:17:32.370081 29482 api.go:53] PageSize not implemented I1218 12:17:32.370104 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:32.370132 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:32.370152 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:17:32.370184 29482 targetgroups.go:35] PageSize not implemented I1218 12:17:32.370203 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1218 12:17:32.370259 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:17:32.370302 29482 iamrole.go:89] ListRoles: { } I1218 12:17:32.370347 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:32.370378 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:32.370444 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:17:32.370492 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:17:32.370529 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:32.371096 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok autoscaling-group:nodes.minimal.example.com ok I1218 12:17:32.371259 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1218 12:17:32.371382 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I1218 12:17:32.371232 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok I1218 12:17:32.371204 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1218 12:17:32.371478 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:32.371452 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1218 12:17:32.371515 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I1218 12:17:32.371509 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1218 12:17:32.371576 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok I1218 12:17:32.371683 29482 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1218 12:17:32.371745 29482 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1218 12:17:32.371783 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1218 12:17:32.371838 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1218 12:17:32.371901 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:32.371949 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1218 12:17:32.372158 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:32.372180 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I1218 12:17:32.372274 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1218 12:17:32.372330 29482 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1218 12:17:32.372308 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1218 12:17:32.372348 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1218 12:17:32.372386 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1218 12:17:32.372428 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1218 12:17:32.372513 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1218 12:17:32.372529 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1218 12:17:32.372562 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I1218 12:17:32.372644 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1218 12:17:32.372737 29482 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1218 12:17:32.372819 29482 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (3.12s) === RUN TestLifecycleMinimalOpenstack I1218 12:17:32.373311 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I1218 12:17:32.380926 29482 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:17:33.562980 29482 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1218 12:17:33.563032 29482 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1218 12:17:33.580557 29482 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2023/12/18 12:17:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1218 12:17:33.591806 29482 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1218 12:17:33.603371 29482 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1218 12:17:33.607025 29482 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2023/12/18 12:17:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1218 12:17:33.609883 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1218 12:17:33.609937 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1218 12:17:33.610158 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1218 12:17:34.615559 29482 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:17:36.027068 29482 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1218 12:17:36.027120 29482 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1218 12:17:36.047531 29482 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2023/12/18 12:17:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1218 12:17:36.053695 29482 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1218 12:17:36.066008 29482 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1218 12:17:36.067939 29482 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2023/12/18 12:17:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1218 12:17:36.071195 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1218 12:17:36.072359 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1218 12:17:36.072915 29482 executor.go:111] Tasks: 92 done / 92 total; 0 can run I1218 12:17:36.074590 29482 delete_cluster.go:128] Looking for cloud resources to delete 2023/12/18 12:17:36 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Subnet:8dfb72cc-1b04-46ae-99e0-b95f56dbbcbb ok Instance:e23eedd1-9807-44c2-99fb-624dde2923c1 ok SecurityGroup:8bbece18-629e-4ea5-b568-701a73f408ee ok Port:af8f3fea-f527-412d-b576-31bf2182c7ac ok Port:8f428238-3230-473a-8dd8-275c1a62514c ok SecurityGroup:6a9a6abf-0b4d-4be4-aae6-f926a8c56d27 ok Network:a771bdf7-24ab-4e2b-97c1-374af03ac089 ok ServerGroup:fe43a2cb-ac2d-457d-a933-6146b3fdab7c ok SecurityGroup:3c2d3873-d978-40ed-af55-5265c3982a2f ok Port:9ed0fcdb-96d5-4491-8982-f63269e52aff ok ServerGroup:8b6116c5-609f-4a16-b37e-328033ad1a32 ok Instance:eac976d0-8cf7-4d4e-ac2d-104a9d606bbf ok Instance:9dca2ad7-4e61-4bba-8769-e8b567cbde30 ok --- PASS: TestLifecycleMinimalOpenstack (4.80s) === RUN TestLifecycleMinimalGCE I1218 12:17:37.175870 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I1218 12:17:37.177647 29482 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:17:38.815972 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:17:38.816050 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:17:38.816144 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1218 12:17:38.816170 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1218 12:17:38.816189 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1218 12:17:38.816250 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1218 12:17:38.817368 29482 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1218 12:17:38.824259 29482 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1218 12:17:38.830839 29482 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1218 12:17:38.831874 29482 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1218 12:17:38.832151 29482 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1218 12:17:38.832252 29482 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:17:40.471672 29482 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1218 12:17:40.472023 29482 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1218 12:17:40.472224 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1218 12:17:40.472256 29482 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1218 12:17:40.472287 29482 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1218 12:17:40.472397 29482 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1218 12:17:40.475587 29482 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1218 12:17:40.479841 29482 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1218 12:17:40.486654 29482 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1218 12:17:40.487678 29482 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1218 12:17:40.487873 29482 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1218 12:17:40.489442 29482 delete_cluster.go:128] Looking for cloud resources to delete I1218 12:17:40.489508 29482 gce.go:99] Scanning zones: [us-test1-a] I1218 12:17:40.489890 29482 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I1218 12:17:40.489917 29482 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1702901858 ok InstanceTemplate:nodes-minimal-gce-example-com-1702901858 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (3.32s) === RUN TestLifecycleFloatingIPOpenstack I1218 12:17:40.491341 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I1218 12:17:40.499256 29482 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:17:41.900919 29482 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1218 12:17:41.900965 29482 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1218 12:17:41.918956 29482 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2023/12/18 12:17:41 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:41 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1218 12:17:41.925576 29482 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1218 12:17:41.939064 29482 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1218 12:17:41.942150 29482 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2023/12/18 12:17:41 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:41 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:41 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1218 12:17:41.944792 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1218 12:17:41.945194 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1218 12:17:41.945197 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1218 12:17:42.950496 29482 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1218 12:17:44.413934 29482 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1218 12:17:44.413982 29482 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1218 12:17:44.433296 29482 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2023/12/18 12:17:44 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:44 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1218 12:17:44.444805 29482 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1218 12:17:44.453063 29482 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1218 12:17:44.454840 29482 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2023/12/18 12:17:44 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:44 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2023/12/18 12:17:44 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1218 12:17:44.458189 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1218 12:17:44.458186 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1218 12:17:44.458544 29482 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1218 12:17:44.458948 29482 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1218 12:17:44.460659 29482 delete_cluster.go:128] Looking for cloud resources to delete 2023/12/18 12:17:44 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Port:900d7f24-c568-4a3d-881c-f025d7f66427 ok Router-IF:61af65fa-972c-4396-92f6-df9bef293b9b ok SecurityGroup:d354815f-b443-4ba8-b49a-5b4796966ffc ok ServerGroup:3a90e8f6-f335-420b-bbcf-543fdae7653b ok ServerGroup:eff3e0ec-02e6-4370-9269-07c5b735edf6 ok Router:9f5faf4e-1251-4740-be09-c3e18d986d67 ok Instance:7b0d1d87-412a-4540-a059-4e8bfe0245f5 ok Port:87dd63cb-f80b-4642-ad73-a4f85b754a49 ok Port:c4d3bcdf-fef2-417c-85f8-6c5473e9edb0 ok Subnet:61af65fa-972c-4396-92f6-df9bef293b9b ok Port:da076ff2-91d7-4345-9b27-136e382f5c4b ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Instance:a5636c42-96d2-4ed9-8076-f69134503b92 ok SecurityGroup:d9a2b2ce-db45-461f-b53f-452a066bf005 ok SecurityGroup:0e9b705c-6697-406d-9b04-518d701d4a76 ok Instance:b1dd5a0a-88c4-4822-bbce-e3d3dee9b85e ok Network:d0dc5862-472d-4360-9d3d-e3ab25ed6a9c ok --- PASS: TestLifecycleFloatingIPOpenstack (5.07s) === RUN TestLifecyclePrivateCalico I1218 12:17:45.564525 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:45.564697 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:45.564748 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:45.564804 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:45.564850 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:45.564904 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:45.564949 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:45.564979 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:45.565019 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:45.565048 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I1218 12:17:45.594849 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:17:45.598564 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:45.598655 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:45.598718 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:46.835098 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:47.286149 29482 iamrole.go:89] ListRoles: { } I1218 12:17:47.288390 29482 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1218 12:17:47.288757 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I1218 12:17:47.288869 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1218 12:17:47.289031 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I1218 12:17:47.289032 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:47.289161 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1218 12:17:47.289260 29482 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" }] }] } I1218 12:17:47.289389 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:17:47.289618 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:47.290991 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I1218 12:17:47.291095 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.privatecalico.example.com" }] } I1218 12:17:47.291228 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:47.291412 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" }] }] } I1218 12:17:47.291669 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:47.291855 29482 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1218 12:17:47.291952 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1218 12:17:47.292004 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1218 12:17:47.292038 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:17:47.292081 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:47.292386 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:47.292553 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:47.292749 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:47.292900 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:47.292952 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:47.293089 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:47.294527 29482 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1218 12:17:47.294707 29482 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1218 12:17:47.294771 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1218 12:17:47.294724 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] }] } I1218 12:17:47.294840 29482 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1218 12:17:47.294863 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1218 12:17:47.294927 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1218 12:17:47.294947 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1218 12:17:47.294959 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:47.295047 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:47.295094 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1218 12:17:47.295122 29482 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1218 12:17:47.295215 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1218 12:17:47.295192 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:47.295253 29482 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1218 12:17:47.295395 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1218 12:17:47.295431 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:47.295458 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1218 12:17:47.295565 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1218 12:17:47.295658 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1218 12:17:47.295932 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:17:47.296055 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:47.296120 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:47.296189 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:47.296290 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1218 12:17:47.296429 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" } ] }], VpcId: "vpc-1" } I1218 12:17:47.296403 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:47.296651 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1218 12:17:47.296862 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }], VpcId: "vpc-1" } I1218 12:17:47.296995 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" }] }], VpcId: "vpc-1" } I1218 12:17:47.297142 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:47.297267 29482 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.297393 29482 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1218 12:17:47.297501 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:17:47.297681 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1218 12:17:47.297774 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:17:47.297854 29482 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1218 12:17:47.297908 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:47.297999 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:47.298057 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:17:47.298150 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:47.298215 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:47.298289 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:47.298368 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:17:47.297912 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1218 12:17:47.298446 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:47.298605 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1218 12:17:47.299079 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:17:47.299134 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1218 12:17:47.299174 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:47.299260 29482 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" } ] } I1218 12:17:47.299354 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:17:47.299407 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:17:47.299450 29482 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I1218 12:17:47.299585 29482 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1218 12:17:47.299754 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1218 12:17:47.299887 29482 api.go:53] PageSize not implemented I1218 12:17:47.299944 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.299838 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:47.300114 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:47.300053 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:47.300181 29482 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1218 12:17:47.300255 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:47.300191 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1218 12:17:47.300290 29482 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I1218 12:17:47.300250 29482 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I1218 12:17:47.300346 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:47.300356 29482 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I1218 12:17:47.300517 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1218 12:17:47.300562 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1218 12:17:47.300619 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1218 12:17:47.300923 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I1218 12:17:47.301059 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.301217 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:47.301322 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1218 12:17:47.301398 29482 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.301467 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:17:47.301515 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1218 12:17:47.301651 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.301793 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.301942 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:47.302016 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:47.302086 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1218 12:17:47.302176 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:47.302215 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.302249 29482 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } W1218 12:17:47.302387 29482 api.go:53] PageSize not implemented I1218 12:17:47.302407 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:47.302346 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.302499 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.302636 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1218 12:17:47.302739 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" }] }] } I1218 12:17:47.302869 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1218 12:17:47.302994 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.303143 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.303279 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.303410 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.303535 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1218 12:17:47.303630 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" }] }] } I1218 12:17:47.303797 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:17:47.303887 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:47.303982 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.304120 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I1218 12:17:47.304257 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:17:47.304345 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1218 12:17:47.304384 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:17:47.304429 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.304553 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1218 12:17:47.304677 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1218 12:17:47.304811 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:47.304924 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1218 12:17:47.305005 29482 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1218 12:17:47.305089 29482 api.go:53] PageSize not implemented I1218 12:17:47.305119 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:47.305148 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:47.305246 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1218 12:17:47.305334 29482 api.go:53] PageSize not implemented I1218 12:17:47.305349 29482 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:47.305275 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:47.305413 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:47.305507 29482 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1218 12:17:47.305551 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:47.305642 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1218 12:17:47.305688 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:47.305668 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:47.305733 29482 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1218 12:17:47.311220 29482 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1218 12:17:47.311477 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:47.311612 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1218 12:17:47.311756 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:47.311885 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:47.311994 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:47.312132 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:47.312648 29482 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1218 12:17:47.312929 29482 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1218 12:17:47.313284 29482 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1218 12:17:47.313342 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:47.313378 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:47.313448 29482 dns.go:235] Pre-creating DNS records I1218 12:17:47.313483 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:47.320096 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:17:47.323753 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:47.323842 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:47.323904 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:48.582179 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:49.021020 29482 iamrole.go:89] ListRoles: { } I1218 12:17:49.023314 29482 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1218 12:17:49.023695 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.023914 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.024223 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:49.024442 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.024611 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:17:49.024666 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:17:49.024756 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:49.024932 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.025137 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:49.027940 29482 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1218 12:17:49.028088 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.028250 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:49.028217 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1218 12:17:49.028311 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1218 12:17:49.028300 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.028361 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1218 12:17:49.028377 29482 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1218 12:17:49.028480 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1218 12:17:49.028432 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.028645 29482 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1218 12:17:49.028552 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1218 12:17:49.028757 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:49.028845 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.029031 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1218 12:17:49.029226 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:49.029284 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:17:49.029327 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:49.029419 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.029542 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:49.029624 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1218 12:17:49.029762 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:17:49.029810 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1218 12:17:49.029980 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:49.030108 29482 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1218 12:17:49.030344 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:49.030430 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:49.030520 29482 api.go:53] PageSize not implemented W1218 12:17:49.030536 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:49.030567 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1218 12:17:49.030561 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:49.030641 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1218 12:17:49.030703 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:49.030708 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I1218 12:17:49.030595 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:49.030759 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1218 12:17:49.030763 29482 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I1218 12:17:49.030797 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } W1218 12:17:49.030883 29482 api.go:53] PageSize not implemented I1218 12:17:49.030902 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:49.030923 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:49.031049 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:49.031188 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:49.031457 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:49.031538 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1218 12:17:49.031586 29482 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1218 12:17:49.031655 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:49.031743 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1218 12:17:49.031845 29482 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1218 12:17:49.031898 29482 api.go:53] PageSize not implemented I1218 12:17:49.031932 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:49.031941 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:49.032026 29482 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" W1218 12:17:49.032053 29482 api.go:53] PageSize not implemented I1218 12:17:49.032133 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:49.032167 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:49.032264 29482 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I1218 12:17:49.032297 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:49.032133 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:49.032410 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:49.032413 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1218 12:17:49.037721 29482 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1218 12:17:49.037829 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:49.037937 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:49.038102 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:49.038213 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:49.038453 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:49.039023 29482 executor.go:111] Tasks: 134 done / 142 total; 2 can run W1218 12:17:49.039148 29482 api.go:53] PageSize not implemented I1218 12:17:49.039175 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:49.039374 29482 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1218 12:17:49.039625 29482 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1218 12:17:49.043081 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:17:49.043143 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:17:49.043187 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:17:49.043221 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1218 12:17:49.043260 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:17:49.043294 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:17:49.043327 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:17:49.043362 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:17:49.043405 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:17:49.043443 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:17:49.043483 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:17:49.043525 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1218 12:17:49.043563 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1218 12:17:49.043597 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:17:49.043628 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:17:49.043666 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:49.043705 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:17:49.043765 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:17:49.043801 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:49.043838 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:49.043873 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:17:49.043908 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1218 12:17:49.043943 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:49.043981 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:17:49.044014 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:17:49.044052 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:17:49.044087 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:17:49.044120 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:49.044159 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:49.044196 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:17:49.044235 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:17:49.045752 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:17:49.045822 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:17:49.045863 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:17:49.045906 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.045968 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1218 12:17:49.046041 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.046108 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.046157 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.046213 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.046257 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.046303 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1218 12:17:49.046361 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.046414 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:17:49.046450 29482 natgateway.go:117] DescribeNatGateways: { } I1218 12:17:49.046488 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1218 12:17:49.046529 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W1218 12:17:49.046586 29482 api.go:53] PageSize not implemented I1218 12:17:49.046604 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1218 12:17:49.046644 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:49.046668 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:49.046683 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1218 12:17:49.046720 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:17:49.046744 29482 targetgroups.go:35] PageSize not implemented I1218 12:17:49.046761 29482 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I1218 12:17:49.046818 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:17:49.046860 29482 iamrole.go:89] ListRoles: { } I1218 12:17:49.046911 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:49.046939 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:49.046986 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:17:49.047034 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:17:49.047095 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I1218 12:17:49.047136 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1218 12:17:49.047176 29482 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1218 12:17:49.047816 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1218 12:17:49.047880 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I1218 12:17:49.047853 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok iam-instance-profile:nodes.privatecalico.example.com ok I1218 12:17:49.047930 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok I1218 12:17:49.047999 29482 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I1218 12:17:49.048018 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1218 12:17:49.048117 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I1218 12:17:49.047957 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.privatecalico.example.com ok I1218 12:17:49.048022 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I1218 12:17:49.048173 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } W1218 12:17:49.048230 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-group:bastion.privatecalico.example.com ok I1218 12:17:49.048236 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok autoscaling-group:nodes.privatecalico.example.com ok I1218 12:17:49.048263 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } I1218 12:17:49.048177 29482 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } security-group:sg-2 ok I1218 12:17:49.048166 29482 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok load-balancer:api-privatecalico-example-0uch4k ok I1218 12:17:49.048337 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1218 12:17:49.048400 29482 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1218 12:17:49.048462 29482 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1218 12:17:49.048503 29482 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1218 12:17:49.048570 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1218 12:17:49.048620 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:49.049066 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W1218 12:17:49.049301 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:49.049330 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } autoscaling-config:lt-2 ok autoscaling-config:lt-3 ok autoscaling-config:lt-1 ok I1218 12:17:49.049404 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1218 12:17:49.049481 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W1218 12:17:49.049669 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:49.049684 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1218 12:17:49.049784 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I1218 12:17:49.049839 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I1218 12:17:49.049855 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1218 12:17:49.049827 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } I1218 12:17:49.049895 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } subnet:subnet-2 ok iam-role:nodes.privatecalico.example.com ok I1218 12:17:49.049924 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I1218 12:17:49.049965 29482 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I1218 12:17:49.049975 29482 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I1218 12:17:49.049983 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I1218 12:17:49.050097 29482 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I1218 12:17:49.050083 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1218 12:17:49.050121 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1218 12:17:49.050137 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:49.050177 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1218 12:17:49.050247 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I1218 12:17:49.050289 29482 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I1218 12:17:49.050188 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W1218 12:17:49.050347 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:49.050364 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1218 12:17:49.050468 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1218 12:17:49.050542 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1218 12:17:49.050676 29482 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1218 12:17:49.050767 29482 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (3.49s) === RUN TestLifecyclePrivateKopeio I1218 12:17:49.051273 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:49.051416 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:49.051456 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:49.051501 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:49.051543 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:49.051594 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:49.051636 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:49.051667 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:49.051706 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:49.051734 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I1218 12:17:49.081110 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:49.084593 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:49.084679 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:49.084743 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:50.365134 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:50.562969 29482 iamrole.go:89] ListRoles: { } I1218 12:17:50.565271 29482 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1218 12:17:50.565510 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.565747 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:50.565845 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I1218 12:17:50.565907 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:50.565981 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1218 12:17:50.566012 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.566147 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I1218 12:17:50.566221 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" }] } I1218 12:17:50.566176 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:50.566309 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:50.566361 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.566526 29482 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.566551 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:50.566696 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I1218 12:17:50.566772 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1218 12:17:50.566816 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1218 12:17:50.566809 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1218 12:17:50.566848 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:17:50.566915 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:50.566959 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" }] }] } I1218 12:17:50.567209 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:50.567212 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.567372 29482 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" }] }] } I1218 12:17:50.567476 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:17:50.570442 29482 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1218 12:17:50.570603 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.570794 29482 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1218 12:17:50.570773 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1218 12:17:50.570859 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1218 12:17:50.570866 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1218 12:17:50.570863 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.570976 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1218 12:17:50.570971 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I1218 12:17:50.571083 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1218 12:17:50.571056 29482 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1218 12:17:50.571103 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:50.571177 29482 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1218 12:17:50.571160 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:50.571206 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1218 12:17:50.571236 29482 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1218 12:17:50.571387 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:50.571382 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1218 12:17:50.571452 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:50.571495 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.571551 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1218 12:17:50.571634 29482 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1218 12:17:50.571695 29482 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.571790 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:17:50.571837 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.572024 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:50.572068 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] }] } I1218 12:17:50.572297 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:50.572343 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.572488 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1218 12:17:50.572562 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:50.572629 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I1218 12:17:50.572724 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:17:50.572765 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1218 12:17:50.572993 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:17:50.573092 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:50.573140 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:50.573177 29482 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1218 12:17:50.573234 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.573424 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1218 12:17:50.573435 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:50.573592 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1218 12:17:50.573274 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1218 12:17:50.573673 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:50.573748 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I1218 12:17:50.573849 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1218 12:17:50.573895 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1218 12:17:50.574107 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:17:50.574202 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:50.574248 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:50.574284 29482 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1218 12:17:50.574336 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1218 12:17:50.574561 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }], VpcId: "vpc-1" } I1218 12:17:50.574684 29482 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] } I1218 12:17:50.574774 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1218 12:17:50.574899 29482 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I1218 12:17:50.574986 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1218 12:17:50.575074 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1218 12:17:50.575117 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:17:50.575172 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:50.575218 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1218 12:17:50.575263 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:17:50.575317 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:17:50.575395 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:17:50.575439 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }], VpcId: "vpc-1" } I1218 12:17:50.575535 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1218 12:17:50.575589 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:17:50.575685 29482 executor.go:111] Tasks: 81 done / 144 total; 41 can run W1218 12:17:50.575998 29482 api.go:53] PageSize not implemented I1218 12:17:50.575953 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.576138 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:50.576140 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:50.576145 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:50.576264 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:50.576231 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:50.576226 29482 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1218 12:17:50.576389 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:50.576407 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1218 12:17:50.576396 29482 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-4" },{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I1218 12:17:50.576474 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1218 12:17:50.576439 29482 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1218 12:17:50.576523 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1218 12:17:50.576565 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:50.576527 29482 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1218 12:17:50.576617 29482 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W1218 12:17:50.576713 29482 api.go:53] PageSize not implemented I1218 12:17:50.576736 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:50.576723 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.576961 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" }] }] } I1218 12:17:50.577135 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.577272 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1218 12:17:50.577433 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1218 12:17:50.577514 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:50.577583 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:50.577654 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:50.577727 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.577999 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.578145 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.578442 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.578719 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:17:50.578830 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:50.578913 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:17:50.578959 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1218 12:17:50.579097 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.579231 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I1218 12:17:50.579339 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.579468 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:17:50.579559 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1218 12:17:50.579642 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.579766 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1218 12:17:50.579897 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I1218 12:17:50.579986 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.580110 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.580241 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.580374 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1218 12:17:50.580447 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.580573 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:17:50.580617 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1218 12:17:50.580656 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1218 12:17:50.580721 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:17:50.580770 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:50.580851 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.580988 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1218 12:17:50.581025 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1218 12:17:50.581151 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I1218 12:17:50.581193 29482 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1218 12:17:50.581242 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1218 12:17:50.581289 29482 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1218 12:17:50.581327 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1218 12:17:50.581368 29482 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1218 12:17:50.581410 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1218 12:17:50.581448 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:17:50.581486 29482 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1218 12:17:50.581524 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:50.581564 29482 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1218 12:17:50.581600 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:17:50.581639 29482 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1218 12:17:50.581678 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:50.581783 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1218 12:17:50.581927 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I1218 12:17:50.582007 29482 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1218 12:17:50.582066 29482 api.go:53] PageSize not implemented I1218 12:17:50.582102 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:50.582110 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1218 12:17:50.582224 29482 api.go:53] PageSize not implemented I1218 12:17:50.582117 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:50.582224 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:50.582281 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:50.582360 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-2" } I1218 12:17:50.582381 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:50.582424 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:50.582488 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:50.582546 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-3" } I1218 12:17:50.592595 29482 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1218 12:17:50.592825 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:50.592949 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:50.593255 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:50.593377 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:50.593916 29482 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1218 12:17:50.594201 29482 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1218 12:17:50.594703 29482 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1218 12:17:50.594787 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:50.594854 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:50.594955 29482 dns.go:235] Pre-creating DNS records I1218 12:17:50.594983 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:50.601598 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:50.605094 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:50.605183 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:50.605248 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:51.908238 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:52.097160 29482 iamrole.go:89] ListRoles: { } I1218 12:17:52.099453 29482 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1218 12:17:52.099780 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:52.099895 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.100490 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.100983 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.101129 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:17:52.101163 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:17:52.101215 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:52.101258 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:52.101572 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.103521 29482 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1218 12:17:52.103745 29482 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1218 12:17:52.103711 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.103890 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1218 12:17:52.103986 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1218 12:17:52.104029 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1218 12:17:52.104052 29482 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1218 12:17:52.103981 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1218 12:17:52.104168 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1218 12:17:52.104200 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:52.104287 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.104449 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.104601 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:52.104649 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.104820 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:17:52.104867 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.105002 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:17:52.105042 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1218 12:17:52.105200 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:52.105282 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:52.105444 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.105601 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.105742 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.105904 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1218 12:17:52.105951 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1218 12:17:52.106124 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:52.106178 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1218 12:17:52.106341 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:17:52.106438 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:52.106611 29482 executor.go:111] Tasks: 81 done / 144 total; 41 can run W1218 12:17:52.106776 29482 api.go:53] PageSize not implemented I1218 12:17:52.106748 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1218 12:17:52.106815 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1218 12:17:52.106817 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:52.106865 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:52.106945 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:52.107017 29482 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } W1218 12:17:52.106901 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:52.107097 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1218 12:17:52.106968 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:52.107145 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1218 12:17:52.107258 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I1218 12:17:52.107312 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1218 12:17:52.107298 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:52.107351 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W1218 12:17:52.107453 29482 api.go:53] PageSize not implemented I1218 12:17:52.107477 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:52.107576 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:52.107734 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:52.108039 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1218 12:17:52.108245 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:52.108385 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:52.108547 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:52.108744 29482 executor.go:111] Tasks: 122 done / 144 total; 7 can run I1218 12:17:52.108837 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:52.108921 29482 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" W1218 12:17:52.108932 29482 api.go:53] PageSize not implemented I1218 12:17:52.108882 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:52.108957 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:52.109051 29482 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I1218 12:17:52.108976 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:52.109023 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1218 12:17:52.109176 29482 api.go:53] PageSize not implemented I1218 12:17:52.109231 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:52.109399 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:52.109467 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:52.114881 29482 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1218 12:17:52.115007 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:52.115169 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:52.115363 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:52.115525 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:52.116013 29482 executor.go:111] Tasks: 136 done / 144 total; 2 can run W1218 12:17:52.116142 29482 api.go:53] PageSize not implemented I1218 12:17:52.116168 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:52.116369 29482 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1218 12:17:52.116587 29482 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1218 12:17:52.120118 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:17:52.120185 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:17:52.120229 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:17:52.120267 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:17:52.120300 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:17:52.120337 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:17:52.120371 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:17:52.120436 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:17:52.120474 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:17:52.120516 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:17:52.120553 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1218 12:17:52.120596 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:17:52.120633 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:17:52.120669 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:52.120704 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:17:52.120741 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:17:52.120780 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1218 12:17:52.120818 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:52.120854 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:52.120890 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:17:52.120926 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1218 12:17:52.120962 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:52.121002 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:17:52.121036 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:17:52.121074 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1218 12:17:52.121112 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1218 12:17:52.121149 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:17:52.121187 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:17:52.121222 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:52.121259 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:52.121296 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:17:52.121333 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:17:52.123004 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:17:52.123077 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:17:52.123097 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:17:52.123137 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.123197 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1218 12:17:52.123268 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.123334 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.123382 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.123434 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.123478 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.123528 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1218 12:17:52.123595 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.123659 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:17:52.123693 29482 natgateway.go:117] DescribeNatGateways: { } I1218 12:17:52.123748 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1218 12:17:52.123793 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W1218 12:17:52.123847 29482 api.go:53] PageSize not implemented I1218 12:17:52.123865 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1218 12:17:52.123907 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:52.123932 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:52.123947 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1218 12:17:52.123986 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:17:52.124011 29482 targetgroups.go:35] PageSize not implemented I1218 12:17:52.124029 29482 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" ] } I1218 12:17:52.124092 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:17:52.124134 29482 iamrole.go:89] ListRoles: { } I1218 12:17:52.124176 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:52.124205 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:52.124246 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:17:52.124294 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:17:52.124347 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1","rtb-3"] } I1218 12:17:52.124395 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1218 12:17:52.124428 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } autoscaling-config:lt-1 ok I1218 12:17:52.125087 29482 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok autoscaling-group:nodes.privatekopeio.example.com ok I1218 12:17:52.125204 29482 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I1218 12:17:52.125211 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1218 12:17:52.125301 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I1218 12:17:52.125291 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:17:52.125311 29482 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } iam-instance-profile:bastions.privatekopeio.example.com ok I1218 12:17:52.125341 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1218 12:17:52.125396 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } autoscaling-group:bastion.privatekopeio.example.com ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I1218 12:17:52.125430 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok I1218 12:17:52.125476 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } load-balancer:api-privatekopeio-example-tl2bv8 ok I1218 12:17:52.125196 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.privatekopeio.example.com. ok iam-instance-profile:masters.privatekopeio.example.com ok I1218 12:17:52.125360 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W1218 12:17:52.125584 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:52.125606 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1218 12:17:52.125653 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1218 12:17:52.125714 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1218 12:17:52.125758 29482 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1218 12:17:52.125814 29482 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1218 12:17:52.125851 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:52.125903 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W1218 12:17:52.126017 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:52.126037 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1218 12:17:52.126070 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:52.126119 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W1218 12:17:52.126285 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:52.126304 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1218 12:17:52.126339 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-3 ok autoscaling-config:lt-2 ok I1218 12:17:52.126486 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1218 12:17:52.126518 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I1218 12:17:52.126550 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I1218 12:17:52.126628 29482 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com subnet:subnet-1 ok I1218 12:17:52.126656 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1218 12:17:52.126670 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:52.126722 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I1218 12:17:52.126808 29482 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1218 12:17:52.126824 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1218 12:17:52.126861 29482 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I1218 12:17:52.126754 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W1218 12:17:52.126915 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:52.126935 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1218 12:17:52.126926 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I1218 12:17:52.126981 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } I1218 12:17:52.127011 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com subnet:subnet-2 ok I1218 12:17:52.127029 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1218 12:17:52.127035 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I1218 12:17:52.127084 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I1218 12:17:52.127125 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I1218 12:17:52.127209 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1218 12:17:52.127265 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1218 12:17:52.127319 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1218 12:17:52.127398 29482 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1218 12:17:52.127479 29482 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (3.08s) === RUN TestLifecycleIPv6 I1218 12:17:52.127940 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:52.128078 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:52.128116 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:52.128155 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:52.128197 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:52.128247 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:52.128288 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:52.128319 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:52.128357 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:52.128385 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I1218 12:17:52.158012 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:17:52.161650 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:52.161733 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:53.434995 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:53.620537 29482 iamrole.go:89] ListRoles: { } I1218 12:17:53.622735 29482 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1218 12:17:53.623177 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.623288 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:53.623337 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:53.623431 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:53.623466 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:53.623567 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.623656 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.623766 29482 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.623835 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:17:53.623971 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.624318 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I1218 12:17:53.624369 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1218 12:17:53.624308 29482 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.624472 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1218 12:17:53.624539 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1218 12:17:53.624602 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:17:53.624674 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:53.624743 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] }] } I1218 12:17:53.624960 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:53.625139 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:53.625590 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I1218 12:17:53.625690 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1218 12:17:53.627666 29482 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1218 12:17:53.627838 29482 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1218 12:17:53.627861 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:53.628024 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1218 12:17:53.627972 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.628071 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1218 12:17:53.628142 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1218 12:17:53.628147 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1218 12:17:53.628316 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1218 12:17:53.628295 29482 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1218 12:17:53.628333 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I1218 12:17:53.628417 29482 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1218 12:17:53.628337 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.628514 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1218 12:17:53.628592 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.628654 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1218 12:17:53.628716 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1218 12:17:53.628846 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1218 12:17:53.628844 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1218 12:17:53.628886 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1218 12:17:53.629047 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1218 12:17:53.629110 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:17:53.629216 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:53.629267 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:53.629310 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:17:53.629357 29482 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I1218 12:17:53.629438 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.629633 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1218 12:17:53.629869 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1218 12:17:53.630076 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:17:53.630169 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:53.629878 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1218 12:17:53.630251 29482 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1218 12:17:53.630343 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.630473 29482 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I1218 12:17:53.630559 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:17:53.630647 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:17:53.630741 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:17:53.630791 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:53.630843 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:53.630947 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:53.631015 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:53.631104 29482 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] } I1218 12:17:53.631188 29482 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1218 12:17:53.631236 29482 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.631323 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:17:53.631429 29482 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1218 12:17:53.631635 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I1218 12:17:53.631809 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.631996 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.632036 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:53.632157 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:53.632220 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I1218 12:17:53.632215 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I1218 12:17:53.632415 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1218 12:17:53.632651 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" }] }] } I1218 12:17:53.632939 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.633085 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:53.633186 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:53.633254 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:53.633329 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:53.633323 29482 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.633402 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I1218 12:17:53.633486 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:53.633637 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I1218 12:17:53.633762 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.634013 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:53.634145 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:53.634248 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.634347 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" }] }] } I1218 12:17:53.634464 29482 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1218 12:17:53.634485 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.634540 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:53.634609 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1218 12:17:53.634741 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:53.634770 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1218 12:17:53.634792 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1218 12:17:53.634951 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:17:53.635063 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1218 12:17:53.635206 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.635374 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I1218 12:17:53.635420 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.635553 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I1218 12:17:53.635595 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:53.635687 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.635819 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1218 12:17:53.635836 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1218 12:17:53.635944 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1218 12:17:53.636032 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.636167 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" }] }] } I1218 12:17:53.636307 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.636439 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.636575 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.636749 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1218 12:17:53.636799 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1218 12:17:53.636844 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1218 12:17:53.636887 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:17:53.636930 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1218 12:17:53.636972 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1218 12:17:53.637021 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:17:53.637088 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:17:53.637130 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1218 12:17:53.637175 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1218 12:17:53.637243 29482 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1218 12:17:53.637348 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1218 12:17:53.637353 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1218 12:17:53.637413 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:53.637456 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:53.637561 29482 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-3"] }] } I1218 12:17:53.637557 29482 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-3" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I1218 12:17:53.637661 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:53.637695 29482 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-3", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.637795 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1218 12:17:53.637845 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1218 12:17:53.637892 29482 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1218 12:17:53.637941 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1218 12:17:53.637987 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I1218 12:17:53.638032 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:53.638168 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I1218 12:17:53.638213 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-5" } I1218 12:17:53.638251 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:53.638380 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1218 12:17:53.638428 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I1218 12:17:53.638465 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:53.638541 29482 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } I1218 12:17:53.638627 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:53.638648 29482 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1218 12:17:53.638779 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1218 12:17:53.638826 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1218 12:17:53.638872 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I1218 12:17:53.638913 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:17:53.638952 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:53.639021 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1218 12:17:53.639065 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1218 12:17:53.639103 29482 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I1218 12:17:53.639156 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-6" } I1218 12:17:53.639198 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1218 12:17:53.639259 29482 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I1218 12:17:53.639324 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1218 12:17:53.639339 29482 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1218 12:17:53.639388 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-4" } W1218 12:17:53.639409 29482 api.go:53] PageSize not implemented I1218 12:17:53.639471 29482 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1218 12:17:53.639536 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:53.639589 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:53.639566 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:53.639611 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1218 12:17:53.639647 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:53.639700 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:53.639771 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1218 12:17:53.639814 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } W1218 12:17:53.639845 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:53.639871 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:53.639876 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:53.639915 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1218 12:17:53.640006 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I1218 12:17:53.639997 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:53.640064 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:53.640185 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1218 12:17:53.640231 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:53.640342 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-1" } I1218 12:17:53.645599 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:17:53.645788 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:53.645908 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:53.646063 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:53.646178 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:53.646616 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:17:53.646855 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:17:53.647172 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:17:53.647230 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:53.647269 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:53.647332 29482 dns.go:235] Pre-creating DNS records I1218 12:17:53.647359 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:53.654151 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1218 12:17:53.657833 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:53.657921 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:54.953403 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:55.141564 29482 iamrole.go:89] ListRoles: { } I1218 12:17:55.143737 29482 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1218 12:17:55.144058 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.144213 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:55.144270 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.144421 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:17:55.144446 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:17:55.144477 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:55.144503 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.144608 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.144964 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:55.146922 29482 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1218 12:17:55.147120 29482 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1218 12:17:55.147175 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:55.147288 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.147305 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1218 12:17:55.147402 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1218 12:17:55.147449 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1218 12:17:55.147444 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1218 12:17:55.147393 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.147609 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] }] } I1218 12:17:55.147797 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.147976 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:55.148098 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.148275 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1218 12:17:55.148496 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:55.148556 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1218 12:17:55.148740 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1218 12:17:55.148928 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:55.149038 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:55.149270 29482 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1218 12:17:55.149417 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:55.149550 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:55.149680 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] }] } I1218 12:17:55.149913 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:17:55.150064 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:55.150155 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1218 12:17:55.150199 29482 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I1218 12:17:55.150253 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1218 12:17:55.150499 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.150694 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1218 12:17:55.150744 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.150880 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:17:55.151048 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:55.151134 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1218 12:17:55.151172 29482 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1218 12:17:55.151209 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1218 12:17:55.151255 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.151365 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:55.151447 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.151541 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:55.151624 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.151739 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1218 12:17:55.151778 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1218 12:17:55.151825 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:55.151938 29482 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1218 12:17:55.152051 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:55.152087 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:55.152203 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:55.152156 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:55.152230 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1218 12:17:55.152275 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1218 12:17:55.152305 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1218 12:17:55.152374 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1218 12:17:55.152364 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:55.152423 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1218 12:17:55.152446 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:55.152481 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1218 12:17:55.152524 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1218 12:17:55.152585 29482 api.go:53] PageSize not implemented I1218 12:17:55.152607 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1218 12:17:55.152675 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:55.152748 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1218 12:17:55.152803 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:55.152905 29482 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1218 12:17:55.152983 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:55.153023 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:55.153048 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:55.153138 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:55.153126 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:55.153067 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:55.153191 29482 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1218 12:17:55.153108 29482 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1218 12:17:55.153164 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1218 12:17:55.153251 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:55.153293 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:55.153372 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:55.153363 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:55.153404 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1218 12:17:55.153521 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:17:55.153581 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1218 12:17:55.153658 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:17:55.153685 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1218 12:17:55.160032 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:17:55.160184 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:55.160375 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:55.160578 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:55.160747 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:55.161254 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:17:55.161534 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:17:55.161804 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:17:55.165176 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:17:55.165242 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:17:55.165283 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:17:55.165322 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I1218 12:17:55.165362 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1218 12:17:55.165403 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:17:55.165439 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1218 12:17:55.165484 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:17:55.165520 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:17:55.165555 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:17:55.165596 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:17:55.165634 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:17:55.165674 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:17:55.165721 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1218 12:17:55.165759 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1218 12:17:55.165794 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:17:55.165829 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:17:55.165863 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:55.165899 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:17:55.165933 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:17:55.165971 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1218 12:17:55.166010 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:55.166047 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:55.166084 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:17:55.166118 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:55.166156 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:17:55.166190 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:17:55.166227 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1218 12:17:55.166268 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1218 12:17:55.166306 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1218 12:17:55.166343 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1218 12:17:55.166380 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:17:55.166414 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:17:55.166447 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:55.166486 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:55.166526 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:17:55.166564 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:17:55.168683 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:17:55.168754 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:17:55.168776 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:17:55.168817 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.168874 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1218 12:17:55.168938 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.169005 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.169060 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.169117 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.169167 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.169221 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1218 12:17:55.169292 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.169374 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:17:55.169408 29482 natgateway.go:117] DescribeNatGateways: { } I1218 12:17:55.169451 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1218 12:17:55.169494 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W1218 12:17:55.169552 29482 api.go:53] PageSize not implemented I1218 12:17:55.169572 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:55.169596 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:55.169610 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1218 12:17:55.169651 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:17:55.169675 29482 targetgroups.go:35] PageSize not implemented I1218 12:17:55.169692 29482 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" ] } I1218 12:17:55.169755 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:17:55.169791 29482 iamrole.go:89] ListRoles: { } I1218 12:17:55.169839 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:55.169867 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:55.169908 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:17:55.169957 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:17:55.170012 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3","rtb-1","rtb-2"] } I1218 12:17:55.170057 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1218 12:17:55.170094 29482 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1218 12:17:55.170128 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1218 12:17:55.170163 29482 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } autoscaling-config:lt-1 ok I1218 12:17:55.170892 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok autoscaling-config:lt-2 ok I1218 12:17:55.170925 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } autoscaling-group:nodes.minimal-ipv6.example.com ok I1218 12:17:55.170968 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1218 12:17:55.171002 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok iam-instance-profile:nodes.minimal-ipv6.example.com ok I1218 12:17:55.171021 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:55.171048 29482 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1218 12:17:55.171107 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok security-group:sg-3 ok I1218 12:17:55.171141 29482 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1218 12:17:55.171202 29482 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1218 12:17:55.171190 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1218 12:17:55.171248 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } I1218 12:17:55.171265 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } subnet:subnet-4 ok iam-instance-profile:masters.minimal-ipv6.example.com ok I1218 12:17:55.171202 29482 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I1218 12:17:55.171111 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.minimal-ipv6.example.com ok I1218 12:17:55.171319 29482 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I1218 12:17:55.171439 29482 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I1218 12:17:55.171529 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I1218 12:17:55.171619 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1218 12:17:55.171682 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:55.171746 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 } ] } W1218 12:17:55.171897 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:55.171919 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1218 12:17:55.171963 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1218 12:17:55.172015 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:55.172066 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W1218 12:17:55.172340 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:55.172361 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1218 12:17:55.172403 29482 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1218 12:17:55.172521 29482 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I1218 12:17:55.172577 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1218 12:17:55.172582 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I1218 12:17:55.172626 29482 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I1218 12:17:55.172673 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1218 12:17:55.172678 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1218 12:17:55.172694 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1218 12:17:55.172734 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } I1218 12:17:55.172730 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } iam-role:nodes.minimal-ipv6.example.com ok subnet:subnet-6 ok I1218 12:17:55.172773 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1218 12:17:55.172783 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I1218 12:17:55.172863 29482 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1218 12:17:55.172881 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1218 12:17:55.172916 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I1218 12:17:55.172997 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1218 12:17:55.173056 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1218 12:17:55.173137 29482 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1218 12:17:55.173218 29482 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (3.05s) === RUN TestLifecycleSharedVPC I1218 12:17:55.173688 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:55.174230 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:55.174271 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:55.174310 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:55.174348 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:55.174398 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:55.174439 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:55.174468 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:55.174511 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:55.174543 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I1218 12:17:55.203630 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:55.206905 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:55.207003 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:56.512522 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:56.694187 29482 iamrole.go:89] ListRoles: { } I1218 12:17:56.695395 29482 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1218 12:17:56.695568 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:17:56.695646 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1218 12:17:56.695672 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1218 12:17:56.696019 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:56.696176 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:56.696293 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:56.696532 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:56.696532 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:56.696726 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1218 12:17:56.697160 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:56.697338 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:56.697485 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:56.698088 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I1218 12:17:56.698171 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I1218 12:17:56.698626 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I1218 12:17:56.698746 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I1218 12:17:56.700649 29482 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1218 12:17:56.700977 29482 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1218 12:17:56.700920 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] }] } I1218 12:17:56.701264 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1218 12:17:56.701318 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1218 12:17:56.701582 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:56.701683 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1218 12:17:56.702120 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1218 12:17:56.702109 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:56.702283 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:17:56.702214 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1218 12:17:56.702643 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1218 12:17:56.702652 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:56.702858 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1218 12:17:56.703034 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1218 12:17:56.703214 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1218 12:17:56.703230 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I1218 12:17:56.703642 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:56.703887 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1218 12:17:56.704867 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:56.704926 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:56.704967 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:56.705001 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:56.705040 29482 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1218 12:17:56.706578 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1218 12:17:56.710085 29482 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1218 12:17:56.710325 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1218 12:17:56.710550 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:56.710723 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:56.710829 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:56.711004 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1218 12:17:56.711077 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1218 12:17:56.711248 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1218 12:17:56.711291 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1218 12:17:56.711422 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:56.711545 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1218 12:17:56.711688 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1218 12:17:56.711957 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1218 12:17:56.712113 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1218 12:17:56.712258 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1218 12:17:56.712310 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:56.712438 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" }] }] } I1218 12:17:56.712630 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1218 12:17:56.712773 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" }] }] } I1218 12:17:56.712910 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1218 12:17:56.713040 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" }] }] } I1218 12:17:56.713176 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1218 12:17:56.713299 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1218 12:17:56.713428 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:56.713523 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:56.713632 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1218 12:17:56.714279 29482 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1218 12:17:56.714606 29482 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1218 12:17:56.714934 29482 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1218 12:17:56.715001 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:56.715041 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:56.715108 29482 dns.go:235] Pre-creating DNS records I1218 12:17:56.715140 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:56.721577 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:17:56.724720 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:56.724811 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:57.781956 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:57.968986 29482 iamrole.go:89] ListRoles: { } I1218 12:17:57.970553 29482 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1218 12:17:57.971198 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] }] } I1218 12:17:57.971392 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.971608 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:17:57.971690 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1218 12:17:57.971726 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1218 12:17:57.972191 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:17:57.972393 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:17:57.973920 29482 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1218 12:17:57.974060 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:17:57.974196 29482 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1218 12:17:57.974200 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1218 12:17:57.974358 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1218 12:17:57.974392 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:57.974444 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1218 12:17:57.974645 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:57.974710 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.974890 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.975063 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:57.979887 29482 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1218 12:17:57.980008 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:57.980116 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:57.980242 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:57.980496 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:57.980776 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:57.980972 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:57.981135 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:57.981637 29482 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1218 12:17:57.981863 29482 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1218 12:17:57.982118 29482 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1218 12:17:57.984751 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:17:57.984815 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:17:57.984850 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:17:57.984885 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:17:57.984921 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:17:57.984955 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:17:57.984993 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:17:57.985035 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:17:57.985071 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:17:57.985102 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:17:57.985134 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:57.985167 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:17:57.985198 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:57.985230 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:57.985263 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:57.985297 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:17:57.985328 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:17:57.985361 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:17:57.985392 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:57.985427 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:57.985464 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:17:57.986755 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:17:57.986815 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:17:57.986839 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:17:57.986881 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.986930 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1218 12:17:57.986988 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.987067 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.987114 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.987156 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.987200 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.987238 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1218 12:17:57.987286 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.987339 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1218 12:17:57.987374 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W1218 12:17:57.987423 29482 api.go:53] PageSize not implemented I1218 12:17:57.987445 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:57.987472 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:57.987491 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:17:57.987515 29482 targetgroups.go:35] PageSize not implemented I1218 12:17:57.987534 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1218 12:17:57.987586 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:17:57.987620 29482 iamrole.go:89] ListRoles: { } I1218 12:17:57.987666 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:57.987696 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:57.987739 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:17:57.987777 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:17:57.987807 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:57.988187 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I1218 12:17:57.988253 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.sharedvpc.example.com ok I1218 12:17:57.988305 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1218 12:17:57.988357 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I1218 12:17:57.988337 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1218 12:17:57.988479 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:57.988498 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok iam-instance-profile:masters.sharedvpc.example.com ok I1218 12:17:57.988546 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:57.988424 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedvpc.example.com. ok I1218 12:17:57.988513 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1218 12:17:57.988647 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I1218 12:17:57.988591 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1218 12:17:57.988785 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:17:57.988806 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1218 12:17:57.988838 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I1218 12:17:57.988917 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1218 12:17:57.989002 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I1218 12:17:57.989048 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1218 12:17:57.989064 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1218 12:17:57.989053 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I1218 12:17:57.989100 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } subnet:subnet-1 ok iam-role:nodes.sharedvpc.example.com ok I1218 12:17:57.989125 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I1218 12:17:57.989165 29482 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I1218 12:17:57.989177 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1218 12:17:57.989205 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I1218 12:17:57.989261 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (2.82s) === RUN TestLifecycleComplex I1218 12:17:57.989701 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:17:57.989835 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:17:57.989872 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:17:57.989914 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:17:57.989955 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:17:57.990006 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:17:57.990046 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:17:57.990077 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:17:57.990114 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:17:57.990141 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I1218 12:17:58.030780 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:17:58.035792 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:58.035892 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:59.267757 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:59.462798 29482 iamrole.go:89] ListRoles: { } I1218 12:17:59.464513 29482 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1218 12:17:59.464690 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:17:59.465001 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1218 12:17:59.465111 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:17:59.465149 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I1218 12:17:59.465237 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I1218 12:17:59.465244 29482 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1218 12:17:59.465358 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:17:59.465402 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1218 12:17:59.465473 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:17:59.465647 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I1218 12:17:59.465698 29482 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1218 12:17:59.465743 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I1218 12:17:59.465782 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:17:59.465963 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:59.466106 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } W1218 12:17:59.466228 29482 api.go:53] PageSize not implemented I1218 12:17:59.466152 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:17:59.466312 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1218 12:17:59.466345 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1218 12:17:59.466366 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:17:59.466399 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:59.466428 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:17:59.466498 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:17:59.466537 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:17:59.466639 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:17:59.467877 29482 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1218 12:17:59.468034 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:17:59.468105 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:17:59.468167 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:17:59.468268 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:17:59.468296 29482 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1218 12:17:59.468353 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1218 12:17:59.468446 29482 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:17:59.468287 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:17:59.468556 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1218 12:17:59.468558 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1218 12:17:59.468528 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:17:59.468808 29482 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1218 12:17:59.468782 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" } ] }], VpcId: "vpc-1" } I1218 12:17:59.468898 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:17:59.468827 29482 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1218 12:17:59.468921 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:17:59.468961 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1218 12:17:59.468985 29482 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:17:59.469069 29482 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I1218 12:17:59.469183 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:59.469356 29482 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I1218 12:17:59.469429 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:17:59.469581 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:59.469790 29482 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1218 12:17:59.469861 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:59.469973 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:17:59.470171 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:17:59.470338 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I1218 12:17:59.470494 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I1218 12:17:59.470570 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:17:59.470721 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:17:59.470857 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:17:59.470634 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1218 12:17:59.470957 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:17:59.471107 29482 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I1218 12:17:59.471171 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I1218 12:17:59.471297 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:17:59.471235 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I1218 12:17:59.471358 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:17:59.471419 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:17:59.471468 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:17:59.471519 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:17:59.471560 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:17:59.471601 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:17:59.471652 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:17:59.471687 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1218 12:17:59.471819 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I1218 12:17:59.471830 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1218 12:17:59.471962 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:17:59.472022 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:17:59.472069 29482 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1218 12:17:59.472118 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:17:59.472169 29482 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1218 12:17:59.472320 29482 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1218 12:17:59.472492 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:59.472602 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:59.472718 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:59.472805 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1218 12:17:59.472883 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1218 12:17:59.472942 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1218 12:17:59.473257 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I1218 12:17:59.473393 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1218 12:17:59.473687 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1218 12:17:59.473896 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:59.474013 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-1", TransitGatewayId: "tgw-123456" } I1218 12:17:59.474086 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I1218 12:17:59.474211 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:59.474313 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:17:59.474327 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:17:59.474427 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-1", TransitGatewayId: "tgw-0123456" } I1218 12:17:59.474487 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" } ] }] } I1218 12:17:59.474662 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1218 12:17:59.474859 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I1218 12:17:59.474994 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I1218 12:17:59.475176 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1218 12:17:59.475305 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1218 12:17:59.475490 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1218 12:17:59.475551 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" } ] }] } I1218 12:17:59.475730 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1218 12:17:59.475917 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1218 12:17:59.476049 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I1218 12:17:59.476176 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1218 12:17:59.476294 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1218 12:17:59.476421 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1218 12:17:59.476602 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I1218 12:17:59.476725 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1218 12:17:59.476776 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1218 12:17:59.476841 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1218 12:17:59.477019 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1218 12:17:59.477227 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1218 12:17:59.477417 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1218 12:17:59.477505 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1218 12:17:59.477572 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:17:59.477618 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I1218 12:17:59.477742 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1218 12:17:59.477919 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1218 12:17:59.478098 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1218 12:17:59.478224 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" } ] }] } I1218 12:17:59.478404 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1218 12:17:59.478617 29482 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1218 12:17:59.478708 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:17:59.478744 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:59.478834 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:59.478858 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1218 12:17:59.478923 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I1218 12:17:59.478952 29482 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-2" }], Tags: [ { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], Type: "network" } I1218 12:17:59.479080 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:17:59.479141 29482 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1218 12:17:59.479240 29482 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1218 12:17:59.479315 29482 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1218 12:17:59.479394 29482 api.go:53] PageSize not implemented I1218 12:17:59.479452 29482 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1218 12:17:59.479502 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:59.479552 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:59.479559 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:59.479573 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:17:59.479731 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:59.479766 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:17:59.479860 29482 loadbalancers.go:35] PageSize not implemented I1218 12:17:59.479845 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:59.479885 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:17:59.480001 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:17:59.485733 29482 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1218 12:17:59.485959 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:59.486092 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:59.486178 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:59.486306 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:59.486927 29482 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1218 12:17:59.487246 29482 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1218 12:17:59.487555 29482 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1218 12:17:59.487608 29482 zones.go:93] ListHostedZonesPages { } I1218 12:17:59.487645 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:59.487716 29482 dns.go:235] Pre-creating DNS records I1218 12:17:59.487742 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:17:59.495792 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:17:59.499938 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:17:59.500030 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:00.769344 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:00.969882 29482 iamrole.go:89] ListRoles: { } I1218 12:18:00.971833 29482 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1218 12:18:00.972545 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:18:00.972812 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:00.972922 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:00.972951 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:00.973003 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:00.973054 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1218 12:18:00.973263 29482 api.go:53] PageSize not implemented I1218 12:18:00.973234 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1218 12:18:00.973354 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1218 12:18:00.973451 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:18:00.973548 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:00.974503 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:00.974700 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:00.975915 29482 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1218 12:18:00.976108 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:00.976286 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:00.976259 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:00.976292 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:18:00.976356 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:00.976372 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:00.976371 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:00.976430 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:00.976516 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:00.976632 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:00.976532 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:18:00.976697 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:00.976689 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1218 12:18:00.976748 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:18:00.976837 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:00.976925 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:00.977083 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:00.977145 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:18:00.977316 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:00.977358 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:00.977431 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:18:00.977564 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:18:00.977677 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:00.977894 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:00.977970 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:00.978190 29482 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1218 12:18:00.978465 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:00.978613 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:18:00.978701 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:00.979011 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:00.979141 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:00.979247 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:00.979421 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:00.979505 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:00.979621 29482 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1218 12:18:00.979691 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:00.979784 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:00.979893 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:00.979928 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:00.979997 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:00.980058 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:00.980122 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:00.980181 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:00.980237 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1218 12:18:00.980366 29482 api.go:53] PageSize not implemented I1218 12:18:00.980459 29482 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1218 12:18:00.980533 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:00.980594 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:00.980621 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:00.980651 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:00.980752 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:00.980775 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1218 12:18:00.980782 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:00.980856 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W1218 12:18:00.980836 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:00.980894 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:00.980987 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:00.981021 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:00.981087 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:00.981112 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:00.986629 29482 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1218 12:18:00.986744 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:00.986898 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:00.987043 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:00.987224 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:00.988719 29482 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1218 12:18:00.989578 29482 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1218 12:18:00.990152 29482 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I1218 12:18:00.998980 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:01.002495 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:01.014832 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:18:01.018873 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:01.018965 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:02.272005 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:02.468783 29482 iamrole.go:89] ListRoles: { } I1218 12:18:02.470355 29482 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1218 12:18:02.470656 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:18:02.470743 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:02.470936 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1218 12:18:02.471022 29482 api.go:53] PageSize not implemented I1218 12:18:02.471055 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:02.471090 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:02.471146 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:02.471280 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1218 12:18:02.471396 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:02.471466 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I1218 12:18:02.471693 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:18:02.471842 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1218 12:18:02.471976 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:02.473761 29482 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1218 12:18:02.473952 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:02.474106 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:02.474184 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:02.474115 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:18:02.474244 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:02.474210 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:02.474285 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:02.474367 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:02.474353 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:02.474469 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:02.474462 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:18:02.474588 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:02.474619 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:02.474634 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:18:02.474678 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:02.474888 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:02.475069 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:02.475153 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:18:02.475355 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:02.475436 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:02.475592 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:02.475719 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:18:02.475875 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:18:02.476055 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:02.476151 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:02.476379 29482 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1218 12:18:02.476494 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:02.476612 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:02.476723 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:02.476932 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:18:02.477122 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:02.477276 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:02.477402 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:02.477996 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:02.478123 29482 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1218 12:18:02.478194 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:02.478249 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:02.478338 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:02.478358 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:02.478405 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:02.478444 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:02.478484 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:02.478517 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:02.478551 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:02.478730 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I1218 12:18:02.478768 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:02.478801 29482 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I1218 12:18:02.478833 29482 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I1218 12:18:02.478866 29482 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1218 12:18:02.478959 29482 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1218 12:18:02.479030 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:02.479068 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W1218 12:18:02.479112 29482 api.go:53] PageSize not implemented I1218 12:18:02.479161 29482 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1218 12:18:02.479205 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:02.479282 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:02.479306 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:02.479313 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:02.479443 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:02.479461 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:02.479552 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:02.479559 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:02.479594 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:02.479673 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:02.479696 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:02.479857 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:02.480000 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:02.480030 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:02.485637 29482 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1218 12:18:02.485867 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:02.486055 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:02.486245 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:02.486457 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:02.487086 29482 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1218 12:18:02.487388 29482 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1218 12:18:02.487615 29482 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1218 12:18:02.487669 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:02.487704 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:02.487786 29482 dns.go:235] Pre-creating DNS records I1218 12:18:02.495923 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:18:02.500234 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:02.500331 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:03.674723 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:03.879997 29482 iamrole.go:89] ListRoles: { } I1218 12:18:03.881955 29482 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1218 12:18:03.882160 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:18:03.882387 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:03.882603 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:03.882669 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:03.882764 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:03.882818 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1218 12:18:03.882983 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1218 12:18:03.883319 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:03.883594 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:18:03.883743 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:03.883804 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:03.884014 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } W1218 12:18:03.884111 29482 api.go:53] PageSize not implemented I1218 12:18:03.887035 29482 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1218 12:18:03.887247 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:03.887363 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:18:03.887439 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:03.887481 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:03.887416 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:03.887546 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:03.887476 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:03.887655 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:18:03.887558 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:18:03.887756 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:03.887794 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:18:03.887858 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:03.887942 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:18:03.888102 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:03.888155 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:03.888267 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:03.888358 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:18:03.888552 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:03.888598 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:03.888672 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:03.888785 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:03.888886 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:03.888960 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1218 12:18:03.889184 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:03.889232 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:03.889332 29482 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1218 12:18:03.889547 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:03.889666 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:03.889757 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:03.889946 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:03.890047 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:03.890117 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:03.890237 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:18:03.890649 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:03.890804 29482 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1218 12:18:03.890894 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:03.890887 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:03.890993 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:03.891012 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:03.891058 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:03.891095 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:03.891132 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:03.891166 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:03.891200 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1218 12:18:03.891289 29482 api.go:53] PageSize not implemented I1218 12:18:03.891343 29482 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1218 12:18:03.891391 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:03.891438 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:03.891426 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:03.891454 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:03.891510 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:03.891535 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:03.891560 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:03.891530 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:03.891622 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:03.891640 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:03.891736 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:03.891766 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:03.891922 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:03.891976 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:03.897738 29482 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1218 12:18:03.897938 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:03.898192 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:03.899174 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:03.899471 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:03.901054 29482 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1218 12:18:03.901574 29482 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1218 12:18:03.902733 29482 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I1218 12:18:03.906983 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:03.910496 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:03.923519 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:18:03.927989 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:03.928080 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:05.165534 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:05.364807 29482 iamrole.go:89] ListRoles: { } I1218 12:18:05.366945 29482 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1218 12:18:05.367368 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:18:05.367455 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:05.367613 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:05.367858 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W1218 12:18:05.367971 29482 api.go:53] PageSize not implemented I1218 12:18:05.368082 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1218 12:18:05.368187 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:05.368346 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1218 12:18:05.368668 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:18:05.368944 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:05.369322 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:05.369457 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:05.369497 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:05.369573 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:05.371553 29482 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1218 12:18:05.371687 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:05.371747 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:05.371830 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:18:05.371918 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:05.371802 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:18:05.371983 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:05.371961 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:05.372061 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:05.372125 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:18:05.372213 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:05.372253 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:18:05.372255 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:05.372358 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:05.372412 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:05.372496 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:05.372639 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:05.372680 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:05.372764 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:18:05.372915 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:05.372973 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:05.373160 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:18:05.373347 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:05.373433 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I1218 12:18:05.373624 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:05.373673 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:05.373900 29482 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1218 12:18:05.374011 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:05.374257 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:05.374354 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:05.374499 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:18:05.374621 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:05.374728 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:05.374905 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:05.375129 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:05.375379 29482 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1218 12:18:05.375450 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:05.375508 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:05.375594 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:05.375615 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:05.375665 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:05.375705 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:05.375748 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:05.375782 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:05.375813 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1218 12:18:05.375908 29482 api.go:53] PageSize not implemented I1218 12:18:05.375957 29482 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1218 12:18:05.376001 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:05.376047 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:05.376062 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:05.376079 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:05.376195 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:05.376176 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:05.376250 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:05.376229 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:05.376298 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:05.376278 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:05.376404 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:05.376436 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:05.376494 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:05.376554 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:05.381915 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:18:05.382027 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:05.382197 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:05.382370 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:05.382487 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:05.383196 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:05.383275 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:05.383446 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:18:05.383703 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:18:05.384016 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:18:05.384068 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:05.384106 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:05.384179 29482 dns.go:235] Pre-creating DNS records I1218 12:18:05.392112 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:18:05.396273 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:05.396366 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:06.650743 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:06.846640 29482 iamrole.go:89] ListRoles: { } I1218 12:18:06.848733 29482 executor.go:111] Tasks: 0 done / 136 total; 52 can run W1218 12:18:06.848952 29482 api.go:53] PageSize not implemented I1218 12:18:06.849125 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:06.849340 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:18:06.849483 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.849624 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:06.849655 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:06.849685 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1218 12:18:06.849808 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.849944 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1218 12:18:06.850072 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:06.850638 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1218 12:18:06.850874 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.851226 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.851939 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:18:06.853121 29482 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1218 12:18:06.853350 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:06.853304 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:18:06.853420 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:06.853307 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.853447 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:06.853491 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:18:06.853572 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:18:06.853633 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:06.853533 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:18:06.853662 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:06.853768 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:06.853850 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:18:06.854046 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:06.854104 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:06.854245 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.854425 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:06.854487 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.854620 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:18:06.854795 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:06.854930 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.855062 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:06.855162 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.855277 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:06.855378 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:06.855532 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:06.855664 29482 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1218 12:18:06.855928 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:06.856058 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:06.856388 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:06.856492 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:06.856633 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:06.856780 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:18:06.857152 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:06.857250 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:06.857414 29482 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1218 12:18:06.857499 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:06.857565 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:06.857515 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:06.857584 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:06.857623 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:06.857659 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:06.857699 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:06.857734 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:06.857767 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1218 12:18:06.857850 29482 api.go:53] PageSize not implemented I1218 12:18:06.857897 29482 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1218 12:18:06.857948 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:06.857996 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:06.857992 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:06.858101 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:06.858012 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:06.858150 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:06.858232 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:06.858270 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:06.858311 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:06.858386 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:06.858443 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:06.858477 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:06.858626 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:06.858678 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:06.865942 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:18:06.866197 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:06.866587 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:06.867001 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:06.867278 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:06.869499 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:18:06.869790 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:18:06.870047 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I1218 12:18:06.875441 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:06.879321 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:06.879414 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:06.889057 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:18:06.893167 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:06.893255 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:06.893311 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:08.336644 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:08.542482 29482 iamrole.go:89] ListRoles: { } I1218 12:18:08.544763 29482 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1218 12:18:08.545191 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1218 12:18:08.545368 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:08.545632 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1218 12:18:08.545778 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:08.545893 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:08.545928 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:08.545988 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:08.546027 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:08.546170 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1218 12:18:08.546277 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1218 12:18:08.546377 29482 api.go:53] PageSize not implemented I1218 12:18:08.546592 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:18:08.546732 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:08.546819 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:18:08.549710 29482 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1218 12:18:08.549998 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:08.549842 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:18:08.550037 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:08.549983 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:18:08.550154 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:08.550086 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:18:08.550225 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:18:08.550313 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:08.550293 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:18:08.550399 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:08.550447 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:08.550544 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:08.550529 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:08.550680 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:08.550786 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:08.550873 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:08.550955 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:08.551082 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:18:08.551250 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:08.551293 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:08.551334 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:08.551442 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:08.551545 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:08.551789 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:08.551864 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:08.551971 29482 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1218 12:18:08.552081 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:08.552163 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:08.552306 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:08.552417 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:08.552681 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:08.552893 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:18:08.553117 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:08.553286 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:08.553830 29482 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1218 12:18:08.553939 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:08.553958 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:08.554035 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:08.554056 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:08.554098 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:08.554137 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:08.554174 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:08.554210 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:08.554244 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1218 12:18:08.554332 29482 api.go:53] PageSize not implemented I1218 12:18:08.554395 29482 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1218 12:18:08.554437 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:08.554486 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:08.554510 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:08.554579 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:08.554717 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:08.554703 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:08.554778 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:08.554767 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:08.554807 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:08.554872 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:08.554894 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:08.554961 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:08.555054 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:08.555099 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:08.560544 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:18:08.560662 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:08.560837 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:08.561034 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:08.561233 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:08.561838 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:18:08.562191 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:18:08.562434 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:18:08.562485 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:08.562524 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:08.562591 29482 dns.go:235] Pre-creating DNS records I1218 12:18:08.570639 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:18:08.574852 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:08.574950 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:08.575013 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:09.792392 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:09.992121 29482 iamrole.go:89] ListRoles: { } I1218 12:18:09.994312 29482 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1218 12:18:09.994651 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1218 12:18:09.994808 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1218 12:18:09.994969 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:09.995140 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:09.995175 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:09.995241 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:09.995285 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I1218 12:18:09.995439 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1218 12:18:09.995567 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:18:09.995625 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:09.995674 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:18:09.996017 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:09.996425 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } W1218 12:18:09.996498 29482 api.go:53] PageSize not implemented I1218 12:18:09.998012 29482 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1218 12:18:09.998132 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:09.998282 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:09.998238 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:18:09.998268 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:09.998356 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:09.998389 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:09.998407 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:18:09.998393 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:09.998455 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:18:09.998544 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:09.998586 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:09.998554 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:18:09.998735 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:09.998795 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:09.998941 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:09.998988 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:09.999110 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:18:09.999276 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:09.999326 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:09.999416 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:09.999501 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:18:09.999649 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:09.999726 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:09.999858 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I1218 12:18:09.999982 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:10.000103 29482 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1218 12:18:10.000199 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:10.000327 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:10.000507 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:10.000733 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:10.000906 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:10.001098 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:10.001234 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:18:10.001465 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:10.001681 29482 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1218 12:18:10.001773 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:10.001770 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:10.001843 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:10.001862 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:10.001905 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:10.001941 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:10.001982 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:10.002017 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:10.002050 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1218 12:18:10.002140 29482 api.go:53] PageSize not implemented I1218 12:18:10.002187 29482 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1218 12:18:10.002235 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:10.002281 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:10.002290 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:10.002386 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:10.002304 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:10.002421 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:10.002492 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:10.002515 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:10.002544 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:10.002656 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:10.002708 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:10.002732 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:10.002814 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:10.002853 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:10.008196 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:18:10.008400 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.008586 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.008659 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.008839 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.009653 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:18:10.009883 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:18:10.010139 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I1218 12:18:10.013108 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:10.016569 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.016664 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.016713 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.026519 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:18:10.030593 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.030682 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.030738 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:10.030789 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:11.326863 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:11.514153 29482 iamrole.go:89] ListRoles: { } I1218 12:18:11.516220 29482 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1218 12:18:11.516539 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1218 12:18:11.516722 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:11.516747 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } W1218 12:18:11.517013 29482 api.go:53] PageSize not implemented I1218 12:18:11.517507 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1218 12:18:11.518527 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:11.518810 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:11.518978 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:11.519413 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:18:11.519553 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:18:11.519662 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:11.519767 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:11.519798 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:11.519849 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:11.521089 29482 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1218 12:18:11.521308 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:11.521417 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:11.521342 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:18:11.521472 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:11.521482 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:11.521430 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:11.521528 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:11.521592 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:18:11.521655 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:11.521682 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:18:11.521592 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:18:11.521866 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:11.521928 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:11.522033 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:18:11.522182 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:11.522259 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:11.522348 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:11.522477 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:18:11.522621 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:11.522698 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:11.522912 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:11.523070 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:11.523128 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:11.523310 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:11.523357 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1218 12:18:11.523529 29482 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1218 12:18:11.523677 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:11.523819 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:11.524069 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:11.524217 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:11.524416 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:11.524541 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:18:11.524768 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:11.524925 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:11.525239 29482 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1218 12:18:11.525314 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:11.525365 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:11.525448 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:11.525468 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:11.525511 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:11.525549 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:11.525592 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:11.525629 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:11.525662 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1218 12:18:11.525757 29482 api.go:53] PageSize not implemented I1218 12:18:11.525813 29482 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1218 12:18:11.525910 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:11.526004 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:11.525904 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:11.526033 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:11.526124 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:11.526160 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:11.526202 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:11.526231 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:11.526334 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:11.526361 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:11.526448 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:11.526481 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:11.526560 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:11.526593 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:11.532062 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:18:11.532174 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:11.532373 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:11.532558 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:11.532771 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:11.533527 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:18:11.534000 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:18:11.534308 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:18:11.534366 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:11.534404 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:11.534474 29482 dns.go:235] Pre-creating DNS records I1218 12:18:11.542532 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1218 12:18:11.546728 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:11.546826 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:11.546894 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:11.546943 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:12.864020 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:13.064265 29482 iamrole.go:89] ListRoles: { } I1218 12:18:13.066007 29482 executor.go:111] Tasks: 0 done / 136 total; 52 can run W1218 12:18:13.066203 29482 api.go:53] PageSize not implemented I1218 12:18:13.066379 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.066562 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:13.066630 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1218 12:18:13.066803 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.066948 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:13.067014 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:13.067080 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1218 12:18:13.067185 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1218 12:18:13.067274 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1218 12:18:13.067621 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.067771 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.067896 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:13.068447 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1218 12:18:13.070690 29482 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1218 12:18:13.070825 29482 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:13.070935 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:13.070879 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.070967 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1218 12:18:13.071041 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:13.071073 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I1218 12:18:13.071054 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:13.071127 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1218 12:18:13.071174 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:13.071197 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:13.071155 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1218 12:18:13.071270 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1218 12:18:13.071474 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:13.071543 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:13.071588 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:13.071678 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:13.071765 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.071902 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.072047 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:13.072091 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1218 12:18:13.072266 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:13.072320 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.072437 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.072537 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:13.072621 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:13.072744 29482 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1218 12:18:13.072938 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:13.073037 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.073188 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1218 12:18:13.073501 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:13.073599 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:13.073897 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:13.074117 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:13.074228 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:13.074336 29482 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1218 12:18:13.074416 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:13.074482 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:13.074502 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:13.074478 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:13.074541 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:13.074640 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1218 12:18:13.074696 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I1218 12:18:13.074735 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I1218 12:18:13.074768 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1218 12:18:13.074867 29482 api.go:53] PageSize not implemented I1218 12:18:13.074924 29482 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1218 12:18:13.074976 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:13.075032 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:13.075054 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:13.075066 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:13.075172 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:13.075167 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:13.075250 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:13.075206 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:13.075281 29482 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1218 12:18:13.075281 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:13.075387 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:13.075440 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:13.075533 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1218 12:18:13.075561 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:13.083985 29482 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1218 12:18:13.084157 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:13.084319 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:13.084501 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:13.084601 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:13.085498 29482 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1218 12:18:13.085759 29482 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1218 12:18:13.086063 29482 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1218 12:18:13.086256 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:18:13.086324 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:18:13.086365 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:18:13.086399 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:18:13.086434 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:18:13.086468 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:18:13.086502 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:18:13.086540 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:18:13.086584 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:18:13.086626 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:18:13.086659 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:18:13.086693 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:18:13.086730 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:18:13.086763 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:18:13.086801 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:13.086841 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:13.086878 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:18:13.086914 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:18:13.086953 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:18:13.086986 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:18:13.087023 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1218 12:18:13.087092 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:18:13.087135 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:18:13.087169 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:13.087212 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:13.087253 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:18:13.087290 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:18:13.090079 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:18:13.090200 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:18:13.090225 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:18:13.090286 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.090413 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1218 12:18:13.090554 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.090650 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.090731 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.090827 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.090907 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.090961 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1218 12:18:13.091020 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.091092 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1218 12:18:13.091135 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W1218 12:18:13.091191 29482 api.go:53] PageSize not implemented I1218 12:18:13.091214 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:13.091239 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:13.091256 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1218 12:18:13.091298 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:18:13.091322 29482 targetgroups.go:35] PageSize not implemented I1218 12:18:13.091340 29482 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" ] } I1218 12:18:13.091409 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:18:13.091448 29482 iamrole.go:89] ListRoles: { } I1218 12:18:13.091491 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:13.091519 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:13.091567 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:18:13.091614 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:18:13.091658 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I1218 12:18:13.092215 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1218 12:18:13.092332 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1218 12:18:13.092355 29482 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I1218 12:18:13.092403 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4 ok I1218 12:18:13.092419 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok autoscaling-group:master-us-test-1a.masters.complex.example.com ok I1218 12:18:13.092525 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I1218 12:18:13.092532 29482 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I1218 12:18:13.092577 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } subnet:subnet-3 ok autoscaling-group:nodes.complex.example.com ok I1218 12:18:13.092699 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok I1218 12:18:13.092624 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1218 12:18:13.092733 29482 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5 ok I1218 12:18:13.092806 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:13.092940 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1218 12:18:13.093017 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:13.092801 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.complex.example.com ok I1218 12:18:13.093118 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1218 12:18:13.093508 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:13.093529 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1218 12:18:13.093569 29482 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1218 12:18:13.093640 29482 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-2 ok I1218 12:18:13.093685 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:13.093756 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 } ] } W1218 12:18:13.093959 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:13.093974 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1218 12:18:13.094056 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1218 12:18:13.094119 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1218 12:18:13.094128 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I1218 12:18:13.094217 29482 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I1218 12:18:13.094237 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1218 12:18:13.094280 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I1218 12:18:13.094329 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I1218 12:18:13.094426 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I1218 12:18:13.094443 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1218 12:18:13.094479 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I1218 12:18:13.094566 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1218 12:18:13.094653 29482 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1218 12:18:13.094737 29482 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (15.11s) === RUN TestLifecycleExternalLB I1218 12:18:13.095215 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:18:13.095357 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:18:13.095394 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:18:13.095435 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:18:13.095475 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:18:13.095523 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:18:13.095567 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:18:13.095599 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:18:13.095636 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:18:13.095663 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I1218 12:18:13.121376 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:13.124660 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:13.124756 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:14.403356 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:14.581272 29482 iamrole.go:89] ListRoles: { } I1218 12:18:14.582402 29482 executor.go:111] Tasks: 0 done / 107 total; 51 can run W1218 12:18:14.582598 29482 api.go:53] PageSize not implemented I1218 12:18:14.582694 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1218 12:18:14.582764 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:14.582855 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1218 12:18:14.582903 29482 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1218 12:18:14.582991 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:18:14.582927 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I1218 12:18:14.583075 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1218 12:18:14.583129 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1218 12:18:14.583151 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I1218 12:18:14.583319 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I1218 12:18:14.583419 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I1218 12:18:14.583563 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:14.583698 29482 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" }] }] } I1218 12:18:14.583783 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1218 12:18:14.583809 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1218 12:18:14.583831 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:18:14.583859 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:14.586197 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1218 12:18:14.586365 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1218 12:18:14.586729 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:14.587001 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I1218 12:18:14.587228 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } W1218 12:18:14.587700 29482 api.go:53] PageSize not implemented I1218 12:18:14.587558 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1218 12:18:14.587960 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:14.588212 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } W1218 12:18:14.588277 29482 api.go:53] PageSize not implemented I1218 12:18:14.588297 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:14.588519 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:14.588700 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I1218 12:18:14.590152 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] } I1218 12:18:14.590152 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:14.590334 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:14.591468 29482 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1218 12:18:14.591641 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1218 12:18:14.591644 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:14.591824 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:14.591886 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1218 12:18:14.591948 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1218 12:18:14.591994 29482 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1218 12:18:14.592078 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" } ] }], VpcId: "vpc-1" } I1218 12:18:14.592035 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1218 12:18:14.592220 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1218 12:18:14.592292 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:14.592349 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1218 12:18:14.592541 29482 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1218 12:18:14.592731 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:18:14.592836 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1218 12:18:14.593240 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:14.593474 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:18:14.593479 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:14.593676 29482 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1218 12:18:14.593777 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:18:14.593858 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:18:14.594011 29482 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1218 12:18:14.594060 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:18:14.594195 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:14.594297 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:18:14.594038 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1218 12:18:14.594371 29482 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1218 12:18:14.594524 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:14.594621 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:14.594694 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:14.594772 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:14.598558 29482 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1218 12:18:14.598703 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:14.598906 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" }] }] } I1218 12:18:14.599147 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1218 12:18:14.599344 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1218 12:18:14.599488 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:14.599598 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:14.599748 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1218 12:18:14.599920 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:14.600061 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:18:14.600128 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:18:14.600317 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" }] }] } I1218 12:18:14.600545 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" }] }] } I1218 12:18:14.600689 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:14.600843 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1218 12:18:14.600901 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1218 12:18:14.601050 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1218 12:18:14.601277 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1218 12:18:14.601462 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" }] }] } I1218 12:18:14.601596 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1218 12:18:14.601642 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1218 12:18:14.601777 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:14.601877 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:14.601979 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" }] }] } I1218 12:18:14.602180 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1218 12:18:14.602338 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1218 12:18:14.602543 29482 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1218 12:18:14.602815 29482 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1218 12:18:14.603065 29482 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1218 12:18:14.603121 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:14.603160 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:14.603231 29482 dns.go:235] Pre-creating DNS records I1218 12:18:14.603263 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:14.609528 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:14.612809 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:14.612902 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:16.017741 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:16.203751 29482 iamrole.go:89] ListRoles: { } I1218 12:18:16.205362 29482 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1218 12:18:16.205707 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W1218 12:18:16.205906 29482 api.go:53] PageSize not implemented I1218 12:18:16.205718 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1218 12:18:16.205960 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1218 12:18:16.206006 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I1218 12:18:16.206084 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1218 12:18:16.206253 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1218 12:18:16.206308 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } W1218 12:18:16.206394 29482 api.go:53] PageSize not implemented I1218 12:18:16.206433 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1218 12:18:16.206540 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1218 12:18:16.206585 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } W1218 12:18:16.206511 29482 api.go:53] PageSize not implemented I1218 12:18:16.206750 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:18:16.206909 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.207096 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:16.207127 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I1218 12:18:16.207265 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:16.207305 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:16.207357 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:16.207402 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.208703 29482 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1218 12:18:16.208869 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.209166 29482 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1218 12:18:16.209086 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:16.209303 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1218 12:18:16.209238 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1218 12:18:16.209425 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:16.209479 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.209611 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:16.209651 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:16.209737 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.209860 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1218 12:18:16.209988 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:16.214661 29482 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1218 12:18:16.214887 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:16.215058 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:16.215337 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:16.215437 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:16.215700 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:16.215850 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:16.215932 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:16.216553 29482 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1218 12:18:16.216820 29482 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1218 12:18:16.217094 29482 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1218 12:18:16.220127 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:18:16.220189 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:18:16.220229 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:18:16.220262 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:18:16.220295 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:18:16.220332 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:18:16.220364 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:18:16.220430 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:18:16.220464 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:18:16.220502 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:18:16.220544 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:18:16.220578 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:18:16.220610 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:18:16.220645 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:18:16.220676 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:16.220712 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:16.220748 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:18:16.220785 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:18:16.220817 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:18:16.220848 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:18:16.220880 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:16.220916 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:16.220951 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:18:16.220985 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:18:16.222277 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:18:16.222343 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:18:16.222366 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:18:16.222405 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.222456 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1218 12:18:16.222512 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.222571 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.222623 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.222681 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.222724 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.222763 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1218 12:18:16.222813 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.222867 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1218 12:18:16.222907 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W1218 12:18:16.222962 29482 api.go:53] PageSize not implemented I1218 12:18:16.222984 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:16.223010 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:16.223028 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:18:16.223051 29482 targetgroups.go:35] PageSize not implemented I1218 12:18:16.223068 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1218 12:18:16.223118 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:18:16.223159 29482 iamrole.go:89] ListRoles: { } I1218 12:18:16.223204 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:16.223233 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:16.223277 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:18:16.223321 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:18:16.223357 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:16.223814 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } autoscaling-group:nodes.externallb.example.com ok autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I1218 12:18:16.223892 29482 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1218 12:18:16.223882 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1218 12:18:16.223973 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I1218 12:18:16.223964 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1218 12:18:16.224018 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I1218 12:18:16.224052 29482 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } iam-instance-profile:nodes.externallb.example.com ok internet-gateway:igw-2 ok autoscaling-config:lt-1 ok I1218 12:18:16.223921 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.externallb.example.com. ok I1218 12:18:16.224117 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:16.224178 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1218 12:18:16.224318 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:16.224343 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I1218 12:18:16.224398 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1218 12:18:16.224460 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1218 12:18:16.224505 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:16.224550 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1218 12:18:16.224751 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:16.224765 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1218 12:18:16.224839 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I1218 12:18:16.224888 29482 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I1218 12:18:16.224905 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1218 12:18:16.224940 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I1218 12:18:16.224919 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1218 12:18:16.224971 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I1218 12:18:16.225015 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I1218 12:18:16.225028 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1218 12:18:16.225055 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I1218 12:18:16.225112 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1218 12:18:16.225187 29482 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1218 12:18:16.225259 29482 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (3.13s) === RUN TestLifecycleSharedSubnet I1218 12:18:16.225761 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:18:16.225900 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:18:16.225938 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:18:16.225979 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:18:16.226022 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:18:16.226074 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:18:16.226117 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:18:16.226147 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:18:16.226187 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:18:16.226214 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I1218 12:18:16.255494 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:16.259030 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:16.259125 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:17.539705 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:17.716986 29482 iamrole.go:89] ListRoles: { } I1218 12:18:17.717881 29482 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1218 12:18:17.719505 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:18:17.720004 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.720069 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I1218 12:18:17.720180 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] } I1218 12:18:17.721832 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:17.722345 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:17.722874 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:17.722925 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:17.723042 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I1218 12:18:17.723079 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:18:17.723532 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I1218 12:18:17.723644 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1218 12:18:17.724454 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1218 12:18:17.724514 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:17.724707 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:17.724851 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:17.726927 29482 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1218 12:18:17.727091 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1218 12:18:17.727168 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1218 12:18:17.727281 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1218 12:18:17.727331 29482 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1218 12:18:17.727307 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:18:17.727443 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1218 12:18:17.727559 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:17.727619 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:17.727667 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1218 12:18:17.727655 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1218 12:18:17.727826 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1218 12:18:17.727847 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1218 12:18:17.728137 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1218 12:18:17.728263 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:17.728342 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:17.728411 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:18:17.728474 29482 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] } I1218 12:18:17.729371 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1218 12:18:17.732985 29482 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1218 12:18:17.733210 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" }] }] } I1218 12:18:17.733467 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.733637 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" }] }] } I1218 12:18:17.733913 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:17.734024 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:17.734221 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" }] }] } I1218 12:18:17.734420 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.734662 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:17.734776 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:17.734992 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" }] }] } I1218 12:18:17.735172 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" }] }] } I1218 12:18:17.735360 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.735666 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.735924 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.736132 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.736296 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.736432 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.736573 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1218 12:18:17.736721 29482 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1218 12:18:17.736987 29482 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1218 12:18:17.737300 29482 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1218 12:18:17.737347 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:17.737382 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:17.737453 29482 dns.go:235] Pre-creating DNS records I1218 12:18:17.737481 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:17.743339 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:17.746528 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:17.746613 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:19.006218 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:19.192901 29482 iamrole.go:89] ListRoles: { } I1218 12:18:19.194203 29482 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1218 12:18:19.195284 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:19.195726 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.195975 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.196557 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:18:19.196785 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:18:19.196901 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1218 12:18:19.196953 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1218 12:18:19.199117 29482 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1218 12:18:19.199455 29482 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1218 12:18:19.199348 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1218 12:18:19.199550 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1218 12:18:19.199567 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1218 12:18:19.199782 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:19.199907 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1218 12:18:19.200176 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:19.200285 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:18:19.205095 29482 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1218 12:18:19.205363 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:19.205574 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:19.205914 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:19.206067 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:19.206750 29482 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1218 12:18:19.206971 29482 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1218 12:18:19.207225 29482 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1218 12:18:19.209839 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:18:19.209901 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:18:19.209940 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:18:19.209972 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:18:19.210006 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:18:19.210039 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:18:19.210076 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:18:19.210114 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:18:19.210153 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:18:19.210185 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:18:19.210214 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:18:19.210245 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:19.210277 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:19.210310 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:18:19.210348 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:18:19.210407 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:18:19.210447 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:19.210487 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:19.210524 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:18:19.211913 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:18:19.211977 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:18:19.211998 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:18:19.212035 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.212085 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1218 12:18:19.212141 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.212199 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.212243 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.212285 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.212330 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.212364 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1218 12:18:19.212404 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.212455 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1218 12:18:19.212492 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W1218 12:18:19.212542 29482 api.go:53] PageSize not implemented I1218 12:18:19.212564 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:19.212591 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:19.212610 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:18:19.212636 29482 targetgroups.go:35] PageSize not implemented I1218 12:18:19.212656 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1218 12:18:19.212712 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:18:19.212754 29482 iamrole.go:89] ListRoles: { } I1218 12:18:19.212799 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:19.212828 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:19.212873 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:18:19.212910 29482 routetable.go:53] DescribeRouteTables: { } autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I1218 12:18:19.213301 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1218 12:18:19.213323 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1218 12:18:19.213374 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1218 12:18:19.213400 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok I1218 12:18:19.213423 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.sharedsubnet.example.com ok I1218 12:18:19.213474 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } I1218 12:18:19.213541 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I1218 12:18:19.213619 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok W1218 12:18:19.213600 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:19.213665 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1218 12:18:19.213451 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.sharedsubnet.example.com. ok I1218 12:18:19.213704 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1218 12:18:19.213794 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:19.213841 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1218 12:18:19.214037 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:19.214051 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1218 12:18:19.214115 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I1218 12:18:19.214162 29482 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1218 12:18:19.214178 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1218 12:18:19.214225 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I1218 12:18:19.214257 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I1218 12:18:19.214297 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1218 12:18:19.214311 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1218 12:18:19.214341 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (2.99s) === RUN TestLifecyclePrivateSharedSubnet I1218 12:18:19.214771 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:18:19.214907 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:18:19.214948 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:18:19.214991 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:18:19.215031 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:18:19.215094 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:18:19.215136 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:18:19.215168 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:18:19.215206 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:18:19.215232 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I1218 12:18:19.247245 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:19.251255 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:19.251350 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:19.251408 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:20.477382 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:20.655894 29482 iamrole.go:89] ListRoles: { } I1218 12:18:20.657245 29482 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1218 12:18:20.657919 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:20.658083 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:20.658233 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:20.658590 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:20.659103 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:18:20.659223 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "private-shared-subnet.example.com" }] }] } I1218 12:18:20.660609 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I1218 12:18:20.660895 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1218 12:18:20.661156 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I1218 12:18:20.661216 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-subnet.example.com" }] } I1218 12:18:20.661342 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:18:20.661404 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1218 12:18:20.661427 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1218 12:18:20.663408 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:20.663908 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:20.664239 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I1218 12:18:20.664321 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:20.664394 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1218 12:18:20.667953 29482 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1218 12:18:20.668105 29482 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1218 12:18:20.668142 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1218 12:18:20.668236 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1218 12:18:20.668377 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1218 12:18:20.668385 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1218 12:18:20.668573 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1218 12:18:20.668578 29482 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1218 12:18:20.668682 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1218 12:18:20.668632 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1218 12:18:20.668702 29482 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1218 12:18:20.668755 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:20.668817 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:20.668778 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1218 12:18:20.668859 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:18:20.669005 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1218 12:18:20.668998 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1218 12:18:20.669140 29482 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1218 12:18:20.669236 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1218 12:18:20.669300 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1218 12:18:20.669421 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:18:20.669490 29482 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" }] } I1218 12:18:20.669570 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:18:20.669614 29482 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I1218 12:18:20.669690 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1218 12:18:20.669880 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I1218 12:18:20.669989 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I1218 12:18:20.670078 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:18:20.670145 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:20.670185 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1218 12:18:20.670297 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:20.670341 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:20.670495 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1218 12:18:20.670619 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1218 12:18:20.670672 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:18:20.671157 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1218 12:18:20.671630 29482 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1218 12:18:20.671840 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I1218 12:18:20.671925 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:20.672035 29482 loadbalancers.go:35] PageSize not implemented W1218 12:18:20.672168 29482 api.go:53] PageSize not implemented I1218 12:18:20.672085 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1218 12:18:20.672203 29482 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I1218 12:18:20.672334 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1218 12:18:20.672323 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:20.672424 29482 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } I1218 12:18:20.672441 29482 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1218 12:18:20.672596 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:20.672504 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1218 12:18:20.672666 29482 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1218 12:18:20.672779 29482 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1218 12:18:20.672722 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } W1218 12:18:20.672948 29482 api.go:53] PageSize not implemented I1218 12:18:20.673125 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:20.673254 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1218 12:18:20.673543 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1218 12:18:20.673754 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:18:20.673897 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I1218 12:18:20.674078 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1218 12:18:20.674621 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1218 12:18:20.674864 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" }] }] } I1218 12:18:20.675038 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I1218 12:18:20.675163 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1218 12:18:20.675329 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1218 12:18:20.675495 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:20.675629 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:20.675716 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1218 12:18:20.675881 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1218 12:18:20.676036 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1218 12:18:20.676190 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" }] }] } I1218 12:18:20.676350 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1218 12:18:20.676503 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1218 12:18:20.676656 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:18:20.676773 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1218 12:18:20.676940 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" }] }] } I1218 12:18:20.677118 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1218 12:18:20.677351 29482 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1218 12:18:20.677407 29482 api.go:53] PageSize not implemented I1218 12:18:20.677468 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:20.677548 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1218 12:18:20.677684 29482 api.go:53] PageSize not implemented I1218 12:18:20.677725 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:20.677746 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:20.677847 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:20.677971 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:20.684541 29482 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1218 12:18:20.684788 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:20.684926 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:20.685120 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:20.685240 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:20.685930 29482 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1218 12:18:20.686149 29482 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1218 12:18:20.686398 29482 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1218 12:18:20.686456 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:20.686492 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:20.686562 29482 dns.go:235] Pre-creating DNS records I1218 12:18:20.686587 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:20.693126 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:20.696672 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:20.696765 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:20.696832 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:21.999961 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:22.189276 29482 iamrole.go:89] ListRoles: { } I1218 12:18:22.191264 29482 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1218 12:18:22.191780 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.192027 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.192494 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:22.192816 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:18:22.192896 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1218 12:18:22.192929 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1218 12:18:22.192978 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:18:22.195002 29482 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1218 12:18:22.195173 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1218 12:18:22.195221 29482 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1218 12:18:22.195185 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:18:22.195268 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1218 12:18:22.195334 29482 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1218 12:18:22.195351 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I1218 12:18:22.195388 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1218 12:18:22.195378 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1218 12:18:22.195583 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1218 12:18:22.195754 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:22.195807 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1218 12:18:22.195945 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:22.195991 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1218 12:18:22.196127 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1218 12:18:22.196271 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:18:22.196349 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1218 12:18:22.196615 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:22.196955 29482 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1218 12:18:22.197369 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:22.197452 29482 loadbalancers.go:35] PageSize not implemented W1218 12:18:22.197454 29482 api.go:53] PageSize not implemented I1218 12:18:22.197475 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1218 12:18:22.197518 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1218 12:18:22.197489 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:22.197556 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I1218 12:18:22.197581 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:22.197600 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I1218 12:18:22.197624 29482 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1218 12:18:22.197648 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I1218 12:18:22.197472 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1218 12:18:22.197731 29482 api.go:53] PageSize not implemented I1218 12:18:22.197753 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:22.197753 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:22.197974 29482 executor.go:111] Tasks: 103 done / 123 total; 5 can run I1218 12:18:22.198076 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:22.198167 29482 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" W1218 12:18:22.198133 29482 api.go:53] PageSize not implemented I1218 12:18:22.198171 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:22.198254 29482 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I1218 12:18:22.198228 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W1218 12:18:22.198316 29482 api.go:53] PageSize not implemented I1218 12:18:22.198378 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:22.198509 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:22.198608 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:22.203870 29482 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1218 12:18:22.204036 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:22.204207 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:22.204358 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:22.204512 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:22.205266 29482 executor.go:111] Tasks: 115 done / 123 total; 2 can run W1218 12:18:22.205387 29482 api.go:53] PageSize not implemented I1218 12:18:22.205420 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:22.205654 29482 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1218 12:18:22.205991 29482 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1218 12:18:22.209245 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:18:22.209304 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:18:22.209340 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:18:22.209373 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:18:22.209406 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:18:22.209439 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:18:22.209475 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:18:22.209513 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:18:22.209555 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1218 12:18:22.209592 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:18:22.209622 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:18:22.209654 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:18:22.209685 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:22.209719 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:22.209753 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:18:22.209788 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1218 12:18:22.209822 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:18:22.209858 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:18:22.209893 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:18:22.209928 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:22.209963 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:22.209999 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:18:22.211551 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:18:22.211619 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:18:22.211638 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:18:22.211674 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.211734 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1218 12:18:22.211800 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.211862 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.211903 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.211944 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.211987 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.212022 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1218 12:18:22.212059 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.212101 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1218 12:18:22.212133 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W1218 12:18:22.212180 29482 api.go:53] PageSize not implemented I1218 12:18:22.212196 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1218 12:18:22.212238 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:22.212264 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:22.212279 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1218 12:18:22.212319 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:18:22.212343 29482 targetgroups.go:35] PageSize not implemented I1218 12:18:22.212360 29482 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I1218 12:18:22.212425 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:18:22.212465 29482 iamrole.go:89] ListRoles: { } I1218 12:18:22.212507 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:22.212533 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:22.212573 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:18:22.212618 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:18:22.213135 29482 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I1218 12:18:22.213173 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.private-shared-subnet.example.com ok I1218 12:18:22.213282 29482 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I1218 12:18:22.213256 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I1218 12:18:22.213323 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } W1218 12:18:22.213384 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:22.213404 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok I1218 12:18:22.213407 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I1218 12:18:22.213465 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1218 12:18:22.213552 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I1218 12:18:22.213289 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-subnet.example.com. ok I1218 12:18:22.213493 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1218 12:18:22.213596 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } autoscaling-group:bastion.private-shared-subnet.example.com ok I1218 12:18:22.213646 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok I1218 12:18:22.213566 29482 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok I1218 12:18:22.213648 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1218 12:18:22.213735 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:22.213805 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1218 12:18:22.214006 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:22.214029 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-3 ok I1218 12:18:22.214112 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:18:22.214206 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W1218 12:18:22.214356 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:22.214373 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1218 12:18:22.214433 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-1 ok I1218 12:18:22.214597 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I1218 12:18:22.214606 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:22.214654 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1218 12:18:22.214673 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1218 12:18:22.214706 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok I1218 12:18:22.214659 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W1218 12:18:22.214763 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:22.214777 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1218 12:18:22.214745 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I1218 12:18:22.214834 29482 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1218 12:18:22.214854 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1218 12:18:22.214886 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok I1218 12:18:22.214940 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I1218 12:18:22.214989 29482 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1218 12:18:22.215002 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1218 12:18:22.215029 29482 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (3.00s) === RUN TestLifecyclePrivateSharedIP I1218 12:18:22.215527 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:18:22.215675 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:18:22.215714 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:18:22.215758 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:18:22.215805 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:18:22.215855 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:18:22.215901 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:18:22.215932 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:18:22.215972 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:18:22.216002 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I1218 12:18:22.248560 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:22.252406 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:22.252492 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:22.252554 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:23.491306 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:23.668510 29482 iamrole.go:89] ListRoles: { } I1218 12:18:23.670961 29482 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1218 12:18:23.671509 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I1218 12:18:23.671655 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1218 12:18:23.671850 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I1218 12:18:23.671921 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1218 12:18:23.671952 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:18:23.672073 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I1218 12:18:23.672144 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1218 12:18:23.672349 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:23.672355 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.672979 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:23.673271 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:23.673606 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:23.673656 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:18:23.673757 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1218 12:18:23.673787 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1218 12:18:23.674092 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:23.675785 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:23.675956 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:23.677972 29482 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1218 12:18:23.678198 29482 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1218 12:18:23.678133 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:23.678259 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1218 12:18:23.678343 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1218 12:18:23.678389 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I1218 12:18:23.678328 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:23.678347 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1218 12:18:23.678500 29482 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1218 12:18:23.678517 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1218 12:18:23.678617 29482 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1218 12:18:23.678705 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1218 12:18:23.678737 29482 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1218 12:18:23.678739 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1218 12:18:23.678815 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1218 12:18:23.678672 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1218 12:18:23.678843 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:23.678897 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:23.678927 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1218 12:18:23.678956 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1218 12:18:23.679090 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1218 12:18:23.679193 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:18:23.679284 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:23.679279 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1218 12:18:23.679329 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:23.679530 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1218 12:18:23.679531 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1218 12:18:23.679755 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1218 12:18:23.679859 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:23.679971 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:18:23.680056 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1218 12:18:23.680174 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I1218 12:18:23.680290 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:18:23.680345 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I1218 12:18:23.680490 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1218 12:18:23.680543 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:18:23.680595 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:18:23.680655 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:23.680713 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:23.680759 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1218 12:18:23.680909 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:18:23.680882 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I1218 12:18:23.681001 29482 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] } I1218 12:18:23.681118 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:18:23.681179 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:23.681259 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:23.681307 29482 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" } ] } I1218 12:18:23.681362 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1218 12:18:23.681899 29482 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1218 12:18:23.682013 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1218 12:18:23.682110 29482 api.go:53] PageSize not implemented I1218 12:18:23.682187 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1218 12:18:23.682268 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:23.682306 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:23.682403 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:23.682365 29482 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-ip.example.com" }] } I1218 12:18:23.682246 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1218 12:18:23.682454 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:23.682491 29482 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1218 12:18:23.682507 29482 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-ip.example.com" }], Type: "network" } I1218 12:18:23.682551 29482 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1218 12:18:23.682576 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.682752 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.682972 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.683224 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.683397 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.683544 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I1218 12:18:23.683661 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1218 12:18:23.683854 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:23.683932 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:23.684001 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:23.684102 29482 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1218 12:18:23.684199 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:23.684235 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1218 12:18:23.684301 29482 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } W1218 12:18:23.684448 29482 api.go:53] PageSize not implemented I1218 12:18:23.684487 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:23.684412 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" }] }] } I1218 12:18:23.684595 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.684757 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.684889 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.685020 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.685173 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.685304 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1218 12:18:23.685413 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.685552 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.685685 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1218 12:18:23.685737 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I1218 12:18:23.685833 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1218 12:18:23.685968 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" }] }] } I1218 12:18:23.686101 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1218 12:18:23.686152 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1218 12:18:23.686197 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1218 12:18:23.686236 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:18:23.686376 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:18:23.686427 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:18:23.686537 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1218 12:18:23.686665 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.686793 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:18:23.686883 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:23.686975 29482 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I1218 12:18:23.687042 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:23.687208 29482 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1218 12:18:23.687322 29482 api.go:53] PageSize not implemented I1218 12:18:23.687293 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:23.687367 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:23.687399 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:23.687428 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:23.687468 29482 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:18:23.687531 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1218 12:18:23.687622 29482 api.go:53] PageSize not implemented I1218 12:18:23.687621 29482 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1218 12:18:23.687646 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:23.687736 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1218 12:18:23.687786 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:18:23.687699 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:23.687827 29482 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1218 12:18:23.693440 29482 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1218 12:18:23.693566 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:23.693767 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1218 12:18:23.693967 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:23.694138 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:23.694221 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:23.694379 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:23.695340 29482 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1218 12:18:23.695662 29482 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1218 12:18:23.695984 29482 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1218 12:18:23.696038 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:23.696091 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:23.696161 29482 dns.go:235] Pre-creating DNS records I1218 12:18:23.696188 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:23.702685 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:23.706110 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:23.706196 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:23.706254 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:24.989739 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:25.186562 29482 iamrole.go:89] ListRoles: { } I1218 12:18:25.188599 29482 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1218 12:18:25.189044 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:18:25.189225 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.189424 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:25.189987 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.190209 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1218 12:18:25.190292 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1218 12:18:25.190331 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1218 12:18:25.192865 29482 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1218 12:18:25.193028 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1218 12:18:25.193047 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1218 12:18:25.193228 29482 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1218 12:18:25.193210 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.193373 29482 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1218 12:18:25.193364 29482 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1218 12:18:25.193459 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1218 12:18:25.193396 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] }] } I1218 12:18:25.193508 29482 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1218 12:18:25.193588 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:25.193634 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.193786 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1218 12:18:25.193960 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:25.194013 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1218 12:18:25.194116 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.194237 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1218 12:18:25.194380 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:25.194439 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1218 12:18:25.194642 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:18:25.194709 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1218 12:18:25.194753 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:25.194866 29482 executor.go:111] Tasks: 74 done / 132 total; 36 can run W1218 12:18:25.195031 29482 api.go:53] PageSize not implemented I1218 12:18:25.195050 29482 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1218 12:18:25.195067 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:25.195159 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:25.195155 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:18:25.195197 29482 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1218 12:18:25.195140 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:25.195248 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:25.195281 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1218 12:18:25.195344 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1218 12:18:25.195400 29482 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I1218 12:18:25.195372 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:25.195454 29482 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1218 12:18:25.195508 29482 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } W1218 12:18:25.195586 29482 api.go:53] PageSize not implemented I1218 12:18:25.195605 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:25.195600 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:25.195803 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:25.195912 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:25.195978 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:25.196111 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:25.196233 29482 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1218 12:18:25.196315 29482 api.go:53] PageSize not implemented I1218 12:18:25.196304 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:25.196380 29482 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I1218 12:18:25.196366 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:25.196428 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1218 12:18:25.196365 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:25.196529 29482 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I1218 12:18:25.196546 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1218 12:18:25.196561 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W1218 12:18:25.196606 29482 api.go:53] PageSize not implemented I1218 12:18:25.196653 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:25.196746 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:25.202075 29482 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1218 12:18:25.202279 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:25.202449 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:25.202576 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1218 12:18:25.202713 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:25.202867 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:25.203351 29482 executor.go:111] Tasks: 124 done / 132 total; 2 can run W1218 12:18:25.203475 29482 api.go:53] PageSize not implemented I1218 12:18:25.203504 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:25.203696 29482 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1218 12:18:25.203949 29482 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1218 12:18:25.207169 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:18:25.207232 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:18:25.207267 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:18:25.207302 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:18:25.207336 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:18:25.207371 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:18:25.207407 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:18:25.207446 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:18:25.207489 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1218 12:18:25.207528 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1218 12:18:25.207561 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:18:25.207592 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:18:25.207622 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:18:25.207658 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:18:25.207690 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1218 12:18:25.207725 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:25.207760 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:25.207793 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1218 12:18:25.207828 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1218 12:18:25.207860 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:18:25.207896 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:18:25.207929 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1218 12:18:25.207967 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:18:25.208001 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:18:25.208035 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:25.208075 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:25.208113 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:18:25.209555 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:18:25.209631 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:18:25.209655 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:18:25.209698 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.209756 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1218 12:18:25.209825 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.209891 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.209935 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.209980 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.210024 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.210068 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1218 12:18:25.210125 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.210181 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:18:25.210214 29482 natgateway.go:117] DescribeNatGateways: { } I1218 12:18:25.210256 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1218 12:18:25.210293 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W1218 12:18:25.210341 29482 api.go:53] PageSize not implemented I1218 12:18:25.210359 29482 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1218 12:18:25.210427 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:25.210459 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:25.210475 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1218 12:18:25.210515 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:18:25.210539 29482 targetgroups.go:35] PageSize not implemented I1218 12:18:25.210559 29482 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" ] } I1218 12:18:25.210624 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:18:25.210666 29482 iamrole.go:89] ListRoles: { } I1218 12:18:25.210715 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:25.210745 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:25.210797 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:18:25.210843 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:18:25.210878 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I1218 12:18:25.210916 29482 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1218 12:18:25.210952 29482 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1218 12:18:25.211525 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok I1218 12:18:25.211576 29482 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok I1218 12:18:25.211639 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } autoscaling-group:bastion.private-shared-ip.example.com ok I1218 12:18:25.211695 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I1218 12:18:25.211631 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.private-shared-ip.example.com ok I1218 12:18:25.211735 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1218 12:18:25.211741 29482 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I1218 12:18:25.211781 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I1218 12:18:25.211841 29482 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } iam-instance-profile:bastions.private-shared-ip.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I1218 12:18:25.211752 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok W1218 12:18:25.211920 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:25.211938 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1218 12:18:25.211732 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.private-shared-ip.example.com ok I1218 12:18:25.211944 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1218 12:18:25.211995 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I1218 12:18:25.211984 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1218 12:18:25.212045 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I1218 12:18:25.212104 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1218 12:18:25.212152 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1218 12:18:25.212342 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:25.212363 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1218 12:18:25.212404 29482 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok autoscaling-config:lt-3 ok I1218 12:18:25.212470 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1218 12:18:25.212515 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1218 12:18:25.212629 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:25.212644 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1218 12:18:25.212736 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I1218 12:18:25.212801 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1218 12:18:25.212805 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I1218 12:18:25.212849 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:25.212903 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1218 12:18:25.212932 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1218 12:18:25.213017 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1218 12:18:25.213067 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok W1218 12:18:25.213043 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:25.213130 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1218 12:18:25.213141 29482 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1218 12:18:25.213184 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1218 12:18:25.213178 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1218 12:18:25.213217 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I1218 12:18:25.213278 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I1218 12:18:25.213334 29482 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1218 12:18:25.213352 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1218 12:18:25.213390 29482 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I1218 12:18:25.213468 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1218 12:18:25.213533 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (3.00s) === RUN TestLifecycleManyAddons I1218 12:18:25.214024 29482 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:18:25.214156 29482 internetgateways.go:66] CreateInternetGateway: { } I1218 12:18:25.214192 29482 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:18:25.214229 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:18:25.214268 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:18:25.214316 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:18:25.214354 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:18:25.214382 29482 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:18:25.214417 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:18:25.214442 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1218 12:18:25.247199 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:25.250713 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:25.250809 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:26.494781 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:27.321494 29482 iamrole.go:89] ListRoles: { } I1218 12:18:27.322471 29482 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1218 12:18:27.322622 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:27.322777 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:27.322977 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:27.323128 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:27.325000 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:27.325522 29482 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.326086 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:18:27.326339 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1218 12:18:27.326370 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:18:27.326455 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1218 12:18:27.326560 29482 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.327002 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:27.328494 29482 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:18:27.328623 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1218 12:18:27.328684 29482 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1218 12:18:27.328720 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:18:27.328795 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:27.328990 29482 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1218 12:18:27.329797 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:27.329915 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:27.329939 29482 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1218 12:18:27.330042 29482 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1218 12:18:27.331926 29482 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1218 12:18:27.332080 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:27.332191 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I1218 12:18:27.332338 29482 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1218 12:18:27.332403 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1218 12:18:27.332312 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1218 12:18:27.332401 29482 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1218 12:18:27.332521 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1218 12:18:27.332524 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:27.332731 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1218 12:18:27.332699 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1218 12:18:27.332814 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:27.332828 29482 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1218 12:18:27.332896 29482 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1218 12:18:27.332970 29482 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1218 12:18:27.333036 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:27.333216 29482 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:18:27.333305 29482 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1218 12:18:27.333343 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1218 12:18:27.333467 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:18:27.333518 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:27.333563 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:18:27.333661 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:18:27.333708 29482 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] } I1218 12:18:27.333819 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:27.333919 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:27.333995 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:18:27.334085 29482 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1218 12:18:27.334176 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:27.334229 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:27.335004 29482 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1218 12:18:27.338322 29482 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1218 12:18:27.338458 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:27.338637 29482 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:18:27.338701 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:27.338802 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:27.338959 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:18:27.339222 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.339450 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.339699 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.339877 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:27.339955 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:27.340025 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:18:27.340159 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:27.340258 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" }] }] } I1218 12:18:27.340469 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:18:27.340642 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" }] }] } I1218 12:18:27.340779 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.340909 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.341039 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:18:27.341173 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.341305 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1218 12:18:27.341351 29482 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1218 12:18:27.341390 29482 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1218 12:18:27.341438 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.341572 29482 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1218 12:18:27.341714 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:27.341867 29482 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1218 12:18:27.342152 29482 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1218 12:18:27.342446 29482 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1218 12:18:27.342745 29482 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1218 12:18:27.342803 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:27.342841 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:27.342912 29482 dns.go:235] Pre-creating DNS records I1218 12:18:27.342945 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:27.349188 29482 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1218 12:18:27.352720 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:27.352807 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:28.606718 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:29.416851 29482 iamrole.go:89] ListRoles: { } I1218 12:18:29.418436 29482 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1218 12:18:29.418873 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.419482 29482 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1218 12:18:29.420250 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.420439 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:18:29.420491 29482 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:18:29.420545 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:29.420569 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.420689 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.421244 29482 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1218 12:18:29.422611 29482 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1218 12:18:29.422753 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1218 12:18:29.422930 29482 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1218 12:18:29.422900 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.423104 29482 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1218 12:18:29.423141 29482 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:18:29.423231 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1218 12:18:29.423444 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1218 12:18:29.423523 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:29.423625 29482 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:18:29.423704 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1218 12:18:29.423905 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:29.423962 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.428983 29482 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1218 12:18:29.429138 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:29.429302 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:29.429552 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:29.429700 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:29.429766 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:29.430045 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:29.430185 29482 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1218 12:18:29.430931 29482 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1218 12:18:29.431175 29482 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1218 12:18:29.431420 29482 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1218 12:18:29.434374 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1218 12:18:29.434437 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1218 12:18:29.434478 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1218 12:18:29.434511 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1218 12:18:29.434546 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1218 12:18:29.434578 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1218 12:18:29.434611 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1218 12:18:29.434646 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1218 12:18:29.434681 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1218 12:18:29.434719 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1218 12:18:29.434757 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1218 12:18:29.434790 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1218 12:18:29.434820 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1218 12:18:29.434855 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1218 12:18:29.434887 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:18:29.434923 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1218 12:18:29.434958 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:18:29.434994 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1218 12:18:29.435026 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1218 12:18:29.435059 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1218 12:18:29.435091 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1218 12:18:29.435127 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1218 12:18:29.435162 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:18:29.435197 29482 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1218 12:18:29.436874 29482 delete_cluster.go:128] Looking for cloud resources to delete W1218 12:18:29.436942 29482 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1218 12:18:29.436967 29482 keypairs.go:95] DescribeKeyPairs: { } I1218 12:18:29.437006 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.437074 29482 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1218 12:18:29.437136 29482 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.437198 29482 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.437246 29482 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.437304 29482 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.437348 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.437387 29482 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1218 12:18:29.437435 29482 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.437486 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1218 12:18:29.437525 29482 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1218 12:18:29.437572 29482 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1218 12:18:29.437613 29482 api.go:53] PageSize not implemented I1218 12:18:29.437635 29482 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1218 12:18:29.437662 29482 loadbalancers.go:35] PageSize not implemented I1218 12:18:29.437681 29482 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1218 12:18:29.437705 29482 targetgroups.go:35] PageSize not implemented I1218 12:18:29.437724 29482 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1218 12:18:29.437778 29482 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1218 12:18:29.437813 29482 iamrole.go:89] ListRoles: { } I1218 12:18:29.437855 29482 zones.go:93] ListHostedZonesPages { } I1218 12:18:29.437883 29482 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1218 12:18:29.437924 29482 internetgateways.go:101] DescribeInternetGateways: { } I1218 12:18:29.437968 29482 routetable.go:53] DescribeRouteTables: { } I1218 12:18:29.438004 29482 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1218 12:18:29.438420 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok autoscaling-group:nodes.minimal.example.com ok I1218 12:18:29.438496 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1218 12:18:29.438480 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1218 12:18:29.438607 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:29.438626 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1218 12:18:29.438602 29482 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1218 12:18:29.438683 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I1218 12:18:29.438672 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok I1218 12:18:29.438730 29482 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1218 12:18:29.438781 29482 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } iam-instance-profile:nodes.minimal.example.com ok I1218 12:18:29.438832 29482 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } keypair:key-1 ok I1218 12:18:29.438894 29482 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1218 12:18:29.438671 29482 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-2 ok route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok I1218 12:18:29.438971 29482 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1218 12:18:29.439078 29482 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1218 12:18:29.439152 29482 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W1218 12:18:29.439400 29482 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1218 12:18:29.439423 29482 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1218 12:18:29.439533 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1218 12:18:29.439598 29482 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1218 12:18:29.439591 29482 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I1218 12:18:29.439624 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } subnet:subnet-1 ok I1218 12:18:29.439681 29482 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1218 12:18:29.439737 29482 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1218 12:18:29.439798 29482 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1218 12:18:29.439821 29482 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1218 12:18:29.439868 29482 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I1218 12:18:29.439963 29482 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1218 12:18:29.440069 29482 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1218 12:18:29.440174 29482 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (4.23s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 214.335s === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.004s === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I1218 12:14:55.813169 29724 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.005s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I1218 12:14:55.841808 29726 pod.go:59] starting pod controller I1218 12:14:55.842111 29726 stoppable.go:62] shutting down controller I1218 12:14:55.842180 29726 pod.go:107] Got stop signal --- PASS: TestPodController (0.00s) I1218 12:14:55.842224 29726 pod.go:65] shutting down pod controller PASS ok k8s.io/kops/dns-controller/pkg/watchers 0.034s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037370} route53_test.go:93: Got zone list: [0xc0000373a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc0000960c8} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000374d0} route53_test.go:93: Got zone list: [0xc000037500] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc0000960e0} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000037600} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003d85d0 0xc000096100} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000377c0} route53_test.go:93: Got zone list: [0xc0000377f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096120} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037950} route53_test.go:93: Got zone list: [0xc000037980] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096148} route53_test.go:187: Successfully added resource record set: {0xc000188700 0xc000096168} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037c60} route53_test.go:93: Got zone list: [0xc000037c90] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc0000961f8} route53_test.go:199: Successfully added resource record set: {0xc000188880 0xc000096218} route53_test.go:118: Got 1 recordsets: [0xc000037e30] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037fc0} route53_test.go:93: Got zone list: [0xc000037ff0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc0000962b8} route53_test.go:221: Successfully added resource record set: {0xc000188a00 0xc0000962d8} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000188a00 0xc0000962d8}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e63b0} route53_test.go:93: Got zone list: [0xc0003e63e0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096398} route53_test.go:246: Successfully removed resource set {0xc000188c00 0xc0000963b8} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e66c0} route53_test.go:93: Got zone list: [0xc0003e66f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096448} route53_test.go:264: Successfully removed resource set {0xc000188d80 0xc000096468} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e6a00} route53_test.go:93: Got zone list: [0xc0003e6a30] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096500} commontests.go:192: Successfully added resource record set: {0xc000188f00 0xc000096520} commontests.go:45: Correctly replaced resource record {0xc000188f00 0xc000096520} -> {0xc000189000 0xc000096570} commontests.go:142: Got 1 recordsets: [0xc0003e6d40] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e6f70} route53_test.go:93: Got zone list: [0xc0003e6fa0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096628} commontests.go:192: Successfully added resource record set: {0xc000189280 0xc000096648} commontests.go:70: Correctly replaced resource record {0xc000189280 0xc000096648} -> {0xc000189380 0xc000096698} commontests.go:142: Got 1 recordsets: [0xc0003e72b0] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e7530} route53_test.go:93: Got zone list: [0xc0003e7560] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096760} commontests.go:192: Successfully added resource record set: {0xc000189600 0xc000096780} commontests.go:142: Got 2 recordsets: [0xc0003e77d0 0xc0003e77f0] commontests.go:142: Got 2 recordsets: [0xc0003e7860 0xc0003e7880] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0003e7a80} route53_test.go:93: Got zone list: [0xc0003e7ab0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d8390 0xc000096888} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.015s === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.006s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678260} clouddns_test.go:71: Got zone list: [0xc0006705a0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc000670570} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678360} clouddns_test.go:71: Got zone list: [0xc000670660] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc000670630} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678460} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc000475500 0xc000670720} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678520} clouddns_test.go:71: Got zone list: [0xc0006707e0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc0006707b0} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678640} clouddns_test.go:71: Got zone list: [0xc000670918] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc0006708e8} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678780} clouddns_test.go:71: Got zone list: [0xc000670a80] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc000670a50} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc0006788e0} clouddns_test.go:71: Got zone list: [0xc000670c90] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc000670c60} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678a40} clouddns_test.go:71: Got zone list: [0xc000670e28] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc000670df8} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678b80} clouddns_test.go:71: Got zone list: [0xc000670f90] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc000670f60} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678ce0} clouddns_test.go:71: Got zone list: [0xc000671158] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc000671128} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678e40} clouddns_test.go:71: Got zone list: [0xc000671428] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc0006713f8} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc000678fc0} clouddns_test.go:71: Got zone list: [0xc000671758] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc000671728} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0000b20c8 0xc0006791a0} clouddns_test.go:71: Got zone list: [0xc000671b30] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0004752c0 0xc000671b00} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.063s === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.027s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.007s === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.073s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I1218 12:15:03.452006 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.452145 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.452179 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.452209 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.452237 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.452277 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.452319 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.452333 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.452366 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.452391 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.460936 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I1218 12:15:03.464747 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.464910 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.464946 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.464990 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.465040 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.465085 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.465129 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.465157 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.465195 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.465220 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.467094 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.01s) === RUN TestContainerdBuilder_Simple I1218 12:15:03.471615 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.471720 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.471755 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.471799 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.471831 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.471879 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.471915 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.471945 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.471985 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.472010 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.473223 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:03.484383 30349 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I1218 12:15:03.484429 30349 assetstore.go:111] bin/containerd I1218 12:15:03.484448 30349 assetstore.go:111] bin/containerd-shim I1218 12:15:03.484462 30349 assetstore.go:111] bin/containerd-shim-runc-v1 I1218 12:15:03.484475 30349 assetstore.go:111] bin/containerd-shim-runc-v2 I1218 12:15:03.484487 30349 assetstore.go:111] bin/containerd-stress I1218 12:15:03.484505 30349 assetstore.go:111] bin/ctr I1218 12:15:03.484574 30349 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I1218 12:15:03.484599 30349 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.02s) === RUN TestContainerdBuilder_Flatcar I1218 12:15:03.490090 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.490265 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.490345 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.490441 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.490489 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.490544 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.490595 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.490631 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.490686 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.490719 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.492600 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:03.495222 30349 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.01s) === RUN TestContainerdBuilder_SkipInstall I1218 12:15:03.497050 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.497239 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.497342 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.497396 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.497439 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.497489 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.497596 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.497633 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.497676 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.497708 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.499440 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:03.502181 30349 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.01s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I1218 12:15:03.503779 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.503899 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.503936 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.503977 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.504055 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.504108 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.504184 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.504216 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.504256 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.504289 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.506096 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:03.510458 30349 assetstore.go:108] Matching assets for "^docker/": I1218 12:15:03.510574 30349 assetstore.go:111] docker/containerd I1218 12:15:03.510647 30349 assetstore.go:111] docker/containerd-shim I1218 12:15:03.510713 30349 assetstore.go:111] docker/ctr I1218 12:15:03.510792 30349 assetstore.go:111] docker/docker I1218 12:15:03.510834 30349 assetstore.go:111] docker/docker-init I1218 12:15:03.510919 30349 assetstore.go:111] docker/docker-proxy I1218 12:15:03.510962 30349 assetstore.go:111] docker/dockerd I1218 12:15:03.510979 30349 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.01s) === RUN TestDockerBuilder_LogFlags I1218 12:15:03.517592 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.517793 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.517855 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.517945 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.518030 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.518121 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.518260 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.518302 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.518366 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.518417 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.520860 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:03.525059 30349 assetstore.go:108] Matching assets for "^docker/": I1218 12:15:03.525108 30349 assetstore.go:111] docker/containerd I1218 12:15:03.525138 30349 assetstore.go:111] docker/containerd-shim I1218 12:15:03.525150 30349 assetstore.go:111] docker/ctr I1218 12:15:03.525163 30349 assetstore.go:111] docker/docker I1218 12:15:03.525175 30349 assetstore.go:111] docker/docker-init I1218 12:15:03.525186 30349 assetstore.go:111] docker/docker-proxy I1218 12:15:03.525203 30349 assetstore.go:111] docker/dockerd I1218 12:15:03.525219 30349 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.01s) === RUN TestDockerBuilder_SkipInstall I1218 12:15:03.531005 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.531162 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.531207 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.531253 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.531300 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.531350 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.531435 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.531465 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.531503 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.531530 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.533205 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:03.536059 30349 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.01s) === RUN TestDockerBuilder_HealthCheck I1218 12:15:03.536338 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.536461 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.536501 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.536545 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.536588 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.536639 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.536723 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.536756 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.536794 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.536824 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.540749 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:03.544977 30349 assetstore.go:108] Matching assets for "^docker/": I1218 12:15:03.545025 30349 assetstore.go:111] docker/docker I1218 12:15:03.545047 30349 assetstore.go:111] docker/docker-containerd I1218 12:15:03.545067 30349 assetstore.go:111] docker/docker-containerd-ctr I1218 12:15:03.545086 30349 assetstore.go:111] docker/docker-containerd-shim I1218 12:15:03.545105 30349 assetstore.go:111] docker/docker-init I1218 12:15:03.545124 30349 assetstore.go:111] docker/docker-proxy I1218 12:15:03.545146 30349 assetstore.go:111] docker/docker-runc I1218 12:15:03.545165 30349 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.02s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I1218 12:15:03.553119 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.553259 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.553300 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.553357 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.553396 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.553446 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.553491 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.553522 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.553565 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.553594 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.557483 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.01s) === RUN TestDockerHooksBuilder I1218 12:15:03.561507 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.561718 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.561796 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.561877 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.561953 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.562038 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.562117 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.562200 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.562252 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.562284 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.565511 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I1218 12:15:03.569596 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.569733 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.569774 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.569821 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.569862 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.569913 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.569958 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.569995 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.570036 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.570066 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.573198 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.01s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I1218 12:15:03.584076 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.584225 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.584270 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.584320 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.584360 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.584419 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.584464 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.584495 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.584537 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.584572 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.587605 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.02s) === RUN TestAuditConfigAPIServerBuilder I1218 12:15:03.605737 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.605858 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.605932 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.605979 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.606016 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.606098 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.606139 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.606167 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.606202 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.606225 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.609521 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I1218 12:15:03.620806 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.620933 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.620974 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.621021 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.621057 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.621107 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.621147 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.621177 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.621213 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.621239 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.624521 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I1218 12:15:03.635702 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.635791 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.635820 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.635848 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.635871 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.635903 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.635927 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.635942 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.635968 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.635985 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.638362 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.02s) === RUN TestWithoutEtcdEventsAPIServerBuilder I1218 12:15:03.651542 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.651643 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.651672 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.651705 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.651730 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.651761 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.651786 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.651802 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.651826 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.651843 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.653791 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I1218 12:15:03.661942 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.662065 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.662101 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.662142 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.662180 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.662227 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.662266 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.662297 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.662392 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.662422 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.665133 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I1218 12:15:03.673880 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:03.673974 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:03.674001 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:03.674030 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:03.674057 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:03.674102 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:03.674130 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:03.674148 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:03.674171 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:03.674188 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:03.676142 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.89s) === RUN TestKubeAPIServerBuilderARM64 I1218 12:15:05.561224 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:05.561321 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:05.561351 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:05.561386 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:05.561412 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:05.561446 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:05.561476 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:05.561491 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:05.561513 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:05.561531 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:05.563422 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.15s) === RUN TestKubeControllerManagerBuilder I1218 12:15:06.711850 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:06.711947 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:06.711976 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:06.712008 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:06.712036 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:06.712072 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:06.712099 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:06.712117 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:06.712139 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:06.712157 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:06.714003 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I1218 12:15:06.720520 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:06.720610 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:06.720636 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:06.720663 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:06.720686 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:06.720728 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:06.720772 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:06.720794 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:06.720816 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:06.720833 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:06.722620 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.16s) === RUN TestKubeControllerManagerBuilderARM64 I1218 12:15:07.883225 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:07.883422 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:07.883510 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:07.883606 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:07.883693 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:07.883808 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:07.883897 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:07.883973 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:07.884057 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:07.884130 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:07.893943 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.16s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I1218 12:15:09.043068 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:09.043159 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:09.043184 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:09.043219 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:09.043244 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:09.043277 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:09.043303 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:09.043320 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:09.043344 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:09.043360 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:09.045165 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I1218 12:15:09.049081 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:09.049171 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:09.049195 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:09.049223 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:09.049251 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:09.049284 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:09.049310 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:09.049329 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:09.049351 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:09.049366 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:09.051165 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.15s) === RUN TestKubeProxyBuilderARM64 I1218 12:15:10.198687 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:10.198810 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:10.198849 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:10.198900 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:10.198943 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:10.198992 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:10.199022 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:10.199039 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:10.199062 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:10.199078 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:10.201656 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.17s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I1218 12:15:11.373282 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:11.373368 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:11.373393 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:11.373422 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:11.373444 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:11.373475 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:11.373504 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:11.373523 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:11.373546 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:11.373564 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:11.375534 30349 zones.go:93] ListHostedZonesPages { } W1218 12:15:11.379657 30349 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I1218 12:15:11.386238 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:11.386361 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:11.386400 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:11.386445 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:11.386472 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:11.386513 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:11.386554 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:11.386585 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:11.386619 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:11.386637 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:11.388460 30349 zones.go:93] ListHostedZonesPages { } W1218 12:15:12.547620 30349 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.16s) === RUN TestKubeSchedulerBuilderARM64 I1218 12:15:12.549993 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:12.550101 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:12.550136 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:12.550175 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:12.550209 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:12.550253 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:12.550287 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:12.550315 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:12.550347 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:12.550370 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:12.552778 30349 zones.go:93] ListHostedZonesPages { } W1218 12:15:13.697710 30349 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.15s) === RUN TestKubectlBuilder I1218 12:15:13.699496 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:13.699583 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:13.699611 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:13.699642 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:13.699666 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:13.699697 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:13.699724 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:13.699740 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:13.699762 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:13.699779 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:13.701456 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:13.703194 30349 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.00s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I1218 12:15:13.705015 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:13.705077 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:13.705112 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:13.705136 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:13.705159 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:13.705186 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:13.705209 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:13.705226 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:13.705246 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:13.705262 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:13.706576 30349 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.00s) === RUN Test_RunKubeletBuilderWarmPool I1218 12:15:13.710038 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:13.710097 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:13.710130 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:13.710153 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:13.710177 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:13.710203 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:13.710225 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:13.710243 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:13.710263 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:13.710279 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:13.711447 30349 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.00s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I1218 12:15:13.716169 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:13.716266 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:13.716293 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:13.716321 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:13.716345 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:13.716376 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:13.716401 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:13.716417 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:13.716437 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:13.716452 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:13.718182 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:13.719870 30349 assetstore.go:108] Matching assets for "protokube$": I1218 12:15:13.719888 30349 assetstore.go:111] /opt/kops/bin/protokube I1218 12:15:13.719898 30349 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I1218 12:15:13.719918 30349 assetstore.go:108] Matching assets for "channels$": I1218 12:15:13.719927 30349 assetstore.go:111] /opt/kops/bin/channels I1218 12:15:13.719934 30349 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I1218 12:15:13.721248 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:13.721313 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:13.721334 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:13.721356 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:13.721377 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:13.721403 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:13.721428 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:13.721443 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:13.721462 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:13.721477 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:13.723003 30349 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.00s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I1218 12:15:13.725159 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:13.725224 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:13.725243 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:13.725263 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:13.725283 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:13.725316 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:13.725337 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:13.725353 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:13.725371 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:13.725386 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:13.726867 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:13.728528 30349 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.00s) === RUN TestUpdateServiceBuilderExternal I1218 12:15:13.728876 30349 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:13.728943 30349 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:13.728963 30349 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:13.728983 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:13.729006 30349 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:13.729032 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:13.729054 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:13.729070 30349 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:13.729089 30349 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:13.729103 30349 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:13.730650 30349 zones.go:93] ListHostedZonesPages { } I1218 12:15:13.732263 30349 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 10.389s === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.02s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.02s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.052s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.036s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.028s === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E1218 12:15:03.362726 30354 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E1218 12:15:03.362850 30354 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.015s === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I1218 12:15:03.423868 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.423981 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424032 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424070 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424108 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I1218 12:15:03.424359 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424402 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424441 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424473 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424507 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424535 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424573 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424603 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424636 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424667 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424699 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.424971 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.426884 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.426966 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.427094 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.427205 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.427260 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.427321 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1218 12:15:03.427372 30355 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I1218 12:15:03.427743 30355 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I1218 12:15:03.427873 30355 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.100s === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.01s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.015s === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W1218 12:15:03.387004 30358 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W1218 12:15:03.388366 30358 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W1218 12:15:03.389378 30358 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W1218 12:15:03.390313 30358 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W1218 12:15:03.391713 30358 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W1218 12:15:03.392805 30358 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host W1218 12:15:03.393823 30358 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E1218 12:15:03.394739 30358 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E1218 12:15:03.394758 30358 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E1218 12:15:03.394771 30358 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E1218 12:15:03.394783 30358 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.050s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.004s === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.061s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.022s === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.01s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.01s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.128s === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.114s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.025s === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.005s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.004s === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.043s === RUN TestFlagToFalse I1218 12:15:10.800152 31761 featureflag_test.go:32] Created flag Unittest1 I1218 12:15:10.800214 31761 featureflag.go:164] FeatureFlag "UnitTest1"=false I1218 12:15:10.800225 31761 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I1218 12:15:10.800300 31761 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.034s === RUN TestRenderInstanceGroupZones W1218 12:15:10.823778 31763 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.029s === RUN TestWarmPoolOnlyRoll I1218 12:15:22.918614 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.918687 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.918707 32303 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I1218 12:15:22.919171 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:22.919196 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:22.920370 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.920419 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:22.925637 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.925691 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.925713 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.925730 32303 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1218 12:15:22.928308 32303 instancegroups.go:431] Draining the node: "master-1a.local". I1218 12:15:22.929135 32303 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1218 12:15:22.929259 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:22.929295 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:22.930487 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.930552 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:22.935775 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.935837 32303 instancegroups.go:431] Draining the node: "master-1b.local". I1218 12:15:22.936752 32303 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1218 12:15:22.936826 32303 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1218 12:15:22.936860 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:22.938034 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.938081 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:22.943298 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.943340 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.943361 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.943377 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:22.944447 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:22.945225 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:22.945262 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:22.946443 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.946495 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:22.951744 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.951796 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:22.952453 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:22.952489 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:22.953818 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.953843 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:22.959055 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.959136 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:22.960152 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:22.960189 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:22.961337 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.961360 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:22.966593 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.966625 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.966658 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.966676 32303 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1218 12:15:22.967810 32303 instancegroups.go:431] Draining the node: "node-2a.local". I1218 12:15:22.968618 32303 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1218 12:15:22.968654 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:22.969800 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.969821 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:22.975020 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.975076 32303 instancegroups.go:431] Draining the node: "node-2b.local". I1218 12:15:22.976139 32303 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1218 12:15:22.976187 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:22.977350 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.977370 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:22.982584 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.982650 32303 instancegroups.go:431] Draining the node: "node-2c.local". I1218 12:15:22.983623 32303 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1218 12:15:22.983661 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:22.984810 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:22.984832 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:22.990067 32303 instancegroups.go:540] Cluster validated. I1218 12:15:22.990103 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I1218 12:15:22.990780 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:22.990816 32303 instancegroups.go:469] waiting for 1ms after terminating instance W1218 12:15:22.991970 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.992013 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.992045 32303 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1218 12:15:22.992058 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:22.992081 32303 instancegroups.go:469] waiting for 1ms after terminating instance W1218 12:15:22.993181 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.993224 32303 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1218 12:15:22.993232 32303 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1218 12:15:22.993244 32303 instancegroups.go:469] waiting for 1ms after terminating instance W1218 12:15:22.994363 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.994386 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.994416 32303 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1218 12:15:22.994429 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:22.994449 32303 instancegroups.go:469] waiting for 1ms after terminating instance W1218 12:15:22.995560 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.995591 32303 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1218 12:15:22.995603 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:22.995623 32303 instancegroups.go:469] waiting for 1ms after terminating instance W1218 12:15:22.996723 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.996755 32303 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1218 12:15:22.996766 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:22.996800 32303 instancegroups.go:469] waiting for 1ms after terminating instance W1218 12:15:22.997906 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.997934 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.997963 32303 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1218 12:15:22.997974 32303 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1218 12:15:22.997992 32303 instancegroups.go:469] waiting for 1ms after terminating instance W1218 12:15:22.999103 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:22.999152 32303 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1218 12:15:22.999166 32303 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1218 12:15:22.999205 32303 instancegroups.go:469] waiting for 1ms after terminating instance W1218 12:15:23.000327 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1218 12:15:23.000372 32303 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1218 12:15:23.000391 32303 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1218 12:15:23.000433 32303 instancegroups.go:469] waiting for 1ms after terminating instance W1218 12:15:23.001573 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1218 12:15:23.001616 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I1218 12:15:23.002032 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:23.002065 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.003206 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.003258 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.003282 32303 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.003327 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.003351 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.003370 32303 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.003386 32303 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1218 12:15:23.004208 32303 instancegroups.go:431] Draining the node: "master-1a.local". I1218 12:15:23.004965 32303 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1218 12:15:23.005037 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:23.005069 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.006207 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.006250 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.006272 32303 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.006323 32303 instancegroups.go:431] Draining the node: "master-1b.local". I1218 12:15:23.007158 32303 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1218 12:15:23.007210 32303 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1218 12:15:23.007234 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.008358 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.008389 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.008410 32303 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.008433 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.008454 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.008470 32303 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.008485 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:23.009389 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.010168 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.010201 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.011317 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.011344 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.011360 32303 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.011390 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:23.012074 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:23.012102 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.013223 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.013253 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.013275 32303 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.013308 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:23.014132 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:23.014165 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.015282 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.015309 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.015325 32303 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.015340 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.015357 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.015372 32303 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.015387 32303 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1218 12:15:23.016312 32303 instancegroups.go:431] Draining the node: "node-2a.local". I1218 12:15:23.017015 32303 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1218 12:15:23.017047 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.020033 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.020083 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.020109 32303 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.020158 32303 instancegroups.go:431] Draining the node: "node-2b.local". I1218 12:15:23.021105 32303 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1218 12:15:23.021144 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.022297 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.022336 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.022357 32303 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.022390 32303 instancegroups.go:431] Draining the node: "node-2c.local". I1218 12:15:23.023211 32303 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1218 12:15:23.023244 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.024370 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.024395 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1218 12:15:23.024409 32303 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1218 12:15:23.024426 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I1218 12:15:23.024685 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I1218 12:15:23.024873 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:23.024896 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.026465 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.026494 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.031740 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.031803 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.031823 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.031834 32303 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1218 12:15:23.032422 32303 instancegroups.go:431] Draining the node: "master-1a.local". I1218 12:15:23.032925 32303 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1218 12:15:23.032985 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:23.033007 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.034176 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.034196 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.039401 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.039447 32303 instancegroups.go:431] Draining the node: "master-1b.local". I1218 12:15:23.040022 32303 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1218 12:15:23.040072 32303 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1218 12:15:23.040094 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.041255 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.041277 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.046391 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.046422 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.046439 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.046454 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:23.047459 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.047970 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.047997 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.049121 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.049149 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.054362 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.054421 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:23.055375 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:23.055414 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.056539 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.056558 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.061778 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.061856 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:23.062570 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:23.062603 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.063754 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.063791 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.068975 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.069002 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.069020 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.069039 32303 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1218 12:15:23.069692 32303 instancegroups.go:431] Draining the node: "node-2a.local". I1218 12:15:23.070181 32303 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1218 12:15:23.070211 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.071339 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.071364 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.076575 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.076646 32303 instancegroups.go:431] Draining the node: "node-2b.local". I1218 12:15:23.077582 32303 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1218 12:15:23.077617 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.078746 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.078769 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.083966 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.084021 32303 instancegroups.go:431] Draining the node: "node-2c.local". I1218 12:15:23.084871 32303 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1218 12:15:23.084906 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.086055 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.086074 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.091259 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.091287 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.07s) === RUN TestRollingUpdateEmptyGroup I1218 12:15:23.091466 32303 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I1218 12:15:23.091864 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:23.091890 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.093002 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.093024 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1218 12:15:23.093037 32303 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I1218 12:15:23.096040 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:23.096099 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.097293 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.097342 32303 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1218 12:15:23.097368 32303 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I1218 12:15:23.097661 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.097686 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1218 12:15:23.097701 32303 instancegroups.go:509] Cluster did not validate within 0s E1218 12:15:23.097716 32303 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I1218 12:15:23.097908 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.097929 32303 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1218 12:15:23.097943 32303 instancegroups.go:509] Cluster did not validate within 0s E1218 12:15:23.097956 32303 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I1218 12:15:23.098301 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:23.098373 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.099522 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.099553 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.105586 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.105668 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.105696 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.105713 32303 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1218 12:15:23.106283 32303 instancegroups.go:431] Draining the node: "master-1a.local". I1218 12:15:23.106736 32303 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1218 12:15:23.106802 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:23.106832 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.107922 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.107947 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1218 12:15:23.107959 32303 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I1218 12:15:23.108174 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:23.108191 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.109310 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.109337 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.114555 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.114633 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.114661 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.114678 32303 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1218 12:15:23.115565 32303 instancegroups.go:431] Draining the node: "master-1a.local". I1218 12:15:23.116269 32303 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1218 12:15:23.116337 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:23.116367 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.117522 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.117558 32303 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1218 12:15:23.117583 32303 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I1218 12:15:23.117881 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.117905 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.117918 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:23.118725 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.119258 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.119285 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.120407 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.120431 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.125630 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.125691 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:23.126363 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:23.126393 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.128539 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.128584 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.133785 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.133854 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:23.134836 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:23.134872 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.136042 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.136077 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.141301 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.141360 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I1218 12:15:23.141746 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.141781 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1218 12:15:23.141807 32303 instancegroups.go:509] Cluster did not validate within 0s E1218 12:15:23.141825 32303 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I1218 12:15:23.142064 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.142091 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1218 12:15:23.142108 32303 instancegroups.go:509] Cluster did not validate within 0s E1218 12:15:23.142125 32303 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I1218 12:15:23.142344 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.142370 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1218 12:15:23.142388 32303 instancegroups.go:509] Cluster did not validate within 0s E1218 12:15:23.142407 32303 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I1218 12:15:23.142656 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.142679 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.142694 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:23.143796 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.144578 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.144614 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.145765 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.145808 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.151036 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.151102 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:23.152070 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:23.152106 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.153251 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.153279 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.158497 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.158569 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:23.159500 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:23.159538 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.160674 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.160703 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.166249 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.166297 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.166325 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1218 12:15:23.166349 32303 instancegroups.go:509] Cluster did not validate within 0s E1218 12:15:23.166368 32303 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I1218 12:15:23.166671 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.166702 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.166717 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:23.167823 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.168667 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.168700 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.169869 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.169917 32303 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1218 12:15:23.169939 32303 instancegroups.go:509] Cluster did not validate within 0s E1218 12:15:23.169960 32303 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I1218 12:15:23.170208 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.170234 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.170249 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:23.171254 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.172359 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.172399 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.173583 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.173614 32303 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1218 12:15:23.173636 32303 instancegroups.go:509] Cluster did not validate within 0s E1218 12:15:23.173656 32303 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I1218 12:15:23.173950 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:23.173976 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.175111 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.175151 32303 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1218 12:15:23.176289 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.181540 32303 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1218 12:15:23.182697 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.187930 32303 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1218 12:15:23.189054 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.195118 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.195196 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.195219 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.195231 32303 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1218 12:15:23.195764 32303 instancegroups.go:431] Draining the node: "master-1a.local". I1218 12:15:23.196231 32303 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1218 12:15:23.196298 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:23.196326 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.197625 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.197678 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.203526 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.203586 32303 instancegroups.go:431] Draining the node: "master-1b.local". I1218 12:15:23.204237 32303 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1218 12:15:23.204292 32303 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1218 12:15:23.204313 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.205465 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.205506 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.210754 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.210798 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.210819 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.210831 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:23.211483 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.211995 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.212019 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.213175 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.213209 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.219416 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.219503 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:23.220358 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:23.220390 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.221541 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.221584 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.226831 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.226919 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:23.227744 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:23.227773 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.228951 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.229013 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.234264 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.234308 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.234340 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.234358 32303 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1218 12:15:23.235413 32303 instancegroups.go:431] Draining the node: "node-2a.local". I1218 12:15:23.236173 32303 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1218 12:15:23.236207 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.237339 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.237394 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.242641 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.242716 32303 instancegroups.go:431] Draining the node: "node-2b.local". I1218 12:15:23.243717 32303 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1218 12:15:23.243760 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.244892 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.244936 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.250173 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.250244 32303 instancegroups.go:431] Draining the node: "node-2c.local". I1218 12:15:23.251224 32303 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1218 12:15:23.251260 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.252391 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.252443 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.257683 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.257731 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I1218 12:15:23.258084 32303 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1218 12:15:23.258115 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.259300 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.259337 32303 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1218 12:15:23.260448 32303 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1218 12:15:23.261604 32303 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1218 12:15:23.262724 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.267931 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.268019 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.268045 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.268063 32303 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1218 12:15:23.268915 32303 instancegroups.go:431] Draining the node: "master-1a.local". I1218 12:15:23.269640 32303 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1218 12:15:23.269715 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:23.269749 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.270890 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.270929 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.276145 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.276214 32303 instancegroups.go:431] Draining the node: "master-1b.local". I1218 12:15:23.277121 32303 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1218 12:15:23.277193 32303 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1218 12:15:23.277226 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.278361 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.278401 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.283610 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.283656 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.283679 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.283697 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:23.284767 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.285551 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.285587 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.286721 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.286752 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.291947 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.292008 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:23.292876 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:23.292910 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.294037 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.294069 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.299270 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.299330 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:23.300272 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:23.300306 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.301434 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.301465 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.306666 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.306697 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.306710 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.306720 32303 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1218 12:15:23.307406 32303 instancegroups.go:431] Draining the node: "node-2a.local". I1218 12:15:23.307883 32303 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1218 12:15:23.307907 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.309030 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.309055 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.314259 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.314309 32303 instancegroups.go:431] Draining the node: "node-2b.local". I1218 12:15:23.314938 32303 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1218 12:15:23.314962 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.316080 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.316106 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.321315 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.321365 32303 instancegroups.go:431] Draining the node: "node-2c.local". I1218 12:15:23.321966 32303 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1218 12:15:23.321991 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.323148 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.323179 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.328402 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.328449 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I1218 12:15:23.329043 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.329059 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.329068 32303 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1218 12:15:23.329682 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.330151 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.330173 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.331294 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.331319 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.336570 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.336614 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:23.337232 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:23.337255 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.338375 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.338400 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.343601 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.343632 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I1218 12:15:23.343890 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.343907 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.343915 32303 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1218 12:15:23.344401 32303 instancegroups.go:431] Draining the node: "master-1a.local". I1218 12:15:23.344832 32303 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1218 12:15:23.344881 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:23.344899 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.346021 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.346044 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.351248 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.351329 32303 instancegroups.go:431] Draining the node: "master-1b.local". I1218 12:15:23.352198 32303 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1218 12:15:23.352272 32303 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1218 12:15:23.352302 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.353435 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.353462 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.364313 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.364360 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.02s) === RUN TestRollingUpdateDisabled I1218 12:15:23.364739 32303 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W1218 12:15:23.364777 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1218 12:15:23.364798 32303 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W1218 12:15:23.364813 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1218 12:15:23.364832 32303 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W1218 12:15:23.364842 32303 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1218 12:15:23.364859 32303 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1218 12:15:23.364874 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I1218 12:15:23.365103 32303 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I1218 12:15:23.365149 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:23.366287 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.366319 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.371530 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.371575 32303 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I1218 12:15:23.371640 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.371665 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.371683 32303 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1218 12:15:23.372504 32303 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I1218 12:15:23.372529 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.372548 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.372563 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:23.373433 32303 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1218 12:15:23.373494 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:23.374644 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.374680 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.379925 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.379973 32303 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I1218 12:15:23.379996 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.380018 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.380036 32303 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1218 12:15:23.381095 32303 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I1218 12:15:23.381161 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:23.382324 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.382356 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:23.388347 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.388401 32303 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1218 12:15:23.388428 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I1218 12:15:23.388798 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.388831 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.388849 32303 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1218 12:15:23.391085 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.391884 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.391931 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.393117 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.393164 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.393197 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:23.393246 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:23.394047 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:23.394282 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:23.394319 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.395465 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.395510 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.495921 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.495998 32303 instancegroups.go:431] Draining the node: "node-1e.local". I1218 12:15:23.496061 32303 instancegroups.go:431] Draining the node: "node-1d.local". I1218 12:15:23.498878 32303 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1218 12:15:23.498969 32303 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1218 12:15:23.499015 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.500184 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.500218 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.500249 32303 instancegroups.go:431] Draining the node: "node-1f.local". I1218 12:15:23.500735 32303 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1218 12:15:23.500764 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.501891 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.501948 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.602129 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.602199 32303 instancegroups.go:431] Draining the node: "node-1g.local". I1218 12:15:23.603048 32303 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1218 12:15:23.603093 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.604217 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.604245 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.604259 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.22s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I1218 12:15:23.604433 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.604451 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.604459 32303 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1218 12:15:23.605452 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:23.605508 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:23.606038 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:23.606184 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:23.606208 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.607349 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.607386 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.707790 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.707873 32303 instancegroups.go:431] Draining the node: "node-1d.local". I1218 12:15:23.707916 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:23.708504 32303 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1218 12:15:23.708859 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:23.708886 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.710008 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.710043 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.710075 32303 instancegroups.go:431] Draining the node: "node-1e.local". I1218 12:15:23.710569 32303 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1218 12:15:23.710604 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.711738 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.711772 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.812191 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.812267 32303 instancegroups.go:431] Draining the node: "node-1f.local". I1218 12:15:23.813256 32303 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1218 12:15:23.813305 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.814424 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.814467 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.814490 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I1218 12:15:23.814688 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.814716 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.814734 32303 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I1218 12:15:23.815952 32303 instancegroups.go:431] Draining the node: "master-1a.local". I1218 12:15:23.816407 32303 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1218 12:15:23.816456 32303 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1218 12:15:23.816491 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.817639 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.817672 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.817708 32303 instancegroups.go:431] Draining the node: "master-1c.local". I1218 12:15:23.817727 32303 instancegroups.go:431] Draining the node: "master-1b.local". I1218 12:15:23.818419 32303 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1218 12:15:23.818456 32303 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1218 12:15:23.818584 32303 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I1218 12:15:23.818613 32303 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I1218 12:15:23.818633 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.819756 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.819808 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.921152 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.921230 32303 instancegroups.go:431] Draining the node: "master-1e.local". I1218 12:15:23.922356 32303 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I1218 12:15:23.922426 32303 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I1218 12:15:23.922479 32303 instancegroups.go:431] Draining the node: "master-1d.local". I1218 12:15:23.923091 32303 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I1218 12:15:23.923141 32303 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I1218 12:15:23.923178 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.924299 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.924343 32303 instancegroups.go:540] Cluster validated. I1218 12:15:23.924372 32303 instancegroups.go:431] Draining the node: "master-1f.local". I1218 12:15:23.925075 32303 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I1218 12:15:23.925136 32303 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I1218 12:15:23.925175 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:23.926301 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:23.926381 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.027141 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.027207 32303 instancegroups.go:431] Draining the node: "master-1g.local". I1218 12:15:24.027801 32303 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I1218 12:15:24.027856 32303 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I1218 12:15:24.027888 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.029035 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.029062 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.029075 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I1218 12:15:24.029254 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.029275 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.029284 32303 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1218 12:15:24.030301 32303 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1218 12:15:24.030342 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:24.031493 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.031520 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.031528 32303 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1218 12:15:24.031561 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:24.032698 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.032722 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.032749 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:24.032772 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:24.033294 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:24.033657 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:24.033683 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.034794 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.034829 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.135248 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.135315 32303 instancegroups.go:431] Draining the node: "node-1d.local". I1218 12:15:24.135342 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:24.136331 32303 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1218 12:15:24.136593 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:24.136637 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.137766 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.137804 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.137836 32303 instancegroups.go:431] Draining the node: "node-1e.local". I1218 12:15:24.138612 32303 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1218 12:15:24.138656 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.139782 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.139837 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.240279 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.240349 32303 instancegroups.go:431] Draining the node: "node-1f.local". I1218 12:15:24.241019 32303 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1218 12:15:24.241061 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.242212 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.242240 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.242254 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I1218 12:15:24.242451 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.242472 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.242480 32303 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1218 12:15:24.243477 32303 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1218 12:15:24.243509 32303 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1218 12:15:24.243538 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:24.244681 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.244709 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.244743 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:24.244755 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:24.245600 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:24.245766 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:24.245794 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.246936 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.246983 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.347385 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.347449 32303 instancegroups.go:431] Draining the node: "node-1d.local". I1218 12:15:24.347488 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:24.348078 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:24.348425 32303 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1218 12:15:24.348453 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.349597 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.349625 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.349647 32303 instancegroups.go:431] Draining the node: "node-1e.local". I1218 12:15:24.350134 32303 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1218 12:15:24.350166 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.351313 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.351348 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.451960 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.452022 32303 instancegroups.go:431] Draining the node: "node-1f.local". I1218 12:15:24.452644 32303 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1218 12:15:24.452684 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.453826 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.453854 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.453868 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I1218 12:15:24.454046 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.454060 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.454067 32303 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1218 12:15:24.454459 32303 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1218 12:15:24.454479 32303 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I1218 12:15:24.454501 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:24.455645 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.455667 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:24.460866 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.460928 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:24.460969 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:24.461586 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:24.461617 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.461968 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:24.461989 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.462772 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.462793 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:24.468038 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.468067 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I1218 12:15:24.468260 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.468277 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.468285 32303 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1218 12:15:24.468722 32303 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E1218 12:15:24.468760 32303 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I1218 12:15:24.468768 32303 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E1218 12:15:24.468790 32303 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I1218 12:15:24.468808 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:24.469945 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.469967 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:24.475146 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.475185 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:24.475197 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:24.475762 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:24.475789 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.476141 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:24.476161 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.476948 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.476968 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:24.482229 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.482266 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I1218 12:15:24.482477 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.482501 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.482510 32303 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I1218 12:15:24.483281 32303 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1218 12:15:24.483322 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:24.484464 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.484490 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.484499 32303 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1218 12:15:24.484530 32303 instancegroups.go:203] waiting for 1ms after detaching instance I1218 12:15:24.485668 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.485692 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.485718 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:24.485768 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:24.485786 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:24.486797 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:24.486836 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.486987 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:24.487012 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.487156 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:24.487180 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.487987 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.588709 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.588772 32303 instancegroups.go:431] Draining the node: "node-1d.local". I1218 12:15:24.589440 32303 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1218 12:15:24.589475 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.590612 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.590640 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.590653 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I1218 12:15:24.590822 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.590842 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.590850 32303 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1218 12:15:24.591985 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:24.592429 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:24.592455 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.593598 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.593625 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.593649 32303 instancegroups.go:431] Draining the node: "node-1e.local". I1218 12:15:24.593699 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:24.594158 32303 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1218 12:15:24.594550 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:24.594581 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.595724 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.595789 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.696471 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.696548 32303 instancegroups.go:431] Draining the node: "node-1g.local". I1218 12:15:24.696581 32303 instancegroups.go:431] Draining the node: "node-1f.local". I1218 12:15:24.697529 32303 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1218 12:15:24.697764 32303 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1218 12:15:24.697804 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.698933 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.698971 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.699009 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:24.699778 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:24.699817 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.700938 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.700986 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.801552 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.801623 32303 instancegroups.go:431] Draining the node: "node-1d.local". I1218 12:15:24.802593 32303 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1218 12:15:24.802642 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.803772 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.803802 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.803821 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I1218 12:15:24.803980 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.803994 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.804003 32303 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1218 12:15:24.804014 32303 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1218 12:15:24.804023 32303 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1218 12:15:24.804037 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I1218 12:15:24.804130 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.804143 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.804151 32303 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1218 12:15:24.804705 32303 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1218 12:15:24.804722 32303 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1218 12:15:24.804731 32303 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1218 12:15:24.804752 32303 instancegroups.go:431] Draining the node: "node-1a.local". I1218 12:15:24.806327 32303 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1218 12:15:24.806382 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.807533 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.807569 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:24.812694 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.812747 32303 instancegroups.go:431] Draining the node: "node-1b.local". I1218 12:15:24.813632 32303 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1218 12:15:24.813669 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.814850 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.814878 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:24.820083 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.820128 32303 instancegroups.go:431] Draining the node: "node-1c.local". I1218 12:15:24.820982 32303 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1218 12:15:24.821016 32303 instancegroups.go:469] waiting for 1ms after terminating instance I1218 12:15:24.822190 32303 instancegroups.go:504] Validating the cluster. I1218 12:15:24.822214 32303 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1218 12:15:24.827407 32303 instancegroups.go:540] Cluster validated. I1218 12:15:24.827449 32303 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 2.003s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.012s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.015s === RUN TestParse E1218 12:15:22.839632 32306 versions.go:96] unable to parse Kubernetes version "" E1218 12:15:22.839763 32306 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.013s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.036s === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.18s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.01s) PASS ok k8s.io/kops/pkg/kubeconfig 0.256s === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.081s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.082s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.077s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I1218 12:15:22.897915 32312 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.073s === RUN Test_RunEtcdManagerBuilder I1218 12:15:22.888995 32314 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W1218 12:15:22.933338 32314 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W1218 12:15:22.935458 32314 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.05s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.02s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.111s === RUN Test_RunKubeApiserverBuilder I1218 12:15:22.901008 32315 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.090s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.082s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.026s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.059s === RUN TestServerGroupBuilder I1218 12:15:30.893926 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:30.912392 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:30.924369 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:30.943002 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.020090 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.038386 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.060462 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.079178 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.101815 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.153152 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.163161 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.172925 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.181806 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.196459 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.205005 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.211600 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.217609 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:31.223758 33212 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.39s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.478s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.031s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.029s === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.032s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.01s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (1.61s) --- PASS: TestIssueCert/ca (0.22s) --- PASS: TestIssueCert/client (0.62s) --- PASS: TestIssueCert/clientOneYear (0.77s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 1.629s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.004s === RUN TestAddUntaggedRouteTables I1218 12:15:30.871350 33219 routetable.go:53] DescribeRouteTables: { } W1218 12:15:30.871835 33219 tags.go:67] cluster tag not found on route-table:rtb-1234 I1218 12:15:30.871852 33219 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I1218 12:15:30.872030 33219 iaminstanceprofile.go:193] ListInstanceProfiles: { } W1218 12:15:30.872133 33219 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I1218 12:15:30.872258 33219 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I1218 12:15:30.872384 33219 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I1218 12:15:30.872443 33219 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I1218 12:15:30.872521 33219 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I1218 12:15:30.872598 33219 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I1218 12:15:30.872622 33219 volumes.go:128] DescribeVolumes: { } W1218 12:15:30.872651 33219 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I1218 12:15:30.872768 33219 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:30.872852 33219 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:30.872884 33219 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:30.872937 33219 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:30.872969 33219 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:30.873020 33219 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:30.873057 33219 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:30.873075 33219 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:30.873103 33219 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:30.873124 33219 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:30.873160 33219 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I1218 12:15:30.873197 33219 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I1218 12:15:30.873227 33219 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I1218 12:15:30.873259 33219 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I1218 12:15:30.873277 33219 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I1218 12:15:30.873313 33219 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I1218 12:15:30.873360 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I1218 12:15:30.873395 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I1218 12:15:30.873415 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I1218 12:15:30.873431 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I1218 12:15:30.873449 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I1218 12:15:30.873472 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I1218 12:15:30.873492 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I1218 12:15:30.873506 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I1218 12:15:30.873524 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I1218 12:15:30.873547 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I1218 12:15:30.873566 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I1218 12:15:30.873580 33219 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.064s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.036s === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.070s === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.004s === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.003s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.004s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.004s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.01s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.02s) PASS ok k8s.io/kops/pkg/util/templater 0.054s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.076s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.006s === RUN TestRemovesDuplicateGuardedBlocks W1218 12:15:38.461551 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.461636 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.461649 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.461660 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.461672 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.461685 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.461696 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.461707 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.461718 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.461729 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.461740 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.461750 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.461760 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.461771 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.461780 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.461791 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.463145 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.463188 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.463277 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.463292 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.463368 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.463384 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.463476 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.463491 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.463570 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.463585 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.463689 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.463710 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.463813 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.463830 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.463932 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.463948 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.464031 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.464046 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.464129 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.464145 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.464221 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.464237 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.464336 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.464352 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.464498 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.464515 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.464608 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.464623 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.464701 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.464717 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.464807 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.464822 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.464911 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.464927 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.465010 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.465026 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.465118 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.465153 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.465274 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.465290 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.465374 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.465389 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.465477 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.465499 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.465578 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.465594 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.465681 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.465696 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.465784 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.465799 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.465893 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.465929 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466014 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466030 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466114 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466147 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466235 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466251 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466333 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466348 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466426 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466441 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466545 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466560 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466667 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466683 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466757 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466772 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466855 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466869 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.466948 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.466967 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.467048 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.467076 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.467167 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.467186 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.467269 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.467289 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.467395 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.467412 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.467488 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.467504 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.467632 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.467648 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.467750 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.467766 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.467836 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.467847 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.467920 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.467934 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468009 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468020 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468095 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468105 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468186 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468197 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468271 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468281 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468347 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468361 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468442 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468458 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468564 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468576 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468651 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468668 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468758 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468781 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468870 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.468885 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.468987 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.469002 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.469084 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.469100 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.469185 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.469201 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.469292 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.469308 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.469404 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.469426 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.469526 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.469550 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.469633 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.469652 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.469740 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.469756 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.469896 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.469921 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.470031 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.470053 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.470138 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.470162 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.470261 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.470284 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.470370 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.470392 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.470512 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.470538 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.470628 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.470647 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.470735 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.470752 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.470849 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.470866 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.470960 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.471005 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.471110 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.471126 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.471213 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.471229 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.471337 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.471354 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.471448 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.471470 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.471567 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.471583 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.471672 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.471688 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.471793 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.471819 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.471914 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.471928 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.472027 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.472046 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.472130 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.472154 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.472239 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.472255 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.472385 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.472411 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.472496 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.472520 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.472608 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.472625 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.472730 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.472747 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.472833 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.472850 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.472944 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.472965 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.473066 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.473083 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.473181 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.473197 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.473303 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.473319 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.473396 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.473414 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.473491 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.473507 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.473607 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.473666 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.473793 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.473812 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.473929 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.473948 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.474038 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474058 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.01s) === RUN TestRecoversFromBadNesting W1218 12:15:38.474543 34503 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1218 12:15:38.474562 34503 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1218 12:15:38.474575 34503 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1218 12:15:38.474588 34503 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1218 12:15:38.474600 34503 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1218 12:15:38.474612 34503 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1218 12:15:38.474624 34503 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1218 12:15:38.474665 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474683 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474696 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.474708 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474720 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.474732 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474744 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.474762 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474776 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.474787 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474800 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474812 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474825 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474841 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.474853 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.474864 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.489235 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.489263 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.489362 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.489378 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.489482 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.489498 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.489578 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.489598 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.489665 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.489679 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.489746 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.489761 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.489871 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.489887 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.489979 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.489995 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490060 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490075 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490144 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490160 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490240 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490255 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490330 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490345 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490446 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490468 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490541 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490556 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490626 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490640 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490716 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490737 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490805 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490820 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490886 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490900 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.490976 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.490991 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491074 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491090 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491161 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491189 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491257 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491272 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491350 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491365 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491451 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491471 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491541 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491556 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491639 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491653 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491713 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491725 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491803 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491815 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491884 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491912 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.491976 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.491993 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492085 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492099 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492165 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492176 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492236 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492247 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492306 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492318 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492382 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492394 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492468 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492480 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492540 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492551 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492623 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492635 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492704 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492715 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492784 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492795 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492855 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492873 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.492958 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.492976 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493036 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493048 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493116 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493128 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493197 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493213 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493273 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493284 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493347 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493359 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493426 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493438 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493502 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493514 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493593 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493611 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493694 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493713 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493809 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493828 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.493907 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.493925 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494001 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494012 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494135 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494154 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494255 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494273 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494359 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494377 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494438 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494453 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494531 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494548 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494641 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494657 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494734 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494762 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494846 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494863 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.494944 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.494961 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495045 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495061 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495140 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495157 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495247 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495262 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495345 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495362 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495453 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495470 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495547 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495563 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495638 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495665 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495751 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495772 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495857 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495878 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.495953 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.495972 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496053 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496073 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496161 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496181 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496252 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496265 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496322 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496338 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496389 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496399 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496474 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496485 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496541 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496559 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496615 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496626 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496692 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496707 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496774 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496785 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496848 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496858 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496930 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.496945 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.496997 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497007 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497056 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497083 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497166 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497178 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497229 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497240 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497296 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497307 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497360 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497370 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497441 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497452 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497504 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497524 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497611 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497623 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497686 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497696 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497761 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497774 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497826 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497836 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497885 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497894 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1218 12:15:38.497952 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1218 12:15:38.497962 34503 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.02s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.041s === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.042s === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.00s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.072s === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.02s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.02s) PASS ok k8s.io/kops/tests/integration/conversion 0.055s === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I1218 12:15:38.498397 34508 files.go:57] Writing file "/tmp/TestWriteFile3147905460/001/SubDir/test1.tmp" I1218 12:15:38.498541 34508 files.go:113] Changing file mode for "/tmp/TestWriteFile3147905460/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.050s === RUN TestBootstrapChannelBuilder_BuildTasks I1218 12:15:41.687644 35341 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:41.687843 35341 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:41.687886 35341 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:41.687923 35341 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:41.687957 35341 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:41.688020 35341 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:41.688067 35341 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:41.688087 35341 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:41.688138 35341 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:41.688177 35341 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:41.696273 35341 zones.go:93] ListHostedZonesPages { } I1218 12:15:41.830553 35341 zones.go:93] ListHostedZonesPages { } I1218 12:15:41.982449 35341 zones.go:93] ListHostedZonesPages { } I1218 12:15:42.102088 35341 zones.go:93] ListHostedZonesPages { } I1218 12:15:42.235356 35341 zones.go:93] ListHostedZonesPages { } I1218 12:15:42.357950 35341 zones.go:93] ListHostedZonesPages { } I1218 12:15:42.539491 35341 zones.go:93] ListHostedZonesPages { } I1218 12:15:42.720323 35341 zones.go:93] ListHostedZonesPages { } I1218 12:15:43.263211 35341 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.69s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I1218 12:15:43.380661 35341 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:43.380773 35341 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:43.380837 35341 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:43.380890 35341 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:43.380934 35341 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:43.380984 35341 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:43.381028 35341 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:43.381057 35341 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:43.381096 35341 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:43.381125 35341 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:43.381157 35341 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I1218 12:15:43.382928 35341 zones.go:93] ListHostedZonesPages { } I1218 12:15:43.521659 35341 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.14s) === RUN TestBootstrapChannelBuilder_AWSCloudController I1218 12:15:43.521816 35341 featureflag.go:164] FeatureFlag "ImageDigest"=false I1218 12:15:43.521908 35341 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:43.521967 35341 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1218 12:15:43.522018 35341 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1218 12:15:43.522060 35341 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1218 12:15:43.522104 35341 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1218 12:15:43.522142 35341 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1218 12:15:43.522167 35341 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1218 12:15:43.522202 35341 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1218 12:15:43.522229 35341 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1218 12:15:43.523888 35341 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.10s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.22s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W1218 12:15:43.857684 35341 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I1218 12:15:43.891435 35341 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I1218 12:15:43.891514 35341 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I1218 12:15:43.891530 35341 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I1218 12:15:43.891600 35341 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I1218 12:15:43.891617 35341 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I1218 12:15:43.891684 35341 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I1218 12:15:43.891752 35341 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I1218 12:15:43.891834 35341 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1218 12:15:43.891850 35341 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I1218 12:15:43.891924 35341 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1218 12:15:43.891940 35341 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I1218 12:15:43.892048 35341 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I1218 12:15:43.892161 35341 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I1218 12:15:43.892232 35341 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I1218 12:15:43.892247 35341 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I1218 12:15:43.892259 35341 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I1218 12:15:43.892273 35341 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I1218 12:15:43.892286 35341 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I1218 12:15:43.892300 35341 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I1218 12:15:43.892313 35341 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I1218 12:15:43.892327 35341 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I1218 12:15:43.893512 35341 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I1218 12:15:43.893708 35341 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.299s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I1218 12:15:41.668301 35342 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4120772029/001 I1218 12:15:41.668692 35342 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4120772029/001 I1218 12:15:41.668984 35342 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4120772029/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.01s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I1218 12:15:41.679205 35342 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1218 12:15:41.679346 35342 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1218 12:15:41.679502 35342 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I1218 12:15:41.679695 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.679948 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.680062 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.680095 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.680476 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:15:41.680532 35342 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1218 12:15:41.680593 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.680716 35342 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1218 12:15:41.680848 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1218 12:15:41.680936 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.681019 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.681088 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.681120 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.681176 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.681237 35342 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1218 12:15:41.681324 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I1218 12:15:41.681517 35342 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1218 12:15:41.681602 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.681756 35342 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1218 12:15:41.681823 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:15:41.681861 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.681902 35342 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1218 12:15:41.682005 35342 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1218 12:15:41.682276 35342 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1218 12:15:41.682363 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:15:41.682405 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.682449 35342 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1218 12:15:41.682535 35342 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:15:41.682860 35342 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I1218 12:15:41.682953 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:15:41.682994 35342 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I1218 12:15:41.683057 35342 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1218 12:15:41.683170 35342 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1218 12:15:41.683248 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.683318 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.683346 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.683390 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.683433 35342 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1218 12:15:41.683490 35342 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1218 12:15:41.683572 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.683614 35342 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1218 12:15:41.683672 35342 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:15:41.683765 35342 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I1218 12:15:41.683814 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1218 12:15:41.683872 35342 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I1218 12:15:41.683970 35342 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1218 12:15:41.684032 35342 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1218 12:15:41.684069 35342 internetgateways.go:66] CreateInternetGateway: { } I1218 12:15:41.684108 35342 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I1218 12:15:41.684202 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.684262 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.684320 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.684347 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.684462 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:15:41.684503 35342 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1218 12:15:41.684563 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.684659 35342 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1218 12:15:41.684780 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1218 12:15:41.684885 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.684943 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.685005 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.685034 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.685082 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.685140 35342 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1218 12:15:41.685228 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I1218 12:15:41.685938 35342 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender427941788/001 I1218 12:15:41.686318 35342 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender427941788/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I1218 12:15:41.686908 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.686982 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.687150 35342 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1218 12:15:41.687215 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:15:41.687255 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.687307 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.687424 35342 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1218 12:15:41.687743 35342 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I1218 12:15:41.687827 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1218 12:15:41.687885 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1218 12:15:41.687969 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.688025 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.688095 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.688121 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.688163 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.688198 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.688258 35342 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1218 12:15:41.688370 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I1218 12:15:41.688725 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.688793 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.688932 35342 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1218 12:15:41.688994 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:15:41.689031 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.689066 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.689129 35342 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1218 12:15:41.689288 35342 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1218 12:15:41.689354 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:15:41.689391 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.689428 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1218 12:15:41.689528 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.689587 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.689654 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.689681 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.689730 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.689767 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.689824 35342 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1218 12:15:41.689912 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.689950 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I1218 12:15:41.690113 35342 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1218 12:15:41.690172 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.690295 35342 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1218 12:15:41.690356 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:15:41.690409 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.690449 35342 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1218 12:15:41.690593 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.690750 35342 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1218 12:15:41.690996 35342 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1218 12:15:41.690993 35342 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1218 12:15:41.691094 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:15:41.691135 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.691174 35342 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1218 12:15:41.691289 35342 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1218 12:15:41.691351 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.691419 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.691446 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.691486 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.691523 35342 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1218 12:15:41.691617 35342 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1218 12:15:41.691707 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.691738 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.691809 35342 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I1218 12:15:41.691997 35342 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1218 12:15:41.692057 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.692190 35342 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1218 12:15:41.692252 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:15:41.692287 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.692322 35342 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1218 12:15:41.692383 35342 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1218 12:15:41.692526 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.692616 35342 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1218 12:15:41.692653 35342 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1218 12:15:41.692725 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:15:41.692768 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.692805 35342 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1218 12:15:41.692914 35342 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1218 12:15:41.692977 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.693043 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.693070 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.693111 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.693147 35342 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1218 12:15:41.693206 35342 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1218 12:15:41.693350 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.693390 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.693471 35342 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I1218 12:15:41.693558 35342 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I1218 12:15:41.693653 35342 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I1218 12:15:41.693775 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.693836 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.693893 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.693919 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.694027 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:15:41.694069 35342 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1218 12:15:41.694120 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.694176 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.694329 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1218 12:15:41.694376 35342 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1218 12:15:41.694423 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1218 12:15:41.694524 35342 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1218 12:15:41.694582 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.694641 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.694669 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.694719 35342 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1218 12:15:41.694774 35342 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1218 12:15:41.694857 35342 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I1218 12:15:41.694992 35342 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:41.695053 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.695179 35342 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1218 12:15:41.695240 35342 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1218 12:15:41.695277 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.695311 35342 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1218 12:15:41.695370 35342 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:41.695424 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1218 12:15:41.695490 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.695517 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.695557 35342 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1218 12:15:41.695592 35342 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I1218 12:15:41.695751 35342 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I1218 12:15:41.695854 35342 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:41.695914 35342 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I1218 12:15:41.695990 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1218 12:15:41.696019 35342 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1218 12:15:41.696069 35342 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.083s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.088s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.035s === RUN TestDiskRenderAzure I1218 12:15:42.392297 35462 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I1218 12:15:42.393085 35462 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I1218 12:15:42.393525 35462 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I1218 12:15:42.394665 35462 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I1218 12:15:42.395104 35462 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I1218 12:15:42.395465 35462 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I1218 12:15:42.395721 35462 resourcegroup.go:108] Creating a new Resource Group with name: rg I1218 12:15:42.395734 35462 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I1218 12:15:42.395985 35462 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I1218 12:15:42.396773 35462 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I1218 12:15:42.397122 35462 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I1218 12:15:42.397381 35462 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I1218 12:15:42.397825 35462 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I1218 12:15:42.398109 35462 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.043s === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.036s === RUN TestProjectIAMBinding I1218 12:15:44.617225 36352 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:44.617743 36352 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1218 12:15:44.617772 36352 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:44.618260 36352 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1218 12:15:44.618304 36352 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:44.618463 36352 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I1218 12:15:44.618587 36352 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:44.618695 36352 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1218 12:15:44.618720 36352 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:44.618842 36352 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1218 12:15:44.618869 36352 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:44.619743 36352 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I1218 12:15:44.620989 36352 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:44.621323 36352 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1218 12:15:44.621345 36352 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:44.621713 36352 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1218 12:15:44.621739 36352 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1218 12:15:44.621879 36352 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.064s === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.02s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.064s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.046s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.028s === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.033s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.005s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.033s === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I1218 12:15:47.336480 36644 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I1218 12:15:47.336584 36644 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I1218 12:15:47.336609 36644 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I1218 12:15:47.336644 36644 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I1218 12:15:47.336655 36644 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I1218 12:15:47.336667 36644 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I1218 12:15:47.336679 36644 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W1218 12:15:47.337251 36644 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.056s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.004s === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.005s === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.004s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.004s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.004s === RUN TestGetProxyEnvVars W1218 12:15:47.304545 36650 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.021s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.026s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.003s === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.003s === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.025s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W1218 12:15:50.585271 36742 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.059s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... >>> kops*: Package size: 144.3 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.1-r0.apk >>> kops: Build complete at Mon, 18 Dec 2023 12:18:35 +0000 elapsed time 0h 6m 31s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/5) Purging .makedepends-kops (20231218.121206) (2/5) Purging kubernetes (1.29.0-r0) (3/5) Purging go (1.21.5-r0) (4/5) Purging bash (5.2.21-r0) Executing bash-5.2.21-r0.pre-deinstall (5/5) Purging readline (8.2.7-r0) Executing busybox-1.36.1-r17.trigger OK: 378 MiB in 106 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...