>>> kops: Building testing/kops 1.28.4-r11 (using abuild 3.15.0-r2) started Wed, 09 Jul 2025 19:31:03 +0000 >>> kops: Validating /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/4) Installing kubernetes (1.33.1-r1) (2/4) Installing go (1.24.5-r0) (3/4) Installing bash (5.3.0-r0) bash-5.3.0-r0.post-install: Executing script... (4/4) Installing .makedepends-kops (20250709.193104) busybox-1.37.0-r19.trigger: Executing script... OK: 608 MiB in 110 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz Connecting to distfiles.alpinelinux.org (172.105.82.32:443) wget: server returned error: HTTP/1.1 404 Not Found >>> kops: Fetching kops-1.28.4.tar.gz::https://github.com/kubernetes/kops/archive/v1.28.4.tar.gz Connecting to github.com (140.82.121.3:443) Connecting to codeload.github.com (140.82.121.10:443) saving to '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' kops-1.28.4.tar.gz.p 10.7M --:--:-- ETA kops-1.28.4.tar.gz.p 16.9M --:--:-- ETA kops-1.28.4.tar.gz.p 23.7M --:--:-- ETA kops-1.28.4.tar.gz.p 29.2M --:--:-- ETA kops-1.28.4.tar.gz.p 100% |********************************| 32.7M 0:00:00 ETA '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' saved >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz >>> kops: Checking sha512sums... kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/spf13/pflag v1.0.5 go: downloading k8s.io/kubectl v0.28.1 go: downloading k8s.io/apimachinery v0.28.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading k8s.io/api v0.28.1 go: downloading k8s.io/client-go v0.28.1 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading golang.org/x/crypto v0.14.0 go: downloading go.uber.org/multierr v1.11.0 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/net v0.17.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading golang.org/x/sys v0.13.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading golang.org/x/term v0.13.0 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading golang.org/x/text v0.13.0 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading google.golang.org/protobuf v1.31.0 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/morikuni/aec v1.0.0 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0709 19:32:38.957476 9610 addon.go:250] addon test wants to update all nodes I0709 19:32:38.958749 9610 addon.go:250] addon test wants to update workers nodes I0709 19:32:38.959012 9610 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0709 19:32:38.959277 9610 addon.go:283] installing PKI for "test" I0709 19:32:39.508547 9610 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.77s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.812s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.043s ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN TestCreateClusterMinimal I0709 19:32:40.356628 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.356872 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.356910 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.356954 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.356984 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.357036 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.357074 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.357092 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.357126 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.357152 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.361256 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.361294 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.419881 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:40.420013 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:40.420288 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:40.428905 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.429133 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.429173 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.429236 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.429280 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.429337 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.429384 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.429407 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.429444 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.429466 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.434952 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.434987 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.475816 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:40.475940 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:40.476185 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:40.479908 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.480014 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.480035 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.480055 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.480069 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.480089 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.480109 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.480118 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.480132 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.480144 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.527160 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.527215 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.588512 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:40.588721 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:40.589167 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:40.594705 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.594844 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.594872 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.594900 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.594921 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.594952 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.594978 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.594993 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.595016 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.595031 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.597403 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.597430 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.693513 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:40.693629 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:40.693891 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:40.699272 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.699391 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.699411 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.699433 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.699448 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.699466 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.699485 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.699496 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.699511 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.699521 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.701722 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.701770 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.762730 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:40.762847 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:40.763099 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:40.766553 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.766677 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.766697 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.766718 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.766732 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.766751 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.766769 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.766778 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.766794 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.766807 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.769275 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.769314 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.799934 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:40.800035 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:40.800293 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:40.805605 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.805735 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.805758 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.805782 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.805800 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.805824 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.805846 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.805859 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.805877 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.805890 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.808315 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.808356 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.826890 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:40.827060 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:40.827340 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.48s) === RUN TestCreateClusterHetzner I0709 19:32:40.833990 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.834180 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.834207 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.834235 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.834266 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.834294 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.834317 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.834331 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.834352 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.834377 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.837330 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.837370 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0709 19:32:40.869388 10939 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0709 19:32:40.869426 10939 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0709 19:32:40.873502 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.873600 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.873619 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.873638 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.873651 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.873668 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.873684 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.873692 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.873705 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.873715 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.876365 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.876388 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.915150 10939 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.08s) === RUN TestCreateClusterOpenStack I0709 19:32:40.918496 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:40.918597 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:40.918625 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:40.918642 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:40.918660 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:40.918679 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:40.918694 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:40.918702 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:40.918714 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:40.918723 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:40.921010 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:40.921041 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0709 19:32:40.990983 10939 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0709 19:32:40.991020 10939 new_cluster.go:1373] Cloud Provider ID: "openstack" I0709 19:32:40.992919 10939 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.08s) === RUN TestCreateClusterOpenStackOctavia I0709 19:32:41.003244 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.003438 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.003471 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.003506 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.003556 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.003590 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.003623 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.003644 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.003672 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.003691 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.007057 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.007103 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0709 19:32:41.063325 10939 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0709 19:32:41.063374 10939 new_cluster.go:1373] Cloud Provider ID: "openstack" I0709 19:32:41.065612 10939 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0709 19:32:41.065631 10939 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.07s) === RUN TestCreateClusterOpenStackNoDNS I0709 19:32:41.071879 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.072005 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.072027 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.072054 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.072070 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.072092 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.072110 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.072124 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.072142 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.072155 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.112943 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.112982 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0709 19:32:41.166159 10939 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0709 19:32:41.166191 10939 new_cluster.go:1373] Cloud Provider ID: "openstack" I0709 19:32:41.166231 10939 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0709 19:32:41.166242 10939 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.10s) === RUN TestCreateClusterCilium I0709 19:32:41.171870 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.171983 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.172008 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.172027 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.172042 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.172061 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.172079 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.172088 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.172105 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.172116 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.175840 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.175871 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.279370 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:41.279487 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:41.279693 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.11s) === RUN TestCreateClusterOverride I0709 19:32:41.283270 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.283370 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.283389 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.283407 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.283420 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.283438 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.283455 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.283464 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.283477 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.283487 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.286527 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.286548 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.389466 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:41.389780 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:41.389948 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.12s) === RUN TestCreateClusterKubernetesFeatureGates I0709 19:32:41.398827 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.399019 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.399051 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.399092 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.399120 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.399153 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.399184 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.399203 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.399229 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.399247 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.403724 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.403780 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.492596 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:41.492717 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:41.492962 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.10s) === RUN TestCreateClusterComplex I0709 19:32:41.497267 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.497370 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.497386 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.497404 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.497417 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.497434 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.497450 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.497460 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.497475 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.497485 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.500174 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.500199 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.545453 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:41.545659 10939 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0709 19:32:41.545668 10939 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0709 19:32:41.545672 10939 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0709 19:32:41.545918 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.05s) === RUN TestCreateClusterComplexPrivate I0709 19:32:41.551905 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.552005 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.552021 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.552038 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.552051 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.552069 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.552086 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.552095 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.552115 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.552125 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.554264 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.554283 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.578566 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:41.578835 10939 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0709 19:32:41.578842 10939 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0709 19:32:41.578852 10939 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0709 19:32:41.578855 10939 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0709 19:32:41.578859 10939 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0709 19:32:41.578861 10939 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0709 19:32:41.578866 10939 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0709 19:32:41.578873 10939 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0709 19:32:41.578877 10939 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0709 19:32:41.578879 10939 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0709 19:32:41.579182 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.04s) === RUN TestCreateClusterHA I0709 19:32:41.591224 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.591425 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.591460 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.591501 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.591535 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.591570 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.591601 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.591619 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.591646 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.591667 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.595899 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.595953 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.688437 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:41.688674 10939 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0709 19:32:41.688683 10939 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0709 19:32:41.688686 10939 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0709 19:32:41.688930 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:41.694574 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.694677 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.694694 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.694734 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.694755 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.694773 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.694792 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.694801 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.694815 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.694825 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.698179 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.698213 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.729333 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:41.729682 10939 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0709 19:32:41.729695 10939 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0709 19:32:41.729700 10939 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0709 19:32:41.730026 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.15s) === RUN TestCreateClusterMinimalGCE I0709 19:32:41.738807 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.738954 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.738977 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.739001 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.739020 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.739045 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.739069 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.739082 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.739103 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.739117 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.741976 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.742004 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.796320 10939 new_cluster.go:1373] Cloud Provider ID: "gce" I0709 19:32:41.796434 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0709 19:32:41.800096 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.800208 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.800240 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.800282 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.800303 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.800332 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.800366 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.800389 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.800411 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.800426 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.803321 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.803347 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.906476 10939 new_cluster.go:1373] Cloud Provider ID: "gce" I0709 19:32:41.906561 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.17s) === RUN TestCreateClusterHAGCE I0709 19:32:41.911477 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.911619 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.911642 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.911669 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.911687 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.911710 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.911730 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.911754 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.911774 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.911787 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.916291 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.916356 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.954075 10939 new_cluster.go:1373] Cloud Provider ID: "gce" I0709 19:32:41.954228 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.05s) === RUN TestCreateClusterGCE I0709 19:32:41.964950 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:41.965150 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:41.965181 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:41.965210 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:41.965234 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:41.965263 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:41.965290 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:41.965307 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:41.965331 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:41.965348 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:41.969465 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:41.969519 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.014245 10939 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0709 19:32:42.014312 10939 new_cluster.go:1373] Cloud Provider ID: "gce" I0709 19:32:42.014384 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.06s) === RUN TestCreateClusterHASharedZone I0709 19:32:42.020215 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.020369 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.020395 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.020420 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.020440 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.020467 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.020490 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.020503 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.020525 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.020541 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.024426 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.024463 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0709 19:32:42.070927 10939 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0709 19:32:42.070964 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.071130 10939 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0709 19:32:42.071351 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.06s) === RUN TestCreateClusterHASharedZones I0709 19:32:42.077025 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.077138 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.077166 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.077185 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.077200 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.077226 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.077245 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.077254 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.077270 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.077280 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.080887 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.080947 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0709 19:32:42.163954 10939 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0709 19:32:42.163990 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.164252 10939 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0709 19:32:42.164261 10939 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0709 19:32:42.164507 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.10s) === RUN TestCreateClusterPrivate I0709 19:32:42.179623 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.179824 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.179864 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.179899 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.179927 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.179961 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.179991 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.180010 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.180038 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.180064 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.184949 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.185009 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.268249 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.268428 10939 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0709 19:32:42.268443 10939 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0709 19:32:42.268731 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:42.268757 10939 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.09s) === RUN TestCreateClusterPrivateGCE I0709 19:32:42.273669 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.273790 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.273811 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.273832 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.273849 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.273870 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.273890 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.273900 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.273917 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.273929 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.278273 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.278331 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.331256 10939 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0709 19:32:42.331332 10939 new_cluster.go:1373] Cloud Provider ID: "gce" I0709 19:32:42.331460 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.06s) === RUN TestCreateClusterWithNGWSpecified I0709 19:32:42.338044 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.338188 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.338214 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.338238 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.338258 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.338281 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.338305 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.338318 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.338337 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.338354 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.342315 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.342364 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.400466 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.400674 10939 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0709 19:32:42.400693 10939 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0709 19:32:42.400990 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:42.401028 10939 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.07s) === RUN TestCreateClusterWithINGWSpecified I0709 19:32:42.407623 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.407764 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.407788 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.407813 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.407833 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.407855 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.407876 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.407892 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.407911 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.407924 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.410985 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.411022 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.509137 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.509292 10939 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0709 19:32:42.509302 10939 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0709 19:32:42.509524 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:42.509545 10939 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.11s) === RUN TestCreateClusterSharedVPC I0709 19:32:42.517883 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.518099 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.518135 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.518175 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.518205 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.518243 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.518274 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.518293 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.518320 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.518341 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.523145 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.523201 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.573777 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.573914 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.573964 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.574002 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.574016 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.574053 10939 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0709 19:32:42.574316 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.06s) === RUN TestCreateClusterSharedSubnets I0709 19:32:42.579673 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.579801 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.579824 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.579847 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.579864 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.579886 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.579906 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.579920 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.579939 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.579954 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.583473 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.583523 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.611648 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.611690 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.611794 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.611952 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.611980 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.612008 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.612029 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.612315 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.04s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0709 19:32:42.619889 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.620075 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.620107 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.620145 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.620173 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.620203 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.620229 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.620248 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.620272 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.620292 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.626140 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.626212 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.685058 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:32:42.685125 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.685138 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.685198 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.685290 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.685302 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.685315 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.685322 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.685557 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.07s) === RUN TestCreateClusterPrivateSharedSubnets I0709 19:32:42.689242 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.689373 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.689391 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.689408 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.689431 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.689449 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.689467 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.689476 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.689492 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.689502 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.692978 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.693022 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.765969 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.765997 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.766027 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.766036 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.766080 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.766180 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.766192 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.766204 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:32:42.766211 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:32:42.766432 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.08s) === RUN TestCreateClusterIPv6 I0709 19:32:42.769853 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.769972 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.769990 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.770006 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.770018 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.770035 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.770051 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.770058 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.770073 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.770084 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.773510 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.773535 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.794260 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.794351 10939 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0709 19:32:42.794361 10939 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0709 19:32:42.794572 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.03s) === RUN TestCreateClusterDifferentAMIs I0709 19:32:42.799907 10939 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0709 19:32:42.799926 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.800334 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.800904 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.800952 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.800990 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.801024 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.801060 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.801079 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.801108 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.801128 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.804924 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.804948 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.834174 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.834210 10939 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0709 19:32:42.834218 10939 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0709 19:32:42.834345 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:42.838088 10939 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.04s) === RUN TestCreateClusterKarpenter I0709 19:32:42.838143 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.838235 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.838248 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.838261 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.838272 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.838286 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.838300 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.838308 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.838319 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.838327 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.841064 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.841086 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0709 19:32:42.947831 10939 new_cluster.go:1373] Cloud Provider ID: "aws" I0709 19:32:42.947925 10939 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0709 19:32:42.947932 10939 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0709 19:32:42.947935 10939 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0709 19:32:42.948062 10939 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.11s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0709 19:32:42.951427 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.951499 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.951512 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.951549 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.951560 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.951574 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.951586 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.951595 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.951605 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.951612 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.954715 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.00s) === RUN TestMinimal I0709 19:32:42.955439 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:42.955523 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:42.955536 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:42.955548 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:42.955558 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:42.955573 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:42.955585 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:42.955593 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:42.955604 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:42.955611 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:42.962785 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0709 19:32:42.963764 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:42.963802 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0709 19:32:49.208721 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:52.447190 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:32:52.448202 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:32:52.448252 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:32:52.448391 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:32:52.455335 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:32:52.460198 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:32:52.460598 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:52.461194 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:52.461390 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:52.461476 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:52.461562 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:32:52.461904 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:32:52.462300 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:32:52.467705 10939 target.go:111] Terraform output is in /tmp/test3115735570/out --- PASS: TestMinimal (9.52s) === RUN TestMinimal_v1_23 I0709 19:32:52.472100 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:52.472290 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:52.472325 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:52.472362 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:52.472395 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:52.472433 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:52.472465 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:52.472485 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:52.472513 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:52.472535 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:52.492671 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0709 19:32:52.495479 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:52.495546 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:54.522631 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:54.657031 10939 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0709 19:32:54.659677 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:32:54.659715 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:32:54.659786 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:32:54.662017 10939 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0709 19:32:54.668288 10939 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0709 19:32:54.668624 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:54.668748 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:54.668980 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:54.669201 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:54.669279 10939 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0709 19:32:54.669465 10939 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0709 19:32:54.669614 10939 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0709 19:32:54.675238 10939 target.go:111] Terraform output is in /tmp/test307852537/out --- PASS: TestMinimal_v1_23 (2.21s) === RUN TestMinimal_v1_24 I0709 19:32:54.679580 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:54.679764 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:54.679795 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:54.679828 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:54.679855 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:54.679893 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:54.679924 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:54.679945 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:54.679972 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:54.679993 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:54.700447 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:32:54.703202 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:54.703285 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:56.682661 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:56.802176 10939 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0709 19:32:56.804096 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:32:56.804121 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:32:56.804184 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:32:56.808799 10939 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0709 19:32:56.811304 10939 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0709 19:32:56.811620 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:56.811765 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:56.812006 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:56.812216 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:56.812278 10939 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0709 19:32:56.812458 10939 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0709 19:32:56.812647 10939 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0709 19:32:56.818597 10939 target.go:111] Terraform output is in /tmp/test1582373689/out --- PASS: TestMinimal_v1_24 (2.14s) === RUN TestMinimal_v1_25 I0709 19:32:56.823225 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:56.823407 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:56.823441 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:56.823480 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:56.823508 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:56.823543 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:56.823572 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:56.823591 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:56.823622 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:56.823642 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:56.844122 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0709 19:32:56.846674 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:56.846740 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:58.634321 10939 zones.go:93] ListHostedZonesPages { } I0709 19:32:58.797300 10939 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0709 19:32:58.799320 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:32:58.799347 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:32:58.799429 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:32:58.801319 10939 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0709 19:32:58.804581 10939 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0709 19:32:58.804715 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:58.804863 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:58.805085 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:58.805184 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:58.805240 10939 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0709 19:32:58.805390 10939 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0709 19:32:58.805512 10939 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0709 19:32:58.808293 10939 target.go:111] Terraform output is in /tmp/test1700983754/out --- PASS: TestMinimal_v1_25 (1.99s) === RUN TestMinimal_v1_26 I0709 19:32:58.810912 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.811010 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:58.811027 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:58.811049 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:58.811062 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:58.811082 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:58.811099 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:58.811108 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:58.811121 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:58.811131 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:58.820174 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0709 19:32:58.821385 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:32:58.821420 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:00.375904 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:00.465551 10939 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0709 19:33:00.466789 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:00.466815 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:00.466869 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:00.467653 10939 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0709 19:33:00.473260 10939 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0709 19:33:00.473439 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:00.473586 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:00.473678 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:00.473966 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:00.474039 10939 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0709 19:33:00.474192 10939 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0709 19:33:00.474323 10939 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0709 19:33:00.477683 10939 target.go:111] Terraform output is in /tmp/test3908913487/out --- PASS: TestMinimal_v1_26 (1.67s) === RUN TestMinimal_v1_27 I0709 19:33:00.479757 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:00.479848 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:00.479865 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:00.479887 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:00.479901 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:00.479921 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:00.479939 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:00.479948 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:00.479962 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:00.479974 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:00.489386 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0709 19:33:00.490603 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:00.490640 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:03.847117 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:03.938026 10939 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0709 19:33:03.945471 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:03.945497 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:03.945557 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:03.948067 10939 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0709 19:33:03.951112 10939 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0709 19:33:03.951320 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:03.951542 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:03.951696 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:03.951778 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:03.951823 10939 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0709 19:33:03.951954 10939 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0709 19:33:03.952146 10939 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0709 19:33:03.956008 10939 target.go:111] Terraform output is in /tmp/test1987464103/out --- PASS: TestMinimal_v1_27 (3.48s) === RUN TestMinimal_NoneDNS I0709 19:33:03.958385 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:03.958512 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:03.958534 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:03.958559 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:03.958574 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:03.958592 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:03.958612 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:03.958621 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:03.958635 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:03.958646 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0709 19:33:03.970157 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:03.970198 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:05.352035 10939 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0709 19:33:05.353872 10939 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0709 19:33:05.355302 10939 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0709 19:33:05.355790 10939 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0709 19:33:05.355825 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:05.355870 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:05.355966 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:05.356032 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:05.358730 10939 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0709 19:33:05.358819 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:05.358940 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:05.359096 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:05.359165 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:05.359215 10939 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0709 19:33:05.359343 10939 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0709 19:33:05.359512 10939 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0709 19:33:05.363690 10939 target.go:111] Terraform output is in /tmp/test3539840170/out --- PASS: TestMinimal_NoneDNS (1.41s) === RUN TestHetzner I0709 19:33:05.367526 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:33:07.111277 10939 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0709 19:33:07.114335 10939 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0709 19:33:07.114648 10939 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0709 19:33:07.118782 10939 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0709 19:33:07.119498 10939 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0709 19:33:07.122132 10939 target.go:111] Terraform output is in /tmp/test1445329707/out --- PASS: TestHetzner (1.76s) === RUN TestNvidia I0709 19:33:07.125219 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:07.125401 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:07.125435 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:07.125474 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:07.125502 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:07.125538 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:07.125567 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:07.125588 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:07.125615 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:07.125635 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:07.148830 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:07.151361 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:07.151428 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:09.040952 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:09.174924 10939 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0709 19:33:09.176890 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:09.176925 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:09.176999 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:09.178035 10939 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0709 19:33:09.182655 10939 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0709 19:33:09.182825 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:09.183163 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:09.184169 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:09.184878 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:09.185054 10939 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0709 19:33:09.185454 10939 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0709 19:33:09.185905 10939 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0709 19:33:09.192870 10939 target.go:111] Terraform output is in /tmp/test3535139807/out --- PASS: TestNvidia (2.07s) === RUN TestMinimalGossip I0709 19:33:09.197457 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:09.197662 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:09.197702 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:09.197771 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:09.197816 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:09.197879 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:09.197927 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:09.197965 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:09.198017 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:09.198050 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:09.218635 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:09.218726 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:10.673214 10939 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0709 19:33:10.678292 10939 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0709 19:33:10.685635 10939 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0709 19:33:10.685937 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:10.686185 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:10.686336 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:10.686686 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:10.686807 10939 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0709 19:33:10.687023 10939 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0709 19:33:10.687266 10939 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0709 19:33:10.693043 10939 target.go:111] Terraform output is in /tmp/test3199796774/out --- PASS: TestMinimalGossip (1.50s) === RUN TestMinimalGossipIRSA I0709 19:33:10.697762 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:10.697943 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:10.697978 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:10.698015 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:10.698046 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:10.698082 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:10.698114 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:10.698133 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:10.698161 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:10.698182 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:10.720007 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:10.720079 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:12.171724 10939 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0709 19:33:12.175985 10939 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0709 19:33:12.180553 10939 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0709 19:33:12.180917 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:12.181102 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:12.181278 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:12.181527 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:12.181621 10939 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0709 19:33:12.181877 10939 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0709 19:33:12.182131 10939 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0709 19:33:12.188516 10939 target.go:111] Terraform output is in /tmp/test2090182452/out --- PASS: TestMinimalGossipIRSA (1.50s) === RUN TestMinimalGCE I0709 19:33:12.194003 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:12.195467 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:33:14.066483 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:33:14.066571 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:33:14.066673 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0709 19:33:14.066701 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0709 19:33:14.066721 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0709 19:33:14.066774 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0709 19:33:14.067797 10939 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0709 19:33:14.071049 10939 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0709 19:33:14.075437 10939 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0709 19:33:14.076370 10939 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0709 19:33:14.076711 10939 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0709 19:33:14.080495 10939 target.go:111] Terraform output is in /tmp/test1169765466/out --- PASS: TestMinimalGCE (1.89s) === RUN TestMinimalGCEPrivate I0709 19:33:14.084019 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:14.085563 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:33:15.770767 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:33:15.770850 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:33:15.770956 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0709 19:33:15.770981 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0709 19:33:15.771000 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0709 19:33:15.771054 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0709 19:33:15.772209 10939 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0709 19:33:15.776226 10939 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0709 19:33:15.780406 10939 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0709 19:33:15.781201 10939 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0709 19:33:15.781383 10939 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0709 19:33:15.785353 10939 target.go:111] Terraform output is in /tmp/test700005913/out --- PASS: TestMinimalGCEPrivate (1.70s) === RUN TestMinimalGCEInternalLoadBalancer I0709 19:33:15.788833 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:15.790429 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:33:17.489571 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:33:17.489634 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:33:17.489741 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0709 19:33:17.489764 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0709 19:33:17.489780 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0709 19:33:17.489827 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0709 19:33:17.489861 10939 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0709 19:33:17.490903 10939 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0709 19:33:17.498298 10939 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0709 19:33:17.498737 10939 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0709 19:33:17.499072 10939 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0709 19:33:17.503523 10939 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0709 19:33:17.504321 10939 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0709 19:33:17.504479 10939 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0709 19:33:17.504694 10939 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0709 19:33:17.504918 10939 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0709 19:33:17.509428 10939 target.go:111] Terraform output is in /tmp/test1059995199/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.72s) === RUN TestMinimalGCEPublicLoadBalancer I0709 19:33:17.513342 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:17.514877 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:33:19.226162 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:33:19.226226 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:33:19.226345 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0709 19:33:19.226365 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0709 19:33:19.226385 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0709 19:33:19.226439 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0709 19:33:19.227581 10939 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0709 19:33:19.230556 10939 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0709 19:33:19.235258 10939 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0709 19:33:19.236114 10939 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0709 19:33:19.236299 10939 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0709 19:33:19.240352 10939 target.go:111] Terraform output is in /tmp/test1828923984/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.73s) === RUN TestMinimalGCELongClusterName I0709 19:33:19.243874 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:19.245406 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:33:20.947009 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:33:20.947101 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:33:20.947207 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0709 19:33:20.947230 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0709 19:33:20.947248 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0709 19:33:20.947301 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0709 19:33:20.948365 10939 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0709 19:33:20.950941 10939 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0709 19:33:20.955613 10939 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0709 19:33:20.956730 10939 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0709 19:33:20.956913 10939 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0709 19:33:20.961103 10939 target.go:111] Terraform output is in /tmp/test2976527057/out --- PASS: TestMinimalGCELongClusterName (1.72s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0709 19:33:20.968809 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:20.970446 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:33:22.685097 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:33:22.685149 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:33:22.685246 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0709 19:33:22.685261 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0709 19:33:22.685275 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0709 19:33:22.685316 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0709 19:33:22.685346 10939 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0709 19:33:22.686159 10939 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0709 19:33:22.689480 10939 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0709 19:33:22.689843 10939 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0709 19:33:22.690006 10939 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0709 19:33:22.694336 10939 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0709 19:33:22.695033 10939 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0709 19:33:22.695219 10939 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0709 19:33:22.695363 10939 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0709 19:33:22.695494 10939 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0709 19:33:22.699698 10939 target.go:111] Terraform output is in /tmp/test1465636036/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.73s) === RUN TestMinimalGCEDNSNone I0709 19:33:22.703260 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:22.704781 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:33:24.405093 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:33:24.405153 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:33:24.405260 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0709 19:33:24.405280 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0709 19:33:24.405298 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0709 19:33:24.405352 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0709 19:33:24.405389 10939 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0709 19:33:24.406559 10939 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0709 19:33:24.409263 10939 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0709 19:33:24.409725 10939 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0709 19:33:24.409935 10939 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0709 19:33:24.414138 10939 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0709 19:33:24.415037 10939 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0709 19:33:24.415228 10939 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0709 19:33:24.415379 10939 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0709 19:33:24.415569 10939 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0709 19:33:24.419429 10939 target.go:111] Terraform output is in /tmp/test1615372049/out --- PASS: TestMinimalGCEDNSNone (1.72s) === RUN TestMinimalScaleway I0709 19:33:24.422880 10939 featureflag.go:164] FeatureFlag "Scaleway"=true I0709 19:33:24.422903 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:33:26.407377 10939 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0709 19:33:26.410347 10939 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0709 19:33:26.414511 10939 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0709 19:33:26.415433 10939 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0709 19:33:26.418673 10939 target.go:111] Terraform output is in /tmp/test4015829835/out I0709 19:33:26.425315 10939 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (2.00s) === RUN TestHA I0709 19:33:26.425457 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:26.425704 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:26.425743 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:26.425794 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:26.425827 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:26.425865 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:26.425901 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:26.425923 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:26.425953 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:26.425979 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:26.452070 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:26.455012 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:26.455106 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:26.455151 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:26.455190 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:27.741129 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:27.890966 10939 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0709 19:33:27.892461 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:27.892511 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:27.892635 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:27.894629 10939 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0709 19:33:27.905625 10939 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0709 19:33:27.905893 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:27.906076 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:27.906335 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:27.906541 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:27.906623 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:27.906783 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:27.906936 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:27.907041 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:27.907148 10939 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0709 19:33:27.907538 10939 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0709 19:33:27.907878 10939 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0709 19:33:27.915666 10939 target.go:111] Terraform output is in /tmp/test905038406/out --- PASS: TestHA (1.50s) === RUN TestHighAvailabilityGCE I0709 19:33:27.921416 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:27.923141 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:33:29.633263 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:33:29.633338 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:33:29.633436 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0709 19:33:29.633452 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0709 19:33:29.633466 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0709 19:33:29.633512 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0709 19:33:29.633564 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0709 19:33:29.633612 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0709 19:33:29.634846 10939 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0709 19:33:29.641707 10939 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0709 19:33:29.648017 10939 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0709 19:33:29.648838 10939 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0709 19:33:29.649161 10939 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0709 19:33:29.654582 10939 target.go:111] Terraform output is in /tmp/test1116630998/out --- PASS: TestHighAvailabilityGCE (1.74s) === RUN TestComplex I0709 19:33:29.659135 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:29.659359 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:29.659397 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:29.659484 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:29.659515 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:29.659556 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:29.659591 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:29.659612 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:29.659668 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:29.659693 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:29.685370 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:33:29.688474 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:29.688548 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:31.318349 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:31.480704 10939 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0709 19:33:31.483933 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:31.483969 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:31.484065 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:31.487083 10939 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0709 19:33:31.491939 10939 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0709 19:33:31.492636 10939 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0709 19:33:31.492840 10939 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0709 19:33:31.492884 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:31.492946 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:31.493055 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:31.493137 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:31.497284 10939 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0709 19:33:31.497422 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:31.497609 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:31.498045 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:31.498118 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:31.498181 10939 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0709 19:33:31.498393 10939 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0709 19:33:31.498685 10939 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0709 19:33:31.505890 10939 target.go:111] Terraform output is in /tmp/test2903136447/out I0709 19:33:31.510640 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:31.510822 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:31.510878 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:31.510917 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:31.510946 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:31.510983 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:31.511020 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:31.511042 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:31.511072 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:31.511096 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:31.531426 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:33:31.534119 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:31.534178 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:32.828812 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:33.002438 10939 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0709 19:33:33.003064 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:33.003103 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:33.003190 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:33.005088 10939 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0709 19:33:33.007676 10939 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0709 19:33:33.008258 10939 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0709 19:33:33.008569 10939 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0709 19:33:33.008637 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:33.008706 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:33.008799 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:33.008864 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:33.013492 10939 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0709 19:33:33.013648 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:33.013851 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:33.014256 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:33.014324 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:33.014384 10939 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0709 19:33:33.014621 10939 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0709 19:33:33.014892 10939 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0709 19:33:33.021995 10939 target.go:111] Terraform output is in /tmp/test3584257408/out --- PASS: TestComplex (3.37s) === RUN TestCompress I0709 19:33:33.026682 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:33.026884 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:33.026920 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:33.026958 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:33.026987 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:33.027024 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:33.027054 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:33.027075 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:33.027103 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:33.027126 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:33.050562 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:33.053149 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:33.053220 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:34.385654 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:34.528068 10939 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0709 19:33:34.528937 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:34.528978 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:34.529084 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:34.530941 10939 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0709 19:33:34.535586 10939 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0709 19:33:34.535958 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:34.536145 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:34.537405 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:34.537486 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:34.537557 10939 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0709 19:33:34.537783 10939 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0709 19:33:34.538025 10939 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0709 19:33:34.543381 10939 target.go:111] Terraform output is in /tmp/test1973195808/out --- PASS: TestCompress (1.52s) === RUN TestExternalPolicies I0709 19:33:34.548565 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:34.548838 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:34.548891 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:34.548976 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:34.549034 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:34.549122 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:34.549194 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:34.549255 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:34.549329 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:34.549373 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:34.574427 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:34.577364 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:34.577442 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:35.849808 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:35.999073 10939 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0709 19:33:36.000292 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:36.000321 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:36.000406 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:36.002492 10939 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0709 19:33:36.004966 10939 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0709 19:33:36.005697 10939 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0709 19:33:36.005828 10939 api.go:53] PageSize not implemented W0709 19:33:36.005965 10939 api.go:53] PageSize not implemented I0709 19:33:36.010196 10939 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0709 19:33:36.010477 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:36.010700 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:36.011044 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:36.011110 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:36.011168 10939 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0709 19:33:36.011416 10939 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0709 19:33:36.011716 10939 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0709 19:33:36.018582 10939 target.go:111] Terraform output is in /tmp/test3821740939/out --- PASS: TestExternalPolicies (1.48s) === RUN TestMinimalIPv6 I0709 19:33:36.027565 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:36.027781 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:36.027818 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:36.027863 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:36.027897 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:36.027936 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:36.027975 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:36.027996 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:36.028025 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:36.028049 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:36.051245 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:33:36.054258 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:36.054324 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:37.346679 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:37.494427 10939 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0709 19:33:37.495975 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:37.496009 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:37.496088 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:37.497565 10939 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0709 19:33:37.499755 10939 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0709 19:33:37.500322 10939 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0709 19:33:37.500650 10939 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0709 19:33:37.500786 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:37.500860 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:37.500895 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:37.500934 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:37.509725 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:33:37.509941 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:37.510172 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:37.510541 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:37.510618 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:37.510685 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:33:37.510902 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:33:37.511178 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:33:37.519044 10939 target.go:111] Terraform output is in /tmp/test351448280/out --- PASS: TestMinimalIPv6 (1.50s) === RUN TestMinimalIPv6Calico I0709 19:33:37.523913 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:37.524107 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:37.524141 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:37.524180 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:37.524215 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:37.524253 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:37.524287 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:37.524308 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:37.524336 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:37.524359 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:37.547461 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:33:37.550475 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:37.550546 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:38.867577 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:39.224281 10939 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0709 19:33:39.225218 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:39.225259 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:39.225349 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:39.227133 10939 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0709 19:33:39.234016 10939 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0709 19:33:39.235821 10939 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0709 19:33:39.236166 10939 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0709 19:33:39.236269 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:39.236350 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:39.236470 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:39.236543 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:39.240850 10939 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0709 19:33:39.241022 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:39.241229 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:39.241615 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:39.241694 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:39.241796 10939 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0709 19:33:39.242065 10939 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0709 19:33:39.242355 10939 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0709 19:33:39.250343 10939 target.go:111] Terraform output is in /tmp/test3994279452/out --- PASS: TestMinimalIPv6Calico (1.73s) === RUN TestMinimalIPv6Cilium I0709 19:33:39.255839 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:39.256038 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:39.256073 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:39.256111 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:39.256141 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:39.256181 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:39.256215 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:39.256235 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:39.256263 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:39.256286 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:39.279601 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:33:39.282790 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:39.282851 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:40.618823 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:40.795405 10939 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0709 19:33:40.795577 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:40.795595 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:40.795657 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:40.798233 10939 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0709 19:33:40.800753 10939 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0709 19:33:40.801510 10939 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0709 19:33:40.801908 10939 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0709 19:33:40.801995 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:40.802072 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:40.802171 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:40.802227 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:40.810570 10939 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0709 19:33:40.810820 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:40.811062 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:40.811438 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:40.811548 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:40.811661 10939 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0709 19:33:40.812133 10939 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0709 19:33:40.812616 10939 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0709 19:33:40.820410 10939 target.go:111] Terraform output is in /tmp/test269386210/out --- PASS: TestMinimalIPv6Cilium (1.57s) === RUN TestMinimalIPv6NoSubnetPrefix I0709 19:33:40.825474 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:40.825680 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:40.825716 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:40.825762 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:40.825794 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:40.825832 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:40.825865 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:40.825885 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:40.825915 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:40.825937 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:40.849269 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:33:40.852810 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:40.852883 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:42.144473 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:42.292717 10939 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0709 19:33:42.294083 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:42.294119 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:42.294203 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:42.295996 10939 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0709 19:33:42.298551 10939 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0709 19:33:42.299163 10939 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0709 19:33:42.299641 10939 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0709 19:33:42.299743 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:42.299816 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:42.299940 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:33:42.300024 10939 loadbalancers.go:35] PageSize not implemented I0709 19:33:42.304305 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:33:42.304455 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:42.304559 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:42.304804 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:42.305254 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:42.305362 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:33:42.305622 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:33:42.305905 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:33:42.313017 10939 target.go:111] Terraform output is in /tmp/test1393326002/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.49s) === RUN TestMinimalWarmPool I0709 19:33:42.317957 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:42.318162 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:42.318199 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:42.318240 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:42.318271 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:42.318311 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:42.318345 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:42.318366 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:42.318395 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:42.318440 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:42.338470 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:42.341347 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:42.341411 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:43.663229 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:43.847012 10939 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0709 19:33:43.852421 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:43.852452 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:43.852529 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:43.854710 10939 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0709 19:33:43.859407 10939 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0709 19:33:43.859728 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:43.859922 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:43.860349 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:43.860447 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:43.860569 10939 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0709 19:33:43.860840 10939 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0709 19:33:43.861090 10939 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0709 19:33:43.867158 10939 target.go:111] Terraform output is in /tmp/test1607870856/out --- PASS: TestMinimalWarmPool (1.55s) === RUN TestMinimalEtcd I0709 19:33:43.872182 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:43.872389 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:43.872425 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:43.872466 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:43.872498 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:43.872536 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:43.872569 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:43.872590 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:43.872619 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:43.872642 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:43.893829 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:43.896549 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:43.896611 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:45.176528 10939 zones.go:93] ListHostedZonesPages { } W0709 19:33:45.312049 10939 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0709 19:33:45.312097 10939 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0709 19:33:45.314314 10939 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0709 19:33:45.324217 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:33:45.324948 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:45.324990 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:45.325119 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:45.327027 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:33:45.336375 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:33:45.336680 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:45.337061 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:45.337278 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:45.337695 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:45.337788 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:33:45.338162 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:33:45.338541 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:33:45.344819 10939 target.go:111] Terraform output is in /tmp/test5070722/out --- PASS: TestMinimalEtcd (1.48s) === RUN TestMinimalGp3 I0709 19:33:45.349567 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:45.349776 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:45.349811 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:45.349851 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:45.349884 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:45.349922 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:45.349956 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:45.349977 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:45.350006 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:45.350031 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:45.370216 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:45.372932 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:45.372998 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:46.677733 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:46.826796 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:33:46.828447 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:46.828478 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:46.828560 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:46.830175 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:33:46.834889 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:33:46.835247 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:46.835444 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:46.835588 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:46.836102 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:46.836209 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:33:46.836473 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:33:46.836679 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:33:46.842201 10939 target.go:111] Terraform output is in /tmp/test1676719847/out --- PASS: TestMinimalGp3 (1.50s) === RUN TestMinimalLongClusterName I0709 19:33:46.846751 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:46.846949 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:46.846990 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:46.847028 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:46.847057 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:46.847093 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:46.847126 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:46.847147 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:46.847175 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:46.847199 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:46.869943 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:46.872459 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:46.872527 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0709 19:33:48.149568 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:48.300449 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:33:48.300888 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:48.300928 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:48.301013 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:48.305817 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:33:48.312836 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:33:48.313179 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:48.313626 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:48.313699 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:48.314280 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:48.314373 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:33:48.314619 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:33:48.314906 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:33:48.321051 10939 target.go:111] Terraform output is in /tmp/test3059036217/out --- PASS: TestMinimalLongClusterName (1.48s) === RUN TestExistingSG I0709 19:33:48.325795 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:48.326014 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:48.326048 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:48.326089 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:48.326121 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:48.326161 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:48.326195 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:48.326216 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:48.326245 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:48.326270 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:48.352061 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:48.355044 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:48.355141 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:48.355181 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:48.355219 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.672205 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:49.830632 10939 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0709 19:33:49.831339 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:49.831377 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:49.831458 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:49.833593 10939 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0709 19:33:49.839089 10939 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0709 19:33:49.842112 10939 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0709 19:33:49.842210 10939 api.go:53] PageSize not implemented W0709 19:33:49.842323 10939 api.go:53] PageSize not implemented W0709 19:33:49.842431 10939 api.go:53] PageSize not implemented W0709 19:33:49.842550 10939 api.go:53] PageSize not implemented I0709 19:33:49.847017 10939 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0709 19:33:49.847170 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.847339 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.847555 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.847635 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.847795 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.847981 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.848056 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.848182 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.848281 10939 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0709 19:33:49.848579 10939 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0709 19:33:49.848862 10939 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0709 19:33:49.857495 10939 target.go:111] Terraform output is in /tmp/test681965088/out --- PASS: TestExistingSG (1.54s) === RUN TestBastionAdditionalUserData I0709 19:33:49.863248 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:49.863453 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:49.863489 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:49.863530 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:49.863560 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:49.863597 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:49.863632 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:49.863655 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:49.863684 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:49.863707 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:49.886167 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:49.889201 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.889260 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:49.889296 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:51.194787 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:51.346005 10939 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0709 19:33:51.347129 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:51.347168 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:51.347247 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:51.349303 10939 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0709 19:33:51.352064 10939 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0709 19:33:51.352794 10939 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0709 19:33:51.352898 10939 api.go:53] PageSize not implemented W0709 19:33:51.352935 10939 api.go:53] PageSize not implemented W0709 19:33:51.353045 10939 api.go:53] PageSize not implemented I0709 19:33:51.357066 10939 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0709 19:33:51.357249 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:51.357362 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:51.358730 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:51.359184 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:51.359824 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:51.360096 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:51.360394 10939 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0709 19:33:51.361221 10939 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0709 19:33:51.362849 10939 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0709 19:33:51.371137 10939 target.go:111] Terraform output is in /tmp/test2691542223/out --- PASS: TestBastionAdditionalUserData (1.51s) === RUN TestPrivateFlannel I0709 19:33:51.376348 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:51.376550 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:51.376608 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:51.376652 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:51.376689 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:51.376728 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:51.376760 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:51.376779 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:51.376809 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:51.376832 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:51.398954 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:33:51.401650 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:51.401714 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:51.401778 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:52.687166 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:52.853809 10939 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0709 19:33:52.855592 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:52.855626 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:52.855702 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:52.857844 10939 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0709 19:33:52.860708 10939 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0709 19:33:52.861146 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:52.861288 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:52.861698 10939 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0709 19:33:52.861778 10939 api.go:53] PageSize not implemented W0709 19:33:52.861833 10939 api.go:53] PageSize not implemented I0709 19:33:52.865952 10939 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0709 19:33:52.866095 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:52.866278 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:52.866677 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:52.866751 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:52.866822 10939 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0709 19:33:52.867048 10939 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0709 19:33:52.868392 10939 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0709 19:33:52.879968 10939 target.go:111] Terraform output is in /tmp/test3300057904/out --- PASS: TestPrivateFlannel (1.51s) === RUN TestPrivateCalico I0709 19:33:52.885183 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:52.885405 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:52.885454 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:52.885524 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:52.885574 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:52.885643 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:52.885686 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:52.885731 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:52.885785 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:52.885822 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:52.908479 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:33:52.911395 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:52.911475 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:52.911526 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:54.250203 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:54.618081 10939 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0709 19:33:54.619160 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:54.619202 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:54.619284 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:54.621902 10939 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0709 19:33:54.628391 10939 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0709 19:33:54.629308 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:54.629483 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:54.629938 10939 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0709 19:33:54.630046 10939 api.go:53] PageSize not implemented W0709 19:33:54.630154 10939 api.go:53] PageSize not implemented I0709 19:33:54.634394 10939 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0709 19:33:54.634553 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:54.634642 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:54.635004 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:54.635279 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:54.635379 10939 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0709 19:33:54.635648 10939 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0709 19:33:54.635882 10939 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0709 19:33:54.644156 10939 target.go:111] Terraform output is in /tmp/test4108119612/out --- PASS: TestPrivateCalico (1.76s) === RUN TestPrivateCilium I0709 19:33:54.649958 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:54.650169 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:54.650203 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:54.650241 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:54.650270 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:54.650309 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:54.650343 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:54.650366 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:54.650395 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:54.650417 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:54.673226 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:54.676127 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:54.676190 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:54.676230 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:55.952131 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:56.126248 10939 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0709 19:33:56.128023 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:56.128064 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:56.128188 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:56.132149 10939 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0709 19:33:56.137390 10939 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0709 19:33:56.138090 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:56.138264 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:56.138472 10939 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0709 19:33:56.138613 10939 api.go:53] PageSize not implemented W0709 19:33:56.138725 10939 api.go:53] PageSize not implemented I0709 19:33:56.143098 10939 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0709 19:33:56.143320 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:56.143440 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:56.143709 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:56.144057 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:56.144146 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:33:56.144398 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:33:56.144690 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:33:56.152243 10939 target.go:111] Terraform output is in /tmp/test904698092/out --- PASS: TestPrivateCilium (1.51s) === RUN TestPrivateCilium2 I0709 19:33:56.157327 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:56.157534 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:56.157570 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:56.157617 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:56.157648 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:56.157684 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:56.157781 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:56.157804 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:56.157831 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:56.157854 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:56.180325 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:33:56.183344 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:56.183409 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:56.183448 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:57.537941 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:58.115879 10939 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0709 19:33:58.116507 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:58.116538 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:58.116626 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:58.119614 10939 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0709 19:33:58.122365 10939 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0709 19:33:58.122771 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:58.122918 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:58.123082 10939 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0709 19:33:58.123153 10939 api.go:53] PageSize not implemented W0709 19:33:58.123188 10939 api.go:53] PageSize not implemented I0709 19:33:58.127551 10939 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0709 19:33:58.127708 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:58.127887 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:58.128065 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:58.128529 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:58.128630 10939 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0709 19:33:58.128893 10939 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0709 19:33:58.129146 10939 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0709 19:33:58.137500 10939 target.go:111] Terraform output is in /tmp/test3416360034/out --- PASS: TestPrivateCilium2 (1.99s) === RUN TestPrivateCiliumAdvanced I0709 19:33:58.151056 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:58.151288 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:58.151324 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:58.151367 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:58.151399 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:58.151437 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:58.151472 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:58.151494 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:58.151522 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:58.151545 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:58.177116 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:58.179952 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:58.180009 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:58.180043 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:59.450687 10939 zones.go:93] ListHostedZonesPages { } I0709 19:33:59.640404 10939 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0709 19:33:59.642501 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:33:59.642542 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:33:59.642630 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:33:59.644442 10939 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0709 19:33:59.647264 10939 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0709 19:33:59.647640 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:59.647785 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:59.647876 10939 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0709 19:33:59.647957 10939 api.go:53] PageSize not implemented W0709 19:33:59.648071 10939 api.go:53] PageSize not implemented I0709 19:33:59.653217 10939 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0709 19:33:59.653476 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:59.653710 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:59.654094 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:59.654163 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:59.654247 10939 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0709 19:33:59.654514 10939 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0709 19:33:59.654701 10939 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0709 19:33:59.667732 10939 target.go:111] Terraform output is in /tmp/test864917662/out --- PASS: TestPrivateCiliumAdvanced (1.52s) === RUN TestPrivateCiliumENI I0709 19:33:59.674101 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:59.674313 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:59.674350 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:59.674394 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:59.674424 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:59.674459 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:59.674492 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:59.674510 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:59.674540 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:59.674563 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:59.695912 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:33:59.698774 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:59.698835 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:33:59.698873 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:00.989180 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:01.167824 10939 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0709 19:34:01.170283 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:01.170314 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:01.170394 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:01.171473 10939 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0709 19:34:01.174271 10939 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0709 19:34:01.174522 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:01.174689 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:01.174939 10939 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0709 19:34:01.175021 10939 api.go:53] PageSize not implemented W0709 19:34:01.175116 10939 api.go:53] PageSize not implemented I0709 19:34:01.179379 10939 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0709 19:34:01.179522 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:01.179681 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:01.179870 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:01.180247 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:01.180346 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:34:01.180577 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:34:01.180827 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:34:01.187750 10939 target.go:111] Terraform output is in /tmp/test1071834817/out --- PASS: TestPrivateCiliumENI (1.52s) === RUN TestPrivateCanal I0709 19:34:01.192864 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:01.193068 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:01.193104 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:01.193150 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:01.193180 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:01.193219 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:01.193253 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:01.193273 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:01.193302 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:01.193325 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:01.214480 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:34:01.217261 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:01.217324 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:01.217364 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:02.490310 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:02.841684 10939 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0709 19:34:02.842710 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:02.842762 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:02.842879 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:02.845061 10939 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0709 19:34:02.847647 10939 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0709 19:34:02.847965 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:02.848152 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:02.849448 10939 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0709 19:34:02.849555 10939 api.go:53] PageSize not implemented W0709 19:34:02.849979 10939 api.go:53] PageSize not implemented I0709 19:34:02.857622 10939 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0709 19:34:02.857825 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:02.858131 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:02.858500 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:02.858593 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:02.858715 10939 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0709 19:34:02.858993 10939 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0709 19:34:02.859259 10939 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0709 19:34:02.867706 10939 target.go:111] Terraform output is in /tmp/test3372871523/out --- PASS: TestPrivateCanal (1.68s) === RUN TestPrivateKopeio I0709 19:34:02.873647 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:02.873858 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:02.873899 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:02.873943 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:02.873973 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:02.874011 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:02.874046 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:02.874068 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:02.874103 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:02.874127 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:02.897829 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:02.900426 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:02.900488 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:02.900528 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:04.169631 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:04.325950 10939 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0709 19:34:04.328096 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:04.328127 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:04.328205 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:04.329487 10939 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0709 19:34:04.332374 10939 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0709 19:34:04.332803 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:04.332982 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:04.333088 10939 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0709 19:34:04.333215 10939 api.go:53] PageSize not implemented W0709 19:34:04.333334 10939 api.go:53] PageSize not implemented I0709 19:34:04.337623 10939 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0709 19:34:04.337867 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:04.338035 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:04.338241 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:04.338633 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:04.338741 10939 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0709 19:34:04.339070 10939 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0709 19:34:04.339304 10939 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0709 19:34:04.346082 10939 target.go:111] Terraform output is in /tmp/test1960351049/out --- PASS: TestPrivateKopeio (1.48s) === RUN TestUnmanaged I0709 19:34:04.355036 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:04.355281 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:04.355317 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:04.355362 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:04.355393 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:04.355428 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:04.355462 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:04.355483 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:04.355511 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:04.355533 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:04.378697 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:04.381675 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:04.381754 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:04.381801 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:05.672887 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:05.806675 10939 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0709 19:34:05.808584 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:05.808617 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:05.808693 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:05.810245 10939 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0709 19:34:05.816074 10939 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0709 19:34:05.817096 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:05.817214 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:05.817283 10939 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0709 19:34:05.817338 10939 api.go:53] PageSize not implemented W0709 19:34:05.817372 10939 api.go:53] PageSize not implemented I0709 19:34:05.821612 10939 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0709 19:34:05.821778 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:05.821976 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:05.822345 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:05.822419 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:05.822491 10939 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0709 19:34:05.822743 10939 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0709 19:34:05.822974 10939 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0709 19:34:05.829824 10939 target.go:111] Terraform output is in /tmp/test1815988461/out --- PASS: TestUnmanaged (1.48s) === RUN TestPrivateSharedSubnet I0709 19:34:05.834544 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:05.834741 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:05.834776 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:05.834817 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:05.834846 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:05.834881 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:05.834913 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:05.834934 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:05.834964 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:05.834984 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:05.853573 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:05.855851 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:05.855903 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:05.855934 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:07.138536 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:07.292123 10939 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0709 19:34:07.293976 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:07.294009 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:07.294093 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:07.295354 10939 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0709 19:34:07.295514 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:34:07.297860 10939 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0709 19:34:07.298038 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:07.298156 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:07.298501 10939 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0709 19:34:07.298576 10939 api.go:53] PageSize not implemented W0709 19:34:07.298689 10939 api.go:53] PageSize not implemented I0709 19:34:07.302986 10939 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0709 19:34:07.303166 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:07.303270 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:07.303615 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:07.303745 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:07.303844 10939 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0709 19:34:07.304061 10939 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0709 19:34:07.304295 10939 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0709 19:34:07.311090 10939 target.go:111] Terraform output is in /tmp/test2633111897/out --- PASS: TestPrivateSharedSubnet (1.48s) === RUN TestPrivateSharedIP I0709 19:34:07.316169 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:07.316376 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:07.316411 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:07.316450 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:07.316481 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:07.316517 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:07.316551 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:07.316571 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:07.316599 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:07.316619 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:07.344224 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:07.347252 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:07.347323 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:07.347366 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:08.676491 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:08.824437 10939 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0709 19:34:08.827128 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:08.827164 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:08.827647 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:08.832723 10939 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0709 19:34:08.833248 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:34:08.835838 10939 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0709 19:34:08.836113 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:08.836302 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:08.836534 10939 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0709 19:34:08.836636 10939 api.go:53] PageSize not implemented W0709 19:34:08.836742 10939 api.go:53] PageSize not implemented I0709 19:34:08.840950 10939 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0709 19:34:08.841167 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:08.841348 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:08.841568 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:08.842088 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:08.842191 10939 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0709 19:34:08.842457 10939 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0709 19:34:08.842690 10939 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0709 19:34:08.850108 10939 target.go:111] Terraform output is in /tmp/test3412582821/out --- PASS: TestPrivateSharedIP (1.54s) === RUN TestPrivateDns1 I0709 19:34:08.855311 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:08.855512 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:08.855547 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:08.855589 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:08.855619 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:08.855663 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:08.855697 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:08.855717 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:08.855746 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:08.855768 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0709 19:34:08.881236 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:08.881297 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:08.881335 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:10.392201 10939 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0709 19:34:10.398108 10939 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0709 19:34:10.398756 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0709 19:34:10.398905 10939 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0709 19:34:10.399026 10939 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0709 19:34:10.399045 10939 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0709 19:34:10.401559 10939 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0709 19:34:10.402204 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:10.402355 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:10.404243 10939 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0709 19:34:10.404325 10939 api.go:53] PageSize not implemented W0709 19:34:10.404390 10939 api.go:53] PageSize not implemented I0709 19:34:10.408941 10939 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0709 19:34:10.409206 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:10.409402 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:10.409778 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:10.409829 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:10.409918 10939 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0709 19:34:10.410149 10939 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0709 19:34:10.410392 10939 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0709 19:34:10.417610 10939 target.go:111] Terraform output is in /tmp/test1804026969/out --- PASS: TestPrivateDns1 (1.57s) === RUN TestPrivateDns2 I0709 19:34:10.422450 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:10.422668 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:10.422702 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:10.422744 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:10.422773 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:10.422808 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:10.422840 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:10.422860 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:10.422890 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:10.422911 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:10.447236 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:10.447301 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:10.447342 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:11.893980 10939 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0709 19:34:11.897151 10939 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0709 19:34:11.897369 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0709 19:34:11.897399 10939 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0709 19:34:11.897480 10939 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0709 19:34:11.897495 10939 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0709 19:34:11.897515 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:34:11.897771 10939 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0709 19:34:11.898071 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:11.898221 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:11.900510 10939 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0709 19:34:11.900598 10939 api.go:53] PageSize not implemented W0709 19:34:11.900656 10939 api.go:53] PageSize not implemented I0709 19:34:11.907027 10939 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0709 19:34:11.907503 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:11.907816 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:11.909190 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:11.909547 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:11.910476 10939 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0709 19:34:11.910771 10939 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0709 19:34:11.911049 10939 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0709 19:34:11.918524 10939 target.go:111] Terraform output is in /tmp/test2859844515/out --- PASS: TestPrivateDns2 (1.50s) === RUN TestDiscoveryFeatureGate I0709 19:34:11.923528 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:11.923724 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:11.923758 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:11.923798 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:11.923826 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:11.923860 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:11.923927 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:11.923949 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:11.923977 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:11.924000 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:11.943560 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:34:11.946325 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:11.946391 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:13.257105 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:13.440157 10939 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0709 19:34:13.443953 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:13.443994 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:13.444170 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:13.448513 10939 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0709 19:34:13.453278 10939 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0709 19:34:13.453622 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:13.453873 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:13.454246 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:13.454333 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:13.454421 10939 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0709 19:34:13.454625 10939 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0709 19:34:13.454898 10939 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0709 19:34:13.462154 10939 target.go:111] Terraform output is in /tmp/test1571483337/out --- PASS: TestDiscoveryFeatureGate (1.54s) === RUN TestVFSServiceAccountIssuerDiscovery I0709 19:34:13.468145 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:13.468345 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:13.468395 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:13.468463 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:13.468494 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:13.468531 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:13.468566 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:13.468587 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:13.468616 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:13.468639 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:13.492253 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:13.494802 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:13.494876 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:14.792220 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:14.937817 10939 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0709 19:34:14.939010 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:14.939042 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:14.939127 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:14.940982 10939 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0709 19:34:14.945487 10939 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0709 19:34:14.945816 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:14.946007 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:14.946191 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:14.946568 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:14.946666 10939 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0709 19:34:14.946896 10939 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0709 19:34:14.947232 10939 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0709 19:34:14.957506 10939 target.go:111] Terraform output is in /tmp/test3346328393/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.49s) === RUN TestAWSLBController I0709 19:34:14.962361 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:14.962553 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:14.962587 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:14.962627 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:14.962659 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:14.962700 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:14.962733 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:14.962754 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:14.962781 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:14.962804 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:14.983645 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:14.986341 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:14.986411 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:16.311795 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:16.914819 10939 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0709 19:34:16.918388 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:16.918482 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:16.918635 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:16.922936 10939 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0709 19:34:16.927443 10939 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0709 19:34:16.927922 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:16.928124 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:16.928366 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:16.928710 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:16.928807 10939 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0709 19:34:16.929066 10939 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0709 19:34:16.929312 10939 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0709 19:34:16.937324 10939 target.go:111] Terraform output is in /tmp/test1140802356/out --- PASS: TestAWSLBController (1.99s) === RUN TestManyAddons I0709 19:34:16.950354 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:16.950590 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:16.950627 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:16.950673 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:16.950705 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:16.950743 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:16.950778 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:16.950797 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:16.950826 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:16.950848 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:16.975232 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:16.978051 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:16.978117 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:18.305140 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:19.004805 10939 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0709 19:34:19.005893 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:19.005924 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:19.006005 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:19.014039 10939 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0709 19:34:19.018868 10939 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0709 19:34:19.019189 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:19.019488 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:19.019899 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:19.019977 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:19.020040 10939 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0709 19:34:19.020288 10939 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0709 19:34:19.020496 10939 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0709 19:34:19.027775 10939 target.go:111] Terraform output is in /tmp/test3126966888/out --- PASS: TestManyAddons (2.09s) === RUN TestManyAddonsCCMIRSA I0709 19:34:19.036711 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:19.036915 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:19.036960 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:19.037002 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:19.037033 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:19.037072 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:19.037107 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:19.037128 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:19.037157 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:19.037181 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:19.061652 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:19.065475 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:19.065549 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:20.375210 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:21.114992 10939 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0709 19:34:21.118519 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:21.118600 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:21.118721 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:21.125544 10939 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0709 19:34:21.130292 10939 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0709 19:34:21.130495 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:21.130894 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:21.131046 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:21.131474 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:21.131559 10939 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0709 19:34:21.131834 10939 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0709 19:34:21.132155 10939 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0709 19:34:21.141878 10939 target.go:111] Terraform output is in /tmp/test3060156826/out --- PASS: TestManyAddonsCCMIRSA (2.12s) === RUN TestManyAddonsCCMIRSA23 I0709 19:34:21.157299 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:21.157525 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:21.157562 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:21.157604 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:21.157635 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:21.157673 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:21.157708 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:21.157728 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:21.157755 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:21.157791 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:21.182077 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0709 19:34:21.185577 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:21.185670 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:22.626217 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:23.371720 10939 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0709 19:34:23.372326 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:23.372367 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:23.372494 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:23.375548 10939 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0709 19:34:23.380241 10939 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0709 19:34:23.380665 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:23.380820 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:23.381201 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:23.381288 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:23.381390 10939 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0709 19:34:23.382988 10939 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0709 19:34:23.383603 10939 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0709 19:34:23.398000 10939 target.go:111] Terraform output is in /tmp/test3045065530/out --- PASS: TestManyAddonsCCMIRSA23 (2.25s) === RUN TestManyAddonsCCMIRSA24 I0709 19:34:23.409975 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:23.410179 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:23.410215 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:23.410266 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:23.410307 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:23.410348 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:23.410381 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:23.410401 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:23.410433 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:23.410454 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:23.431206 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:34:23.433755 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:23.433812 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:24.705748 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:25.435317 10939 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0709 19:34:25.436620 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:25.436653 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:25.436741 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:25.443482 10939 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0709 19:34:25.449759 10939 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0709 19:34:25.450174 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:25.450396 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:25.450811 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:25.450887 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:25.450958 10939 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0709 19:34:25.451236 10939 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0709 19:34:25.451516 10939 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0709 19:34:25.461705 10939 target.go:111] Terraform output is in /tmp/test3013130415/out --- PASS: TestManyAddonsCCMIRSA24 (2.06s) === RUN TestManyAddonsCCMIRSA25 I0709 19:34:25.473523 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:25.473731 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:25.473768 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:25.473809 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:25.473840 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:25.473880 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:25.473916 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:25.473937 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:25.473966 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:25.473989 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:25.499410 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0709 19:34:25.502574 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:25.502656 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:26.799493 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:27.520168 10939 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0709 19:34:27.520793 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:27.520841 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:27.520964 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:27.523673 10939 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0709 19:34:27.528485 10939 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0709 19:34:27.528754 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:27.528961 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:27.529148 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:27.531021 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:27.531187 10939 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0709 19:34:27.531622 10939 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0709 19:34:27.532635 10939 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0709 19:34:27.543701 10939 target.go:111] Terraform output is in /tmp/test318393032/out --- PASS: TestManyAddonsCCMIRSA25 (2.08s) === RUN TestManyAddonsCCMIRSA26 I0709 19:34:27.555812 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:27.556024 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:27.556061 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:27.556103 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:27.556137 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:27.556176 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:27.556213 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:27.556236 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:27.556266 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:27.556289 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:27.578156 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0709 19:34:27.580993 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:27.581053 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:28.941033 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:29.685766 10939 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0709 19:34:29.686156 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:29.686190 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:29.686273 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:29.690038 10939 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0709 19:34:29.694843 10939 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0709 19:34:29.695261 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:29.695487 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:29.695936 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:29.696020 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:29.696102 10939 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0709 19:34:29.696403 10939 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0709 19:34:29.696683 10939 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0709 19:34:29.705614 10939 target.go:111] Terraform output is in /tmp/test3338818258/out --- PASS: TestManyAddonsCCMIRSA26 (2.16s) === RUN TestManyAddonsGCE I0709 19:34:29.720370 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:34:31.807455 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:34:31.807540 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:34:31.807632 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0709 19:34:31.807651 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0709 19:34:31.807669 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0709 19:34:31.807733 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0709 19:34:31.808795 10939 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0709 19:34:31.812619 10939 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0709 19:34:31.817059 10939 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0709 19:34:31.817799 10939 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0709 19:34:31.817949 10939 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0709 19:34:31.822691 10939 target.go:111] Terraform output is in /tmp/test1937207333/out --- PASS: TestManyAddonsGCE (2.11s) === RUN TestCCM I0709 19:34:31.832543 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:31.832782 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:31.832821 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:31.832870 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:31.832905 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:31.832943 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:31.832980 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:31.833001 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:31.833030 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:31.833052 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:31.856217 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:31.859219 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:31.859287 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:33.189376 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:33.863685 10939 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0709 19:34:33.864335 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:33.864354 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:33.864408 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:33.872116 10939 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0709 19:34:33.877238 10939 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0709 19:34:33.877609 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:33.878247 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:33.878787 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:33.879492 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:33.879603 10939 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0709 19:34:33.879894 10939 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0709 19:34:33.880132 10939 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0709 19:34:33.887315 10939 target.go:111] Terraform output is in /tmp/test45573127/out --- PASS: TestCCM (2.07s) === RUN TestExternalDNS I0709 19:34:33.897985 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:33.898207 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:33.898246 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:33.898303 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:33.898339 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:33.898427 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:33.898476 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:33.898503 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:33.898539 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:33.898575 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:33.922405 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:33.925986 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:33.926092 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:35.214326 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:35.372285 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:34:35.372782 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:35.372834 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:35.372941 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:35.375558 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:34:35.380094 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:34:35.380385 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:35.380664 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:35.380807 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:35.381275 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:35.381372 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:34:35.382788 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:34:35.383420 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:34:35.392779 10939 target.go:111] Terraform output is in /tmp/test1518535048/out --- PASS: TestExternalDNS (1.50s) === RUN TestExternalDNSIRSA I0709 19:34:35.397454 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:35.397658 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:35.397701 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:35.397743 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:35.397774 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:35.397814 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:35.397848 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:35.397870 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:35.397900 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:35.397923 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:35.418282 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:35.421038 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:35.421108 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:36.689994 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:36.869351 10939 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0709 19:34:36.870393 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:36.870439 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:36.870559 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:36.872182 10939 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0709 19:34:36.876855 10939 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0709 19:34:36.877180 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:36.877335 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:36.877706 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:36.877786 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:36.877875 10939 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0709 19:34:36.878097 10939 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0709 19:34:36.878365 10939 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0709 19:34:36.890699 10939 target.go:111] Terraform output is in /tmp/test674835822/out --- PASS: TestExternalDNSIRSA (1.50s) === RUN TestKarpenter I0709 19:34:36.896556 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:36.896763 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:36.896802 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:36.896843 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:36.896874 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:36.896912 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:36.896947 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:36.896969 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:36.896999 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:36.897021 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:36.921348 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:34:36.924247 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:36.924307 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:36.924347 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.202462 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:38.359009 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.359110 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.359194 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0709 19:34:38.480149 10939 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0709 19:34:38.480208 10939 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0709 19:34:38.480223 10939 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0709 19:34:38.480231 10939 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0709 19:34:38.480239 10939 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0709 19:34:38.502457 10939 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0709 19:34:38.503886 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:38.503920 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:38.503998 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:38.506295 10939 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0709 19:34:38.511358 10939 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0709 19:34:38.511569 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.511709 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.511906 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.512102 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.512301 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.512403 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.512511 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.512739 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.512843 10939 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0709 19:34:38.513109 10939 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0709 19:34:38.513369 10939 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0709 19:34:38.522165 10939 target.go:111] Terraform output is in /tmp/test3751442304/out --- PASS: TestKarpenter (1.63s) === RUN TestSharedSubnet I0709 19:34:38.529315 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:38.529523 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:38.529561 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:38.529602 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:38.529633 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:38.529674 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:38.529708 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:38.529728 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:38.529757 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:38.529780 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:38.553995 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:38.556755 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:38.556827 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:39.832641 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:39.976552 10939 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0709 19:34:39.976814 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:39.976837 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:39.976916 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:39.980405 10939 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0709 19:34:39.981601 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:34:39.987444 10939 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0709 19:34:39.987816 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:39.988078 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:39.988662 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:39.988757 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:39.988872 10939 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0709 19:34:39.989186 10939 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0709 19:34:39.989451 10939 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0709 19:34:39.994921 10939 target.go:111] Terraform output is in /tmp/test2218574511/out --- PASS: TestSharedSubnet (1.47s) === RUN TestSharedVPC I0709 19:34:39.999577 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:39.999781 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:39.999816 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:39.999854 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:39.999883 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:39.999922 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:39.999959 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:39.999981 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:40.000009 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:40.000031 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:40.019694 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:40.022349 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:40.022414 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:41.339434 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:41.494083 10939 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0709 19:34:41.494663 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:41.494706 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:41.494833 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:41.498444 10939 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0709 19:34:41.499757 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:34:41.506132 10939 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0709 19:34:41.506523 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:41.506953 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:41.507212 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:41.507657 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:41.507756 10939 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0709 19:34:41.508086 10939 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0709 19:34:41.508482 10939 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0709 19:34:41.514751 10939 target.go:111] Terraform output is in /tmp/test2164513705/out --- PASS: TestSharedVPC (1.52s) === RUN TestSharedVPCIPv6 I0709 19:34:41.519427 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:41.519618 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:41.519654 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:41.519692 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:41.519722 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:41.519760 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:41.519794 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:41.519816 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:41.519845 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:41.519867 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:41.521469 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:34:41.521519 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:34:41.543590 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:34:41.543637 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0709 19:34:41.543716 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:34:41.547005 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:41.547069 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:42.854210 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:43.015117 10939 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0709 19:34:43.017845 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:43.017881 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:43.017955 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:43.018801 10939 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0709 19:34:43.019123 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:34:43.019244 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:34:43.021490 10939 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0709 19:34:43.022188 10939 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0709 19:34:43.022326 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:34:43.022402 10939 loadbalancers.go:35] PageSize not implemented I0709 19:34:43.022512 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:34:43.022573 10939 loadbalancers.go:35] PageSize not implemented I0709 19:34:43.026581 10939 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0709 19:34:43.026738 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:43.026874 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:43.027243 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:43.027301 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:43.027390 10939 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0709 19:34:43.027626 10939 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0709 19:34:43.027871 10939 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0709 19:34:43.034745 10939 target.go:111] Terraform output is in /tmp/test3581614033/out --- PASS: TestSharedVPCIPv6 (1.52s) === RUN TestExistingIAM I0709 19:34:43.039672 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:43.039883 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:43.039920 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:43.039957 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:43.039986 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:43.040023 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:43.040068 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:43.040088 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:43.040117 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:43.040139 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:43.070614 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:43.073623 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:43.073694 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:43.073736 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:43.073779 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.403211 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:44.557249 10939 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0709 19:34:44.564791 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:44.564837 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:44.564959 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:44.566574 10939 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0709 19:34:44.571319 10939 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0709 19:34:44.571511 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.571728 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.571982 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.572093 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.572173 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.572256 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.572637 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.572710 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.572792 10939 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0709 19:34:44.573205 10939 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0709 19:34:44.573554 10939 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0709 19:34:44.581573 10939 target.go:111] Terraform output is in /tmp/test2499208496/out --- PASS: TestExistingIAM (1.55s) === RUN TestPhaseNetwork I0709 19:34:44.587932 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:44.588298 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:44.588359 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:44.588448 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:44.588528 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:44.588601 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:44.588670 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:44.588738 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:44.588795 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:44.588835 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:44.617140 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:44.619851 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.619984 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:44.620023 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:45.937534 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:46.091626 10939 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0709 19:34:46.092205 10939 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0709 19:34:46.092568 10939 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0709 19:34:46.092901 10939 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0709 19:34:46.093055 10939 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0709 19:34:46.093202 10939 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0709 19:34:46.093276 10939 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0709 19:34:46.093343 10939 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0709 19:34:46.094251 10939 target.go:111] Terraform output is in /tmp/test403428372/out --- PASS: TestPhaseNetwork (1.51s) === RUN TestExternalLoadBalancer I0709 19:34:46.094874 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:46.095106 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:46.095147 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:46.095191 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:46.095224 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:46.095263 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:46.095303 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:46.095324 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:46.095355 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:46.095380 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:46.114918 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:46.117590 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:46.117667 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.382031 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:47.530823 10939 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0709 19:34:47.531689 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:47.531725 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:47.531874 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:47.535938 10939 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0709 19:34:47.543325 10939 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0709 19:34:47.543524 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.544081 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.544302 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.544505 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.544604 10939 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0709 19:34:47.544837 10939 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0709 19:34:47.545167 10939 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0709 19:34:47.551438 10939 target.go:111] Terraform output is in /tmp/test3946335892/out --- PASS: TestExternalLoadBalancer (1.46s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0709 19:34:47.556440 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:47.556652 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:47.556687 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:47.556731 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:47.556764 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:47.556802 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:47.556835 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:47.556855 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:47.556884 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:47.556906 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:47.579926 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:47.582353 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.582405 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.582435 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.582461 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.582485 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.582506 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:47.582531 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:48.879768 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:49.041953 10939 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0709 19:34:49.042377 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:49.042404 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:49.042483 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:49.044377 10939 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0709 19:34:49.049236 10939 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0709 19:34:49.049513 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.049651 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.051186 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.051368 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.051769 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.051863 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.052383 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.052997 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.053203 10939 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0709 19:34:49.054462 10939 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0709 19:34:49.055226 10939 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0709 19:34:49.063839 10939 target.go:111] Terraform output is in /tmp/test944654813/out --- PASS: TestMixedInstancesASG (1.51s) === RUN TestMixedInstancesSpotASG I0709 19:34:49.069761 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:49.069959 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:49.069995 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:49.070040 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:49.070072 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:49.070112 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:49.070147 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:49.070167 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:49.070195 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:49.070218 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:49.096071 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:49.099230 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.099316 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.099367 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.099430 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.099471 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.099511 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:49.099548 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.395940 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:50.558100 10939 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0709 19:34:50.558419 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:50.558463 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:50.558588 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:50.564427 10939 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0709 19:34:50.571837 10939 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0709 19:34:50.572097 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.572334 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.572545 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.572725 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.572799 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.572920 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.572992 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.573327 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.573411 10939 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0709 19:34:50.573729 10939 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0709 19:34:50.574018 10939 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0709 19:34:50.581811 10939 target.go:111] Terraform output is in /tmp/test3450009853/out --- PASS: TestMixedInstancesSpotASG (1.52s) === RUN TestAdditionalObjects I0709 19:34:50.587757 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:50.588057 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:50.588097 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:50.588134 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:50.588162 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:50.588200 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:50.588236 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:50.588257 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:50.588287 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:50.588309 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:50.614094 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0709 19:34:50.617648 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:50.617731 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:51.948195 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:52.093259 10939 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0709 19:34:52.093737 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:52.093778 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:52.093888 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:52.096452 10939 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0709 19:34:52.100833 10939 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0709 19:34:52.101339 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:52.101532 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:52.101706 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:52.102142 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:52.102230 10939 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0709 19:34:52.102473 10939 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0709 19:34:52.102772 10939 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0709 19:34:52.111263 10939 target.go:111] Terraform output is in /tmp/test1500796635/out --- PASS: TestAdditionalObjects (1.53s) === RUN TestContainerd I0709 19:34:52.116137 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:52.116351 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:52.116388 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:52.116433 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:52.116464 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:52.116502 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:52.116540 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:52.116561 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:52.116591 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:52.116614 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:52.136433 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:52.139414 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:52.139471 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:53.497164 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:53.641999 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:34:53.642479 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:53.642513 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:53.642595 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:53.650393 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:34:53.655965 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:34:53.656166 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:53.656419 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:53.656568 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:53.657098 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:53.657211 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:34:53.657503 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:34:53.657896 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:34:53.663553 10939 target.go:111] Terraform output is in /tmp/test2589246681/out --- PASS: TestContainerd (1.55s) === RUN TestContainerdCustom I0709 19:34:53.668210 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:53.668434 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:53.668471 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:53.668516 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:53.668547 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:53.668585 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:53.668621 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:53.668641 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:53.668671 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:53.668710 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:53.689308 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:53.692115 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:53.692179 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:54.200768 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:54.348480 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:34:54.348841 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:54.348876 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:54.348959 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:54.351436 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:34:54.356171 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:34:54.356589 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:54.356789 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:54.357177 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:54.357250 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:54.357324 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:34:54.358773 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:34:54.359904 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:34:54.368231 10939 target.go:111] Terraform output is in /tmp/test688834164/out --- PASS: TestContainerdCustom (0.71s) === RUN TestDockerCustom I0709 19:34:54.373331 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:54.373537 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:54.373574 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:54.373615 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:54.373648 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:54.373687 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:54.373723 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:54.373744 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:54.373774 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:54.373799 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:54.394887 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0709 19:34:54.397773 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:54.397841 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:54.912154 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:55.047986 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:34:55.049834 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:55.049881 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:55.050041 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:55.055804 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:34:55.060854 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:34:55.061179 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:55.061402 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:55.061783 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:55.061888 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:55.061978 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:34:55.062214 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:34:55.062507 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:34:55.068195 10939 target.go:111] Terraform output is in /tmp/test594958681/out --- PASS: TestDockerCustom (0.70s) === RUN TestAPIServerNodes I0709 19:34:55.072985 10939 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0709 19:34:55.073009 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:55.073205 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:55.073240 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:55.073280 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:55.073309 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:55.073350 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:55.073383 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:55.073403 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:55.073434 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:55.073457 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:55.094901 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0709 19:34:55.097737 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:55.097804 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:55.097847 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:56.505962 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:56.660138 10939 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0709 19:34:56.661423 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:56.661459 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:56.661549 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:56.663234 10939 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0709 19:34:56.667917 10939 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0709 19:34:56.668104 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:56.668316 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:56.668504 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:56.668685 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:56.669424 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:56.670134 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:56.670367 10939 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0709 19:34:56.671078 10939 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0709 19:34:56.672248 10939 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0709 19:34:56.681182 10939 target.go:111] Terraform output is in /tmp/test2671299600/out I0709 19:34:56.686399 10939 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.61s) === RUN TestNTHIMDSProcessor I0709 19:34:56.686519 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:56.686731 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:56.686768 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:56.686813 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:56.686847 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:56.686890 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:56.686929 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:56.686950 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:56.686981 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:56.687004 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:56.707153 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:56.709847 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:56.709917 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:58.011928 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:58.163063 10939 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0709 19:34:58.163754 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:58.163788 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:58.163874 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:58.166261 10939 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0709 19:34:58.170717 10939 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0709 19:34:58.171007 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:58.171257 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:58.171472 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:58.171905 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:58.172010 10939 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0709 19:34:58.172296 10939 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0709 19:34:58.172555 10939 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0709 19:34:58.177466 10939 target.go:111] Terraform output is in /tmp/test3439284681/out --- PASS: TestNTHIMDSProcessor (1.50s) === RUN TestNTHIMDSProcessorIRSA I0709 19:34:58.181660 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:58.181885 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:58.181922 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:58.181963 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:58.181993 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:58.182033 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:58.182067 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:58.182088 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:58.182119 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:58.182143 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:58.202051 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:58.204789 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:58.204856 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:59.544618 10939 zones.go:93] ListHostedZonesPages { } I0709 19:34:59.726273 10939 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0709 19:34:59.727275 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:34:59.727303 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:34:59.727388 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:34:59.729799 10939 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0709 19:34:59.734292 10939 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0709 19:34:59.734647 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:59.734905 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:59.735252 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:59.735648 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:59.735758 10939 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0709 19:34:59.736061 10939 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0709 19:34:59.736328 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:34:59.742972 10939 target.go:111] Terraform output is in /tmp/test2707626557/out --- PASS: TestNTHIMDSProcessorIRSA (1.57s) === RUN TestCustomIRSA I0709 19:34:59.748322 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:34:59.748549 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:34:59.748586 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:34:59.748626 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:34:59.748656 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:34:59.748695 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:34:59.748728 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:34:59.748749 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:34:59.748780 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:34:59.748804 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:34:59.772160 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:34:59.775205 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:34:59.775271 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:01.106707 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:01.634994 10939 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0709 19:35:01.636194 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:35:01.636229 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:01.636317 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:35:01.638763 10939 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0709 19:35:01.646316 10939 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0709 19:35:01.647528 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:01.648300 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:01.648566 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:01.648942 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:01.649037 10939 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0709 19:35:01.649291 10939 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0709 19:35:01.649548 10939 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0709 19:35:01.657937 10939 target.go:111] Terraform output is in /tmp/test447837164/out --- PASS: TestCustomIRSA (1.92s) === RUN TestClusterNameDigit I0709 19:35:01.667426 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:01.667641 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:01.667682 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:01.667754 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:01.667789 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:01.667829 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:01.667866 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:01.667888 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:01.667918 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:01.667941 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:35:01.689251 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:01.692101 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:01.692167 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:03.007902 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:03.158340 10939 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0709 19:35:03.159996 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:35:03.160041 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:03.160165 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:35:03.162232 10939 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0709 19:35:03.166874 10939 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0709 19:35:03.167285 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:03.167495 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:03.167712 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:03.168054 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:03.168146 10939 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0709 19:35:03.168377 10939 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0709 19:35:03.168617 10939 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0709 19:35:03.174769 10939 target.go:111] Terraform output is in /tmp/test3520037731/out --- PASS: TestClusterNameDigit (1.52s) === RUN TestCASPriorityExpander I0709 19:35:03.183494 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:03.183712 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:03.183752 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:03.183794 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:03.183824 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:03.183860 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:03.183895 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:03.183917 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:03.183946 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:03.183969 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:35:03.207703 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0709 19:35:03.210628 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:03.210694 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:03.210734 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:03.210768 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0709 19:35:04.884452 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:05.053192 10939 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0709 19:35:05.055157 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:35:05.055188 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:05.055269 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:35:05.057798 10939 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0709 19:35:05.062386 10939 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0709 19:35:05.062645 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.062842 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.063037 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.063237 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.063430 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.063506 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.063631 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.063785 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.063881 10939 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0709 19:35:05.064146 10939 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0709 19:35:05.064440 10939 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0709 19:35:05.071597 10939 target.go:111] Terraform output is in /tmp/test2633628360/out --- PASS: TestCASPriorityExpander (1.90s) === RUN TestCASPriorityExpanderCustom I0709 19:35:05.080599 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:05.080824 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:05.080859 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:05.080903 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:05.080934 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:05.080974 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:05.081009 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:05.081030 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:05.081058 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:05.081081 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:35:05.105444 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0709 19:35:05.108510 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.108579 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.108622 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:05.108657 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0709 19:35:06.439493 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:06.601609 10939 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0709 19:35:06.602310 10939 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0709 19:35:06.602361 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:06.602435 10939 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0709 19:35:06.605982 10939 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0709 19:35:06.610928 10939 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0709 19:35:06.611113 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:06.611226 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:06.611402 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:06.611555 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:06.611722 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:06.611800 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:06.611876 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:06.612188 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:06.612282 10939 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0709 19:35:06.612602 10939 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0709 19:35:06.612927 10939 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0709 19:35:06.619981 10939 target.go:111] Terraform output is in /tmp/test3548017651/out --- PASS: TestCASPriorityExpanderCustom (1.54s) === RUN TestLifecycleMinimalAWS I0709 19:35:06.625515 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:06.625724 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:06.625761 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:06.625802 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:06.625833 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:06.625880 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:06.625915 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:06.625938 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:06.625967 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:06.625990 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0709 19:35:06.646362 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0709 19:35:06.651829 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:06.651923 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0709 19:35:08.021438 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:08.164968 10939 iamrole.go:89] ListRoles: { } I0709 19:35:08.166039 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:35:08.166326 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:08.166440 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0709 19:35:08.166547 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0709 19:35:08.166591 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:08.166538 10939 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.166703 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:08.166817 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0709 19:35:08.166790 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:08.166911 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] } I0709 19:35:08.167014 10939 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.167071 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:08.167312 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:08.167446 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:08.167507 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:08.167602 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:08.167700 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0709 19:35:08.167759 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:08.167877 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:08.167915 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0709 19:35:08.167942 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:08.167974 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:08.168001 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.169080 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:35:08.169226 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0709 19:35:08.169310 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0709 19:35:08.169365 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:08.169521 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0709 19:35:08.169600 10939 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0709 19:35:08.169634 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], VpcId: "vpc-1" } I0709 19:35:08.169667 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:08.169829 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0709 19:35:08.169830 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0709 19:35:08.169903 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0709 19:35:08.169858 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:08.169955 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0709 19:35:08.170089 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0709 19:35:08.170248 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" }] }], VpcId: "vpc-1" } I0709 19:35:08.170323 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:08.170364 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:08.170395 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:08.170510 10939 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0709 19:35:08.170551 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:08.170613 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:08.170678 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:08.170712 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] } I0709 19:35:08.170816 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:08.170905 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:08.170956 10939 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0709 19:35:08.171027 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:08.171088 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:08.171145 10939 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.171206 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:08.171381 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0709 19:35:08.174035 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:35:08.174246 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:08.174448 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:08.175244 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:08.175379 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:08.175774 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:08.175893 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.176088 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0709 19:35:08.176134 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0709 19:35:08.176264 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.176762 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.176980 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:08.177168 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:08.177252 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.177445 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.177695 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0709 19:35:08.178006 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:08.178666 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.179212 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.179327 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I0709 19:35:08.179425 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0709 19:35:08.179529 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.179625 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0709 19:35:08.179721 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.179819 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:35:08.179952 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:08.181438 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:35:08.181690 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:35:08.181983 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:35:08.182038 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:08.182070 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:08.182138 10939 dns.go:235] Pre-creating DNS records I0709 19:35:08.182163 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:08.186603 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0709 19:35:08.189086 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:08.189158 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0709 19:35:09.564747 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:09.709693 10939 iamrole.go:89] ListRoles: { } I0709 19:35:09.710538 10939 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0709 19:35:09.712382 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.714103 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:09.715626 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:09.716407 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.716553 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.716633 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:09.716685 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:09.716727 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:09.716805 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.718859 10939 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0709 19:35:09.718996 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.719187 10939 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0709 19:35:09.719122 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0709 19:35:09.719249 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0709 19:35:09.719296 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:09.719355 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.719503 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:09.719539 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:09.719609 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:09.719671 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.719778 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0709 19:35:09.719907 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:09.723781 10939 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0709 19:35:09.723921 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:09.724034 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:09.724152 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:09.724223 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:09.724379 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:09.724620 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:09.724748 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:09.725321 10939 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0709 19:35:09.725507 10939 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0709 19:35:09.725754 10939 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0709 19:35:09.727852 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:35:09.727910 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:09.727939 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:35:09.727960 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:35:09.727980 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:35:09.728000 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:35:09.728025 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:09.728047 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:35:09.728069 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:35:09.728097 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:35:09.728123 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:09.728143 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:09.728161 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:09.728183 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:35:09.728206 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:09.728228 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:09.728255 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:09.728278 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:09.728299 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:09.728319 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:35:09.728341 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:09.728365 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:09.728393 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:09.728443 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:35:09.729419 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:35:09.729504 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:35:09.729520 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:35:09.729553 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.729599 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0709 19:35:09.729643 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.729691 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.729728 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.729771 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.729805 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.729835 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0709 19:35:09.729869 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.729908 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:35:09.729936 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0709 19:35:09.729968 10939 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0709 19:35:09.729997 10939 api.go:53] PageSize not implemented I0709 19:35:09.730017 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:09.730038 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:09.730054 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:35:09.730084 10939 targetgroups.go:35] PageSize not implemented I0709 19:35:09.730099 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0709 19:35:09.730143 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:35:09.730184 10939 iamrole.go:89] ListRoles: { } I0709 19:35:09.730230 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:09.730256 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:09.730291 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:35:09.730329 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:09.730356 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0709 19:35:09.730746 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-group:nodes.minimal.example.com ok I0709 19:35:09.730844 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:09.730879 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0709 19:35:09.730853 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I0709 19:35:09.731022 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0709 19:35:09.730910 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0709 19:35:09.731125 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:09.731145 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0709 19:35:09.731064 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0709 19:35:09.731194 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:09.731220 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0709 19:35:09.731241 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0709 19:35:09.731329 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:09.731348 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0709 19:35:09.731375 10939 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0709 19:35:09.731421 10939 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok I0709 19:35:09.731469 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0709 19:35:09.731528 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0709 19:35:09.731619 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0709 19:35:09.731662 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0709 19:35:09.731675 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0709 19:35:09.731743 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } I0709 19:35:09.731674 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } iam-role:nodes.minimal.example.com ok subnet:subnet-1 ok I0709 19:35:09.731786 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0709 19:35:09.731820 10939 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0709 19:35:09.731830 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0709 19:35:09.731849 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0709 19:35:09.731914 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0709 19:35:09.731977 10939 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0709 19:35:09.732031 10939 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (3.11s) === RUN TestLifecycleMinimalOpenstack I0709 19:35:09.732570 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0709 19:35:09.739176 10939 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:35:11.162951 10939 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0709 19:35:11.162990 10939 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0709 19:35:11.177068 10939 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/07/09 19:35:11 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:11 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0709 19:35:11.185392 10939 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0709 19:35:11.193631 10939 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0709 19:35:11.202088 10939 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/07/09 19:35:11 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:11 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:11 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0709 19:35:11.204837 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0709 19:35:11.205254 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0709 19:35:11.205325 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0709 19:35:12.209344 10939 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:35:13.638593 10939 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0709 19:35:13.638634 10939 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0709 19:35:13.654908 10939 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/07/09 19:35:13 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:13 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0709 19:35:13.664877 10939 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0709 19:35:13.670308 10939 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0709 19:35:13.671803 10939 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/07/09 19:35:13 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:13 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:13 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0709 19:35:13.674329 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0709 19:35:13.674344 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0709 19:35:13.674591 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0709 19:35:13.674939 10939 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0709 19:35:13.676162 10939 delete_cluster.go:128] Looking for cloud resources to delete 2025/07/09 19:35:13 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) ServerGroup:b272f4ae-de86-4c62-8369-9bc30ca84eb6 ok SecurityGroup:00560a3a-fb91-4801-8593-fa2fcc879c17 ok Port:9e942397-f7b5-47b8-b6ca-d064f513c775 ok Port:139e2384-e2da-43d1-b39e-4ce8e116f227 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Subnet:dc7e7296-9876-4a82-936f-e90707564f3f ok Instance:ab1a21c9-6fe3-418e-af60-8c0602b99300 ok SecurityGroup:81b6e3f8-4f24-4679-80b3-9db442734fe0 ok Port:fcc67f6c-dddd-4f2f-adbe-8f7c1582f7ed ok ServerGroup:6b25ff7b-8ec0-43cd-9ccc-d8a9ea8c0ca6 ok Instance:1fc5383c-9daa-4341-8f55-61ec11910fb7 ok SecurityGroup:f627eac6-a10d-4ea6-822e-e2cf5343fa65 ok Instance:fbb091c9-fc20-4d46-9d26-89692cf0b04a ok Network:1dc4a804-51fa-4e93-a32f-aa114071d50b ok --- PASS: TestLifecycleMinimalOpenstack (5.05s) === RUN TestLifecycleMinimalGCE I0709 19:35:14.785661 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0709 19:35:14.787387 10939 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:35:16.502855 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:35:16.502937 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:35:16.503028 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0709 19:35:16.503047 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0709 19:35:16.503066 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0709 19:35:16.503128 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0709 19:35:16.504139 10939 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0709 19:35:16.507825 10939 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0709 19:35:16.512133 10939 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0709 19:35:16.513040 10939 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0709 19:35:16.513246 10939 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0709 19:35:16.513331 10939 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:35:18.227584 10939 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0709 19:35:18.227671 10939 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0709 19:35:18.227757 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0709 19:35:18.227779 10939 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0709 19:35:18.227797 10939 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0709 19:35:18.227853 10939 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0709 19:35:18.228936 10939 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0709 19:35:18.232185 10939 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0709 19:35:18.236717 10939 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0709 19:35:18.237498 10939 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0709 19:35:18.237629 10939 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0709 19:35:18.238936 10939 delete_cluster.go:128] Looking for cloud resources to delete I0709 19:35:18.238991 10939 gce.go:99] Scanning zones: [us-test1-a] I0709 19:35:18.239305 10939 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0709 19:35:18.239323 10939 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:node-to-master-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok InstanceTemplate:nodes-minimal-gce-example-com-1752089716 ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1752089716 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (3.45s) === RUN TestLifecycleFloatingIPOpenstack I0709 19:35:18.240543 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0709 19:35:18.247110 10939 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:35:19.659323 10939 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0709 19:35:19.659354 10939 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0709 19:35:19.675719 10939 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/07/09 19:35:19 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:19 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0709 19:35:19.679822 10939 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0709 19:35:19.691859 10939 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0709 19:35:19.694507 10939 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/07/09 19:35:19 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:19 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:19 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0709 19:35:19.696509 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0709 19:35:19.697065 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0709 19:35:20.700545 10939 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0709 19:35:22.226988 10939 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0709 19:35:22.227026 10939 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0709 19:35:22.242919 10939 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/07/09 19:35:22 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:22 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0709 19:35:22.252686 10939 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0709 19:35:22.257950 10939 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0709 19:35:22.259420 10939 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/07/09 19:35:22 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:22 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/07/09 19:35:22 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0709 19:35:22.261973 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0709 19:35:22.261975 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0709 19:35:22.262294 10939 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0709 19:35:22.262583 10939 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0709 19:35:22.263934 10939 delete_cluster.go:128] Looking for cloud resources to delete 2025/07/09 19:35:22 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SecurityGroup:87715597-8d86-464c-a42c-2e1ab5fb1371 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok ServerGroup:f7459221-f2f3-42f5-b4b6-f753eed8173a ok Router:55e05d00-bae1-4987-8e77-752349a247aa ok ServerGroup:34fc1e51-7b30-4a53-9b67-036fac32b731 ok Port:aa1dace7-8da4-4377-a00e-f13b1b40f8b9 ok Instance:a42e6a55-696c-448d-8114-f581a6eb44ea ok Router-IF:ab8b1b23-42f4-445f-95b6-5203d950dc86 ok Instance:a76de73b-b168-4888-bee4-37fcbfec66ab ok Network:75cf80b3-d36c-40cd-9e00-2e087df0d66e ok Port:b2e74d5d-5c5b-4ad8-9af1-4b28a925bdbb ok Subnet:ab8b1b23-42f4-445f-95b6-5203d950dc86 ok Port:4ec17f40-7c3b-4c94-b3e9-b383eaf84cc7 ok SecurityGroup:59f9e75b-4880-4236-92eb-bb758d4a1ade ok Instance:105cead7-0ff7-4e71-a2b7-db24c7bf8505 ok Port:019e2b4b-02ad-451c-866b-c324aa17958a ok SecurityGroup:95db71bb-c234-4e2f-8d4f-8a525042fec1 ok --- PASS: TestLifecycleFloatingIPOpenstack (5.13s) === RUN TestLifecyclePrivateCalico I0709 19:35:23.373683 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:23.373916 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:23.373955 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:23.373999 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:23.374029 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:23.374069 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:23.374102 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:23.374123 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:23.374151 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:23.374175 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0709 19:35:23.397118 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:35:23.400100 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:23.400254 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:23.400301 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:24.704657 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:25.040071 10939 iamrole.go:89] ListRoles: { } I0709 19:35:25.041061 10939 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0709 19:35:25.041410 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:25.041590 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:25.041618 10939 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.042198 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:25.041799 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:25.043041 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0709 19:35:25.043301 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0709 19:35:25.043318 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:25.043495 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0709 19:35:25.043541 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0709 19:35:25.043608 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:25.043681 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:25.043689 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0709 19:35:25.043793 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0709 19:35:25.043737 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:25.044036 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:25.044893 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:25.045074 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0709 19:35:25.045195 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0709 19:35:25.044991 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:25.045581 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:25.045887 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0709 19:35:25.046197 10939 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.046878 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:25.048775 10939 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0709 19:35:25.048887 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0709 19:35:25.048919 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:25.049033 10939 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0709 19:35:25.049113 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0709 19:35:25.049060 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0709 19:35:25.049125 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0709 19:35:25.049257 10939 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0709 19:35:25.049248 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0709 19:35:25.049344 10939 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0709 19:35:25.049405 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0709 19:35:25.049557 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0709 19:35:25.049595 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0709 19:35:25.049487 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0709 19:35:25.049641 10939 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0709 19:35:25.049744 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0709 19:35:25.049721 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0709 19:35:25.049905 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:25.049988 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:25.050029 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:25.050059 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:25.050118 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:25.050148 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:25.050172 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:25.050232 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:25.050261 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:25.050286 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:25.050401 10939 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0709 19:35:25.050450 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:25.050689 10939 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0709 19:35:25.050753 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:25.050918 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0709 19:35:25.050942 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:25.051086 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0709 19:35:25.051167 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:25.051255 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0709 19:35:25.051233 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0709 19:35:25.051332 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] }] } I0709 19:35:25.051347 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0709 19:35:25.051423 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:35:25.051454 10939 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0709 19:35:25.051472 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0709 19:35:25.051514 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0709 19:35:25.051581 10939 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0709 19:35:25.051638 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:25.051680 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:25.051709 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:25.051753 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:25.051785 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] } I0709 19:35:25.051878 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:25.051572 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0709 19:35:25.051963 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:25.052033 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0709 19:35:25.052089 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:35:25.052161 10939 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0709 19:35:25.052300 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0709 19:35:25.052401 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } W0709 19:35:25.052552 10939 api.go:53] PageSize not implemented I0709 19:35:25.052545 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:25.052620 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:25.052562 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0709 19:35:25.052673 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" }] }] } I0709 19:35:25.052714 10939 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I0709 19:35:25.052700 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:25.052834 10939 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0709 19:35:25.052775 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:25.052886 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:25.052913 10939 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0709 19:35:25.052964 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0709 19:35:25.052959 10939 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0709 19:35:25.053005 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0709 19:35:25.053086 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0709 19:35:25.053220 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0709 19:35:25.053344 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0709 19:35:25.053447 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:25.053573 10939 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.053591 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.053732 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:25.053852 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0709 19:35:25.053898 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:25.053971 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.054147 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:25.054232 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0709 19:35:25.054338 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.054438 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.054537 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:25.054598 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:25.054643 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0709 19:35:25.054670 10939 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I0709 19:35:25.054684 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } W0709 19:35:25.054776 10939 api.go:53] PageSize not implemented I0709 19:35:25.054782 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:25.054795 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:25.054823 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0709 19:35:25.054915 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0709 19:35:25.055014 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0709 19:35:25.055114 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0709 19:35:25.055215 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.055314 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0709 19:35:25.055384 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.055477 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.055573 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I0709 19:35:25.055664 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.055759 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0709 19:35:25.055849 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" }] }] } I0709 19:35:25.055945 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.056037 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0709 19:35:25.056110 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:25.056192 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.056292 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.056395 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:25.056458 10939 executor.go:111] Tasks: 120 done / 142 total; 6 can run I0709 19:35:25.056543 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:25.056599 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0709 19:35:25.056626 10939 api.go:53] PageSize not implemented I0709 19:35:25.056690 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:25.056735 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:25.056766 10939 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:25.056731 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W0709 19:35:25.056848 10939 api.go:53] PageSize not implemented I0709 19:35:25.056891 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:25.056845 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:25.056876 10939 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0709 19:35:25.056973 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0709 19:35:25.057006 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:25.057037 10939 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0709 19:35:25.061235 10939 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0709 19:35:25.061347 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:25.061486 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0709 19:35:25.061530 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:25.061632 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:25.061710 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:25.061835 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:25.062476 10939 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0709 19:35:25.062699 10939 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0709 19:35:25.062904 10939 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0709 19:35:25.062952 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:25.062982 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:25.063037 10939 dns.go:235] Pre-creating DNS records I0709 19:35:25.063059 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:25.068166 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:35:25.071087 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:25.071148 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:25.071188 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:26.355490 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:26.731067 10939 iamrole.go:89] ListRoles: { } I0709 19:35:26.732719 10939 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0709 19:35:26.733083 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.733264 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.733450 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:26.733481 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:26.733526 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:26.733571 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:26.733560 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.733658 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.734203 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:26.736164 10939 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0709 19:35:26.736338 10939 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0709 19:35:26.736287 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.736396 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0709 19:35:26.736428 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.736467 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0709 19:35:26.736531 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0709 19:35:26.736565 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0709 19:35:26.736541 10939 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0709 19:35:26.736562 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0709 19:35:26.736686 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:26.736735 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.736844 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:26.736877 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.736979 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0709 19:35:26.737102 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:26.737142 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:26.737212 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0709 19:35:26.737324 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:35:26.737369 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:26.737475 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0709 19:35:26.737606 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:26.737659 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.737757 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:26.737921 10939 executor.go:111] Tasks: 79 done / 142 total; 41 can run W0709 19:35:26.738206 10939 api.go:53] PageSize not implemented I0709 19:35:26.738169 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:26.738270 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:26.738232 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:26.738309 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:26.738198 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:26.738341 10939 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0709 19:35:26.738301 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0709 19:35:26.738380 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:26.738447 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0709 19:35:26.738492 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0709 19:35:26.738532 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0709 19:35:26.738565 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0709 19:35:26.738495 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } W0709 19:35:26.738633 10939 api.go:53] PageSize not implemented I0709 19:35:26.738650 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:26.738621 10939 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0709 19:35:26.738698 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0709 19:35:26.738831 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:26.738909 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:26.739052 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:26.739173 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:26.739271 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:26.739449 10939 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0709 19:35:26.739533 10939 api.go:53] PageSize not implemented I0709 19:35:26.739567 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:26.739520 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:26.739642 10939 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0709 19:35:26.739596 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:26.739686 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0709 19:35:26.739671 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:26.739756 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0709 19:35:26.739785 10939 api.go:53] PageSize not implemented I0709 19:35:26.739786 10939 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0709 19:35:26.739818 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:26.739937 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:26.744047 10939 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0709 19:35:26.744199 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:26.744311 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:26.744432 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:26.744491 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:26.744623 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:26.745248 10939 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0709 19:35:26.745365 10939 api.go:53] PageSize not implemented I0709 19:35:26.745400 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:26.745589 10939 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0709 19:35:26.745792 10939 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0709 19:35:26.748382 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:35:26.748462 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:26.748490 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:35:26.748513 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0709 19:35:26.748535 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:35:26.748557 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:35:26.748578 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:35:26.748598 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:26.748622 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:35:26.748644 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:35:26.748669 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:35:26.748697 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0709 19:35:26.748722 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0709 19:35:26.748743 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:26.748762 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:26.748780 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:26.748803 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:35:26.748823 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:35:26.748844 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:26.748869 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:26.748891 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:26.748913 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0709 19:35:26.748940 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:26.748964 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:26.748984 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:26.749006 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:26.749024 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:35:26.749045 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:26.749067 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:26.749091 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:26.749115 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:35:26.750287 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:35:26.750347 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:35:26.750361 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:35:26.750394 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.750439 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0709 19:35:26.750489 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.750537 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.750570 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.750607 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.750638 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.750671 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0709 19:35:26.750710 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.750749 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:26.750772 10939 natgateway.go:117] DescribeNatGateways: { } I0709 19:35:26.750806 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0709 19:35:26.750834 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0709 19:35:26.750876 10939 api.go:53] PageSize not implemented I0709 19:35:26.750890 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0709 19:35:26.750921 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:26.750941 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:26.750953 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0709 19:35:26.750979 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:35:26.750996 10939 targetgroups.go:35] PageSize not implemented I0709 19:35:26.751008 10939 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" ] } I0709 19:35:26.751055 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:35:26.751089 10939 iamrole.go:89] ListRoles: { } I0709 19:35:26.751129 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:26.751150 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:26.751190 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:35:26.751227 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:26.751263 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0709 19:35:26.751293 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0709 19:35:26.751322 10939 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok I0709 19:35:26.751825 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:26.751854 10939 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I0709 19:35:26.751934 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } autoscaling-group:bastion.privatecalico.example.com ok I0709 19:35:26.751976 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I0709 19:35:26.751886 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 } ] } W0709 19:35:26.752032 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:26.752049 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } I0709 19:35:26.752085 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0709 19:35:26.752093 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0709 19:35:26.752141 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I0709 19:35:26.752134 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0709 19:35:26.752178 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0709 19:35:26.752209 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok I0709 19:35:26.752201 10939 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0709 19:35:26.752247 10939 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0709 19:35:26.752274 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } autoscaling-group:nodes.privatecalico.example.com ok I0709 19:35:26.752010 10939 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I0709 19:35:26.752256 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:26.752381 10939 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.privatecalico.example.com ok load-balancer:api-privatecalico-example-0uch4k ok I0709 19:35:26.752313 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } security-group:sg-2 ok W0709 19:35:26.752466 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:26.752478 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0709 19:35:26.752504 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-3 ok I0709 19:35:26.752571 10939 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0709 19:35:26.752636 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:26.752678 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } W0709 19:35:26.752768 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:26.752782 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0709 19:35:26.752863 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0709 19:35:26.752903 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0709 19:35:26.752996 10939 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0709 19:35:26.752913 10939 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0709 19:35:26.753017 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0709 19:35:26.753064 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0709 19:35:26.753076 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0709 19:35:26.753067 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I0709 19:35:26.753102 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } subnet:subnet-1 ok iam-role:nodes.privatecalico.example.com ok I0709 19:35:26.753134 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0709 19:35:26.753127 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:26.753173 10939 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0709 19:35:26.753188 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0709 19:35:26.753208 10939 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0709 19:35:26.753243 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0709 19:35:26.753265 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I0709 19:35:26.753196 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0709 19:35:26.753336 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:26.753349 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0709 19:35:26.753437 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0709 19:35:26.753514 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0709 19:35:26.753601 10939 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0709 19:35:26.753675 10939 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (3.38s) === RUN TestLifecyclePrivateKopeio I0709 19:35:26.754251 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:26.754492 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:26.754528 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:26.754562 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:26.754593 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:26.754632 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:26.754665 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:26.754686 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:26.754713 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:26.754735 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0709 19:35:26.778338 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:26.781187 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:26.781253 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:26.781295 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:28.075197 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:28.231590 10939 iamrole.go:89] ListRoles: { } I0709 19:35:28.233138 10939 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0709 19:35:28.233446 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.233640 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0709 19:35:28.233746 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0709 19:35:28.233703 10939 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.233865 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:28.233946 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:28.234017 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:28.234128 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.234147 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0709 19:35:28.234233 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" }] } I0709 19:35:28.234279 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.234416 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0709 19:35:28.234520 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.234458 10939 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.234543 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatekopeio.example.com" }] } I0709 19:35:28.234623 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0709 19:35:28.234657 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0709 19:35:28.234686 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:28.234730 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:28.234764 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:28.234880 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:28.234920 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.235089 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:28.235191 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:28.235810 10939 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0709 19:35:28.235939 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.236038 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0709 19:35:28.236087 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0709 19:35:28.236142 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0709 19:35:28.236138 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0709 19:35:28.236203 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0709 19:35:28.236252 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.236258 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0709 19:35:28.236326 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0709 19:35:28.236412 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0709 19:35:28.236424 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0709 19:35:28.236418 10939 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0709 19:35:28.236450 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0709 19:35:28.236525 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0709 19:35:28.236532 10939 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0709 19:35:28.236597 10939 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0709 19:35:28.236630 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:28.236674 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0709 19:35:28.236703 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:28.236718 10939 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0709 19:35:28.236742 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] }] } I0709 19:35:28.236778 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0709 19:35:28.236913 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0709 19:35:28.236935 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:28.237022 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:28.237063 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:28.237106 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0709 19:35:28.237264 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatekopeio.example.com" }] }], VpcId: "vpc-1" } I0709 19:35:28.237330 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.237405 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:28.237470 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.237496 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0709 19:35:28.237539 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.237603 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0709 19:35:28.237690 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:28.237666 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0709 19:35:28.237748 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.237824 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:28.237899 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:28.237940 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:28.237980 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:28.237925 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0709 19:35:28.237806 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0709 19:35:28.238016 10939 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" }] }] } I0709 19:35:28.238092 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:28.238138 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:28.238180 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:28.238215 10939 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0709 19:35:28.238258 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0709 19:35:28.238368 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0709 19:35:28.238428 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:28.238480 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:28.238563 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0709 19:35:28.238601 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:35:28.238641 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0709 19:35:28.238675 10939 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0709 19:35:28.238748 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0709 19:35:28.238783 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:28.238808 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:28.238836 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" } ] } I0709 19:35:28.238891 10939 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0709 19:35:28.238924 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:35:28.238958 10939 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0709 19:35:28.239023 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0709 19:35:28.239054 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0709 19:35:28.239077 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:28.239150 10939 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0709 19:35:28.239299 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } W0709 19:35:28.239405 10939 api.go:53] PageSize not implemented I0709 19:35:28.239432 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:28.239503 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:28.239570 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:28.239527 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0709 19:35:28.239544 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:28.239635 10939 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I0709 19:35:28.239683 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:28.239660 10939 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-4" },{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0709 19:35:28.239702 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:28.239730 10939 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0709 19:35:28.239742 10939 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0709 19:35:28.239764 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0709 19:35:28.239800 10939 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0709 19:35:28.239786 10939 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0709 19:35:28.239826 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:28.239853 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0709 19:35:28.239884 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:28.240001 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0709 19:35:28.240033 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0709 19:35:28.240065 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0709 19:35:28.240094 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:28.240134 10939 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0709 19:35:28.240209 10939 api.go:53] PageSize not implemented I0709 19:35:28.240225 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:28.240228 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.240389 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" }] }] } I0709 19:35:28.240574 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:28.240663 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.240771 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:28.240832 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:28.240917 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:28.240975 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.241072 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.241176 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I0709 19:35:28.241296 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.241374 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0709 19:35:28.241446 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0709 19:35:28.241486 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.241590 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.241691 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0709 19:35:28.241784 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0709 19:35:28.241860 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:28.241902 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0709 19:35:28.241996 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0709 19:35:28.242030 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0709 19:35:28.242062 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.242153 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } I0709 19:35:28.242228 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.242325 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0709 19:35:28.242394 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0709 19:35:28.242460 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.242553 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0709 19:35:28.242645 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.242731 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.242818 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.242913 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0709 19:35:28.242939 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:28.242994 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0709 19:35:28.243085 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0709 19:35:28.243191 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:28.243221 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0709 19:35:28.243347 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0709 19:35:28.243377 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-4" } I0709 19:35:28.243405 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0709 19:35:28.243432 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0709 19:35:28.243460 10939 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0709 19:35:28.243497 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:28.243529 10939 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0709 19:35:28.243555 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:35:28.243592 10939 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0709 19:35:28.243652 10939 executor.go:111] Tasks: 122 done / 144 total; 7 can run I0709 19:35:28.243716 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0709 19:35:28.243797 10939 api.go:53] PageSize not implemented I0709 19:35:28.243819 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-2" } I0709 19:35:28.243853 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:28.243785 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:28.243858 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0709 19:35:28.243976 10939 api.go:53] PageSize not implemented I0709 19:35:28.243979 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:28.244101 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:28.244120 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:28.244047 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-1" } I0709 19:35:28.244171 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:28.248532 10939 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0709 19:35:28.248696 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:28.248791 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:28.248876 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:28.248967 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:28.249347 10939 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0709 19:35:28.249557 10939 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0709 19:35:28.249770 10939 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0709 19:35:28.249818 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:28.249849 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:28.249906 10939 dns.go:235] Pre-creating DNS records I0709 19:35:28.249930 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:28.254989 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:28.257888 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:28.257953 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:28.257994 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:29.574345 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:29.729327 10939 iamrole.go:89] ListRoles: { } I0709 19:35:29.731004 10939 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0709 19:35:29.731490 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.731567 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:29.731912 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.732043 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:29.732072 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:29.732116 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:29.732152 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.732405 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.732564 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:29.734396 10939 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0709 19:35:29.734518 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0709 19:35:29.734632 10939 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0709 19:35:29.734636 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0709 19:35:29.734698 10939 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0709 19:35:29.734721 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0709 19:35:29.734710 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0709 19:35:29.734651 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0709 19:35:29.734747 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0709 19:35:29.734815 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:29.734878 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:29.734957 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.735108 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:29.735154 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:29.735256 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.735381 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:29.735413 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0709 19:35:29.735532 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:35:29.735575 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.735679 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] }] } I0709 19:35:29.735785 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0709 19:35:29.735818 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] }] } I0709 19:35:29.735920 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:29.735989 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.736091 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.736187 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:29.736220 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.736307 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0709 19:35:29.736408 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:29.736526 10939 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0709 19:35:29.736655 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:29.736792 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:29.736859 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:29.736872 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0709 19:35:29.736904 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0709 19:35:29.736837 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:29.736937 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0709 19:35:29.736964 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0709 19:35:29.736968 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:29.736991 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W0709 19:35:29.737022 10939 api.go:53] PageSize not implemented W0709 19:35:29.737054 10939 api.go:53] PageSize not implemented I0709 19:35:29.737070 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:29.737078 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:29.737098 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:29.737156 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:29.737182 10939 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0709 19:35:29.737281 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:29.737353 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0709 19:35:29.737614 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:29.737685 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:29.737750 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:29.737890 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0709 19:35:29.737998 10939 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0709 19:35:29.738051 10939 api.go:53] PageSize not implemented I0709 19:35:29.738088 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:29.738085 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:29.738083 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:29.738140 10939 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" W0709 19:35:29.738161 10939 api.go:53] PageSize not implemented I0709 19:35:29.738161 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:29.738166 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:29.738215 10939 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0709 19:35:29.738211 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:29.738330 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:29.738431 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:29.742521 10939 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0709 19:35:29.742625 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:29.742727 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:29.742874 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:29.742916 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:29.743485 10939 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0709 19:35:29.743583 10939 api.go:53] PageSize not implemented I0709 19:35:29.743603 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:29.743762 10939 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0709 19:35:29.743913 10939 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0709 19:35:29.746581 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:35:29.746632 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:29.746662 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:35:29.746684 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:35:29.746704 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:35:29.746728 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:35:29.746755 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:29.746778 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:35:29.746803 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:35:29.746829 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:35:29.746858 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0709 19:35:29.746883 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:29.746906 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:29.746929 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:29.746953 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:35:29.746977 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:35:29.747002 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0709 19:35:29.747024 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:29.747047 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:29.747068 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:29.747089 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0709 19:35:29.747112 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:29.747138 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:29.747156 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:29.747182 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0709 19:35:29.747205 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0709 19:35:29.747228 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:29.747247 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:35:29.747266 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:29.747296 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:29.747321 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:29.747343 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:35:29.748593 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:35:29.748653 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:35:29.748670 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:35:29.748704 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.748748 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0709 19:35:29.748795 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.748842 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.748874 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.748913 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.748945 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.748980 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0709 19:35:29.749029 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.749078 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:29.749102 10939 natgateway.go:117] DescribeNatGateways: { } I0709 19:35:29.749132 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0709 19:35:29.749161 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0709 19:35:29.749204 10939 api.go:53] PageSize not implemented I0709 19:35:29.749217 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0709 19:35:29.749246 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:29.749265 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:29.749277 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0709 19:35:29.749303 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:35:29.749321 10939 targetgroups.go:35] PageSize not implemented I0709 19:35:29.749333 10939 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0709 19:35:29.749376 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:35:29.749409 10939 iamrole.go:89] ListRoles: { } I0709 19:35:29.749451 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:29.749474 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:29.749508 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:35:29.749545 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:29.749584 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1","rtb-3"] } I0709 19:35:29.749617 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0709 19:35:29.749642 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0709 19:35:29.750141 10939 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0709 19:35:29.750195 10939 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-group:bastion.privatekopeio.example.com ok I0709 19:35:29.750186 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0709 19:35:29.750258 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0709 19:35:29.750262 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } I0709 19:35:29.750304 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0709 19:35:29.750339 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:29.750348 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } volume:vol-1 ok iam-instance-profile:nodes.privatekopeio.example.com ok I0709 19:35:29.750382 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0709 19:35:29.750433 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok I0709 19:35:29.750426 10939 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } load-balancer:api-privatekopeio-example-tl2bv8 ok I0709 19:35:29.750320 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.privatekopeio.example.com ok I0709 19:35:29.750381 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0709 19:35:29.750519 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:29.750511 10939 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I0709 19:35:29.750534 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-group:nodes.privatekopeio.example.com ok autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok iam-instance-profile:bastions.privatekopeio.example.com ok I0709 19:35:29.750584 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:35:29.750648 10939 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I0709 19:35:29.750649 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W0709 19:35:29.750751 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:29.750766 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0709 19:35:29.750816 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0709 19:35:29.750862 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-3 ok I0709 19:35:29.750913 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:29.750952 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0709 19:35:29.751093 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:29.751104 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0709 19:35:29.751189 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0709 19:35:29.751215 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0709 19:35:29.751241 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0709 19:35:29.751289 10939 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0709 19:35:29.751298 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0709 19:35:29.751303 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0709 19:35:29.751346 10939 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0709 19:35:29.751339 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0709 19:35:29.751370 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0709 19:35:29.751411 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0709 19:35:29.751390 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:29.751423 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0709 19:35:29.751448 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0709 19:35:29.751437 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W0709 19:35:29.751529 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:29.751499 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0709 19:35:29.751583 10939 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0709 19:35:29.751597 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0709 19:35:29.751624 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I0709 19:35:29.751540 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0709 19:35:29.751742 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0709 19:35:29.751806 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0709 19:35:29.751849 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0709 19:35:29.751914 10939 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0709 19:35:29.751972 10939 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (3.00s) === RUN TestLifecycleIPv6 I0709 19:35:29.752530 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:29.752770 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:29.752804 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:29.752842 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:29.752871 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:29.752907 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:29.752940 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:29.752961 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:29.752988 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:29.753008 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0709 19:35:29.782582 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:35:29.785903 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:29.785975 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:31.096325 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:31.243224 10939 iamrole.go:89] ListRoles: { } I0709 19:35:31.244596 10939 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0709 19:35:31.244796 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.244870 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:31.244937 10939 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.245015 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:31.245111 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0709 19:35:31.245095 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.245222 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0709 19:35:31.245289 10939 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0709 19:35:31.245368 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0709 19:35:31.245396 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0709 19:35:31.245421 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:31.245455 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:31.245487 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.245620 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:31.245722 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:31.245779 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:31.245861 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0709 19:35:31.245949 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0709 19:35:31.245956 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.246101 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.246255 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:31.246366 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:31.249579 10939 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0709 19:35:31.249958 10939 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0709 19:35:31.249840 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0709 19:35:31.250070 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0709 19:35:31.250077 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0709 19:35:31.250090 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0709 19:35:31.250311 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:31.250319 10939 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0709 19:35:31.250337 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0709 19:35:31.250455 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:31.250503 10939 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0709 19:35:31.250637 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0709 19:35:31.250607 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:31.250824 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:31.250898 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0709 19:35:31.250959 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.251131 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0709 19:35:31.251317 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0709 19:35:31.251321 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] }] } I0709 19:35:31.251533 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0709 19:35:31.251612 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.251799 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:31.251885 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.252001 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:31.251885 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0709 19:35:31.252109 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0709 19:35:31.252246 10939 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0709 19:35:31.252302 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] }] } I0709 19:35:31.252479 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:31.252803 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] } I0709 19:35:31.252966 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:31.253433 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:31.253516 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:31.253555 10939 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }] } I0709 19:35:31.253619 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:31.253656 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:35:31.253687 10939 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0709 19:35:31.253745 10939 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0709 19:35:31.253781 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:31.253846 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:31.253892 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:31.253933 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0709 19:35:31.254086 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0709 19:35:31.254161 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0709 19:35:31.254200 10939 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0709 19:35:31.254006 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0709 19:35:31.254336 10939 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0709 19:35:31.255254 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:31.255380 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I0709 19:35:31.255491 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:31.255635 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.255765 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.255812 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0709 19:35:31.255875 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.255924 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0709 19:35:31.256016 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:31.256011 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0709 19:35:31.256064 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:31.256103 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:31.256205 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I0709 19:35:31.256268 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:31.256338 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:31.256445 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0709 19:35:31.256599 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.256713 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I0709 19:35:31.256813 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.256892 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0709 19:35:31.256977 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.256989 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0709 19:35:31.257055 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:31.257121 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0709 19:35:31.257126 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0709 19:35:31.257211 10939 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0709 19:35:31.257256 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:31.257330 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:31.257395 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:31.257404 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0709 19:35:31.257430 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0709 19:35:31.257463 10939 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }] }] } I0709 19:35:31.257535 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:31.257636 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0709 19:35:31.257832 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.258120 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.258299 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.258444 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0709 19:35:31.258490 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0709 19:35:31.258546 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.258649 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.258754 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0709 19:35:31.258849 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I0709 19:35:31.258969 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.259070 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:31.259106 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0709 19:35:31.259202 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.259296 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0709 19:35:31.259365 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.259474 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.259577 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0709 19:35:31.259624 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0709 19:35:31.259656 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0709 19:35:31.259686 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0709 19:35:31.259716 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0709 19:35:31.259751 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:31.259843 10939 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0709 19:35:31.259920 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:31.260000 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:31.260014 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:31.260079 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:31.260138 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0709 19:35:31.260187 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I0709 19:35:31.260160 10939 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-4" },{ SubnetId: "subnet-5" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0709 19:35:31.260219 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:31.260318 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0709 19:35:31.260347 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-5" } I0709 19:35:31.260372 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:31.260462 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0709 19:35:31.260490 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0709 19:35:31.260521 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:31.260610 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0709 19:35:31.260638 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-6" } I0709 19:35:31.260661 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:31.260718 10939 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } I0709 19:35:31.260793 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:31.260803 10939 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }] }] } I0709 19:35:31.260919 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0709 19:35:31.260957 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0709 19:35:31.260992 10939 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0709 19:35:31.261027 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0709 19:35:31.261082 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-2" } I0709 19:35:31.261115 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:31.261186 10939 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-5"] }] } I0709 19:35:31.261262 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0709 19:35:31.261306 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0709 19:35:31.261284 10939 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-5", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0709 19:35:31.261354 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0709 19:35:31.261347 10939 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0709 19:35:31.261390 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0709 19:35:31.261422 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0709 19:35:31.261414 10939 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0709 19:35:31.261448 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } W0709 19:35:31.261472 10939 api.go:53] PageSize not implemented I0709 19:35:31.261481 10939 tags.go:42] CreateTags { Resources: ["subnet-5"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0709 19:35:31.261551 10939 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0709 19:35:31.261622 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:31.261620 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:31.261667 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:31.261658 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:31.261683 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0709 19:35:31.261791 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I0709 19:35:31.261706 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:31.261835 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:31.261853 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:31.261827 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:31.261910 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:31.261947 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0709 19:35:31.261935 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0709 19:35:31.261939 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:31.261986 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:31.262104 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-3" } I0709 19:35:31.262148 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:31.262237 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0709 19:35:31.266428 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:35:31.266572 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:31.266669 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:31.266746 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:31.266847 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:31.267391 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:35:31.267587 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:35:31.267856 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:35:31.267901 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:31.267929 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:31.267982 10939 dns.go:235] Pre-creating DNS records I0709 19:35:31.268004 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:31.273254 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0709 19:35:31.276284 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:31.276352 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:32.605363 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:32.760312 10939 iamrole.go:89] ListRoles: { } I0709 19:35:32.761879 10939 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0709 19:35:32.762074 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.762205 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:32.762232 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:32.762278 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:32.762316 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:32.762577 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.762704 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.763225 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:32.763253 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.764680 10939 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0709 19:35:32.764873 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0709 19:35:32.764843 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0709 19:35:32.764922 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0709 19:35:32.764962 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0709 19:35:32.764869 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.765493 10939 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0709 19:35:32.765490 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.765631 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.765744 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0709 19:35:32.765866 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:32.765902 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0709 19:35:32.766003 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:32.766043 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.766144 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:32.766221 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:32.766282 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.766371 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0709 19:35:32.766483 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:32.766911 10939 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0709 19:35:32.767017 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:32.767122 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:32.767230 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:32.767324 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0709 19:35:32.767364 10939 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0709 19:35:32.767393 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0709 19:35:32.767514 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.767678 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0709 19:35:32.767768 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.767895 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0709 19:35:32.767922 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.768029 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0709 19:35:32.768087 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:32.768310 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:32.768490 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.768601 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:32.768638 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:32.768698 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0709 19:35:32.768724 10939 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0709 19:35:32.768749 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0709 19:35:32.768782 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.768864 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.768944 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:32.768982 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:32.769076 10939 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0709 19:35:32.769158 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:32.769237 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:32.769228 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:32.769295 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:32.769310 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0709 19:35:32.769299 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:32.769349 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0709 19:35:32.769379 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0709 19:35:32.769408 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0709 19:35:32.769353 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0709 19:35:32.769436 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0709 19:35:32.769490 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:32.769555 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } W0709 19:35:32.769576 10939 api.go:53] PageSize not implemented I0709 19:35:32.769597 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:32.769664 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:32.769721 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:32.769773 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:32.769852 10939 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0709 19:35:32.769914 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:32.769925 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:32.769981 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:32.769971 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:32.769977 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:32.770015 10939 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0709 19:35:32.769997 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0709 19:35:32.770034 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:32.770058 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:32.770123 10939 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0709 19:35:32.770083 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0709 19:35:32.770080 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:32.770193 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:32.770212 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0709 19:35:32.770298 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:32.770327 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0709 19:35:32.770410 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:32.770430 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0709 19:35:32.774319 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:35:32.774420 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:32.774550 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:32.774621 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:32.774764 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:32.775368 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:35:32.775594 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:35:32.775826 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:35:32.778473 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:35:32.778531 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:32.778558 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:35:32.778578 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0709 19:35:32.778599 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0709 19:35:32.778622 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:35:32.778650 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0709 19:35:32.778671 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:35:32.778692 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:35:32.778712 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:32.778738 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:35:32.778761 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:35:32.778793 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:35:32.778818 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0709 19:35:32.778842 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0709 19:35:32.778864 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:32.778882 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:32.778903 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:32.778927 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:35:32.778951 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:35:32.778973 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0709 19:35:32.778996 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:32.779020 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:32.779043 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:32.779066 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:32.779091 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:32.779112 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:32.779137 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0709 19:35:32.779161 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0709 19:35:32.779184 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0709 19:35:32.779211 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0709 19:35:32.779233 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:32.779254 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:35:32.779276 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:32.779299 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:32.779323 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:32.779346 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:35:32.780949 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:35:32.781005 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:35:32.781021 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:35:32.781059 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.781104 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0709 19:35:32.781152 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.781201 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.781243 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.781284 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.781322 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.781359 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0709 19:35:32.781409 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.781469 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:32.781496 10939 natgateway.go:117] DescribeNatGateways: { } I0709 19:35:32.781539 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0709 19:35:32.781572 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0709 19:35:32.781616 10939 api.go:53] PageSize not implemented I0709 19:35:32.781632 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:32.781651 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:32.781664 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0709 19:35:32.781694 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:35:32.781712 10939 targetgroups.go:35] PageSize not implemented I0709 19:35:32.781746 10939 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" ] } I0709 19:35:32.781800 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:35:32.781830 10939 iamrole.go:89] ListRoles: { } I0709 19:35:32.781872 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:32.781895 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:32.781929 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:35:32.781966 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:32.782009 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-3","rtb-2"] } I0709 19:35:32.782045 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0709 19:35:32.782076 10939 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0709 19:35:32.782103 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0709 19:35:32.782127 10939 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0709 19:35:32.782685 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0709 19:35:32.782756 10939 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0709 19:35:32.782785 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0709 19:35:32.782819 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } I0709 19:35:32.782856 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I0709 19:35:32.782861 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:32.782911 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } I0709 19:35:32.782740 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-2 ok autoscaling-group:nodes.minimal-ipv6.example.com ok I0709 19:35:32.782911 10939 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0709 19:35:32.782936 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok security-group:sg-1 ok I0709 19:35:32.782977 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok I0709 19:35:32.782952 10939 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } iam-instance-profile:masters.minimal-ipv6.example.com ok route53-record:Z1AFAKE1ZON3YO/AAAA/api.minimal-ipv6.example.com ok I0709 19:35:32.783025 10939 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0709 19:35:32.782994 10939 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } subnet:subnet-5 ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I0709 19:35:32.783058 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0709 19:35:32.783106 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:32.783149 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 } ] } W0709 19:35:32.783377 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:32.783398 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0709 19:35:32.783431 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0709 19:35:32.783480 10939 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I0709 19:35:32.783526 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0709 19:35:32.783563 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:32.783604 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0709 19:35:32.783711 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:32.783730 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0709 19:35:32.783764 10939 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok autoscaling-config:lt-1 ok I0709 19:35:32.783842 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0709 19:35:32.783938 10939 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0709 19:35:32.783954 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0709 19:35:32.783996 10939 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0709 19:35:32.783986 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0709 19:35:32.784027 10939 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I0709 19:35:32.784024 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0709 19:35:32.784066 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0709 19:35:32.784102 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0709 19:35:32.784116 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I0709 19:35:32.784116 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } subnet:subnet-1 ok I0709 19:35:32.784159 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I0709 19:35:32.784161 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0709 19:35:32.784183 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0709 19:35:32.784217 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0709 19:35:32.784302 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0709 19:35:32.784357 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0709 19:35:32.784418 10939 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0709 19:35:32.784482 10939 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (3.03s) === RUN TestLifecycleSharedVPC I0709 19:35:32.785025 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:32.785280 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:32.785317 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:32.785352 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:32.785380 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:32.785416 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:32.785449 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:32.785469 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:32.785497 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:32.785521 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0709 19:35:32.804701 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:32.807296 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:32.807437 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:34.125324 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:34.273436 10939 iamrole.go:89] ListRoles: { } I0709 19:35:34.274298 10939 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0709 19:35:34.274652 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:34.274836 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0709 19:35:34.274845 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:34.274936 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0709 19:35:34.275084 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0709 19:35:34.275049 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:34.275205 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:34.275195 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0709 19:35:34.275264 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0709 19:35:34.275406 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:35:34.275475 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0709 19:35:34.275498 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0709 19:35:34.275538 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:34.275676 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:34.275667 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:34.275757 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:34.278713 10939 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0709 19:35:34.278975 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0709 19:35:34.279412 10939 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0709 19:35:34.279326 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:34.279500 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0709 19:35:34.279607 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:35:34.279764 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0709 19:35:34.279870 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0709 19:35:34.279765 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I0709 19:35:34.280165 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:35:34.280604 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0709 19:35:34.280638 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:34.281481 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:34.281491 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0709 19:35:34.281581 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:34.281648 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:35:34.281808 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:34.281881 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:34.281932 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:34.282044 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:34.282853 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0709 19:35:34.282969 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0709 19:35:34.283032 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:34.283066 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] } I0709 19:35:34.283631 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0709 19:35:34.286060 10939 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0709 19:35:34.286241 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:34.286380 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0709 19:35:34.286435 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0709 19:35:34.286643 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I0709 19:35:34.286914 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0709 19:35:34.287121 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:34.287220 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:34.287385 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0709 19:35:34.287598 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0709 19:35:34.287709 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0709 19:35:34.287815 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:34.287927 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:34.288025 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0709 19:35:34.288178 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:34.288291 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0709 19:35:34.288333 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" }] }] } I0709 19:35:34.288516 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" }] }] } I0709 19:35:34.288662 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0709 19:35:34.288766 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0709 19:35:34.288802 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0709 19:35:34.288831 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:34.289000 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0709 19:35:34.289154 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0709 19:35:34.289266 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0709 19:35:34.289362 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0709 19:35:34.289507 10939 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0709 19:35:34.289700 10939 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0709 19:35:34.289910 10939 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0709 19:35:34.289957 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:34.289991 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:34.290051 10939 dns.go:235] Pre-creating DNS records I0709 19:35:34.290078 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:34.294636 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:34.297284 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:34.297351 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:35.631807 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:35.778255 10939 iamrole.go:89] ListRoles: { } I0709 19:35:35.779301 10939 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0709 19:35:35.779657 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:35.779793 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.779921 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:35:35.779987 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0709 19:35:35.780022 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0709 19:35:35.780489 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.780572 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:35.782041 10939 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0709 19:35:35.782184 10939 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0709 19:35:35.782214 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:35:35.782389 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0709 19:35:35.782377 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0709 19:35:35.782597 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:35.782671 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0709 19:35:35.782847 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:35.782921 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.783088 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.783258 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:35.786613 10939 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0709 19:35:35.786744 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:35.786887 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:35.787008 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:35.787133 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:35.787206 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:35.787382 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:35.787643 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:35.787930 10939 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0709 19:35:35.788111 10939 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0709 19:35:35.788256 10939 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0709 19:35:35.790275 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:35:35.790327 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:35:35.790355 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:35:35.790378 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:35:35.790399 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:35:35.790422 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:35:35.790444 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:35:35.790469 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:35:35.790497 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:35.790517 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:35.790535 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:35.790555 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:35:35.790573 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:35.790593 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:35.790615 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:35.790637 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:35.790658 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:35.790676 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:35:35.790694 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:35.790718 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:35.790742 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:35:35.791787 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:35:35.791839 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:35:35.791855 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:35:35.791888 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.791926 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0709 19:35:35.791967 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.792013 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.792043 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.792075 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.792108 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.792135 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0709 19:35:35.792169 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.792210 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0709 19:35:35.792233 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0709 19:35:35.792267 10939 api.go:53] PageSize not implemented I0709 19:35:35.792286 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:35.792307 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:35.792325 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:35:35.792343 10939 targetgroups.go:35] PageSize not implemented I0709 19:35:35.792360 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0709 19:35:35.792400 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:35:35.792432 10939 iamrole.go:89] ListRoles: { } I0709 19:35:35.792467 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:35.792491 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:35.792527 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:35:35.792558 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:35.792582 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:35.792874 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I0709 19:35:35.792987 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } autoscaling-group:nodes.sharedvpc.example.com ok I0709 19:35:35.792925 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0709 19:35:35.793088 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:35.793104 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0709 19:35:35.793062 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok iam-instance-profile:nodes.sharedvpc.example.com ok I0709 19:35:35.793162 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0709 19:35:35.793172 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0709 19:35:35.793236 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok I0709 19:35:35.793056 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.sharedvpc.example.com. ok I0709 19:35:35.793271 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0709 19:35:35.793336 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0709 19:35:35.793383 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:35.793428 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0709 19:35:35.793532 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:35.793546 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0709 19:35:35.793623 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0709 19:35:35.793661 10939 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0709 19:35:35.793638 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0709 19:35:35.793674 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0709 19:35:35.793703 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0709 19:35:35.793728 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0709 19:35:35.793759 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0709 19:35:35.793768 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0709 19:35:35.793786 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0709 19:35:35.793831 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (3.01s) === RUN TestLifecycleComplex I0709 19:35:35.794371 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:35.794603 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:35.794635 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:35.794671 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:35.794699 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:35.794737 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:35.794772 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:35.794793 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:35.794821 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:35.794844 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0709 19:35:35.822696 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:35.826240 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:35.826310 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:37.111150 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:37.272469 10939 iamrole.go:89] ListRoles: { } I0709 19:35:37.273733 10939 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0709 19:35:37.274037 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } W0709 19:35:37.274187 10939 api.go:53] PageSize not implemented I0709 19:35:37.274171 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:37.274327 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:37.274346 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0709 19:35:37.274372 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:37.274445 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I0709 19:35:37.274526 10939 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.274572 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0709 19:35:37.274622 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0709 19:35:37.274644 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0709 19:35:37.274629 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" } ] } I0709 19:35:37.274663 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:37.274688 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:37.274740 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0709 19:35:37.276579 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:37.276767 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0709 19:35:37.276924 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0709 19:35:37.277096 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:37.277232 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:37.277374 10939 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.277613 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:37.277947 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:37.278125 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:37.278363 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:37.280464 10939 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0709 19:35:37.280551 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:37.280616 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:37.280668 10939 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0709 19:35:37.280759 10939 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:37.280740 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:37.280875 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:37.280876 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:37.280955 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:37.280990 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0709 19:35:37.281079 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:37.281172 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0709 19:35:37.281160 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:37.281242 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:37.281889 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0709 19:35:37.281962 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:37.281978 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I0709 19:35:37.281973 10939 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0709 19:35:37.282105 10939 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0709 19:35:37.282027 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0709 19:35:37.282161 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:37.282156 10939 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:37.281233 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0709 19:35:37.282191 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0709 19:35:37.282263 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:37.282292 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I0709 19:35:37.282271 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:37.282337 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:37.282432 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0709 19:35:37.282489 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:37.282552 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0709 19:35:37.282573 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:37.282676 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0709 19:35:37.282773 10939 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0709 19:35:37.282817 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:37.282889 10939 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0709 19:35:37.282923 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:37.282992 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:35:37.283030 10939 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] } I0709 19:35:37.283105 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:37.283054 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0709 19:35:37.283168 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:37.283218 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:37.283249 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:37.283286 10939 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0709 19:35:37.283319 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I0709 19:35:37.283401 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:37.283438 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:37.283464 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:37.283496 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:37.283523 10939 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0709 19:35:37.283337 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0709 19:35:37.283560 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:37.283661 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:37.283779 10939 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0709 19:35:37.283946 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:37.284069 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:37.284216 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:37.284420 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0709 19:35:37.284656 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.284787 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.284959 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.285181 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0709 19:35:37.285297 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0709 19:35:37.285387 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:37.285485 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:37.285592 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:37.285685 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0709 19:35:37.285763 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0709 19:35:37.285904 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0709 19:35:37.286004 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0709 19:35:37.286139 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:37.286216 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" } ] }] } I0709 19:35:37.286310 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0709 19:35:37.286369 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0709 19:35:37.286453 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0709 19:35:37.286497 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0709 19:35:37.286578 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" } ] }] } I0709 19:35:37.286693 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0709 19:35:37.286780 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-2", TransitGatewayId: "tgw-123456" } I0709 19:35:37.286822 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0709 19:35:37.286928 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0709 19:35:37.287008 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:37.287043 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.287147 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.287262 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:37.287324 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.287444 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0709 19:35:37.287524 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }] } I0709 19:35:37.287630 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.287743 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0709 19:35:37.287777 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0709 19:35:37.287903 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0709 19:35:37.288011 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.288119 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0709 19:35:37.288222 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0709 19:35:37.288290 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0709 19:35:37.288361 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-2", TransitGatewayId: "tgw-0123456" } I0709 19:35:37.288432 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0709 19:35:37.288478 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:37.288534 10939 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0709 19:35:37.288588 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:37.288614 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:37.288686 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:37.288696 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0709 19:35:37.288729 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0709 19:35:37.288769 10939 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-2" }], Tags: [ { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], Type: "network" } I0709 19:35:37.288862 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:37.288906 10939 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0709 19:35:37.288979 10939 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0709 19:35:37.289032 10939 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0709 19:35:37.289087 10939 api.go:53] PageSize not implemented I0709 19:35:37.289138 10939 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0709 19:35:37.289195 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:37.289187 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:37.289236 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:37.289245 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:37.289251 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:37.289366 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:37.289470 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:37.289560 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:37.289501 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:37.289578 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:37.294159 10939 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0709 19:35:37.294318 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:37.294421 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:37.294505 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:37.294626 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:37.295128 10939 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0709 19:35:37.295363 10939 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0709 19:35:37.295628 10939 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0709 19:35:37.295677 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:37.295707 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:37.295765 10939 dns.go:235] Pre-creating DNS records I0709 19:35:37.295786 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:37.302263 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:37.305754 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:37.305826 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:38.611000 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:38.778048 10939 iamrole.go:89] ListRoles: { } I0709 19:35:38.779687 10939 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0709 19:35:38.779927 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0709 19:35:38.780047 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0709 19:35:38.780089 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:38.780232 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0709 19:35:38.780374 10939 api.go:53] PageSize not implemented I0709 19:35:38.780358 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.780489 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:38.780518 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:38.780568 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.780713 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:38.780751 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.780898 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:38.780991 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.782194 10939 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0709 19:35:38.782320 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:38.782358 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:38.782445 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:38.782477 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:38.782447 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.782571 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:38.782538 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:38.782639 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:38.782536 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:38.782686 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:38.782763 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:38.782729 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.782878 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:38.782914 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.783034 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.783134 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:38.783167 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:38.783300 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:38.783351 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:38.783424 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:38.783486 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:38.783590 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:38.783646 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.783767 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:38.783876 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:38.784017 10939 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0709 19:35:38.784206 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.784346 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:38.784460 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:38.784697 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:38.784837 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:38.784983 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:38.785133 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:38.785199 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:38.785305 10939 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0709 19:35:38.785364 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:38.785407 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:38.785487 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:38.785504 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:38.785543 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:38.785571 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:38.785602 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:38.785628 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:38.785651 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0709 19:35:38.785725 10939 api.go:53] PageSize not implemented I0709 19:35:38.785768 10939 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0709 19:35:38.785807 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:38.785847 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:38.785868 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:38.785928 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:38.785858 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:38.785936 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:38.785990 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:38.786017 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:38.786039 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:38.786141 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:38.786194 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:38.786213 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:38.786298 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:38.786340 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:38.791905 10939 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0709 19:35:38.792162 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:38.792449 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:38.792737 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:38.792978 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:38.794000 10939 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0709 19:35:38.794955 10939 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0709 19:35:38.795359 10939 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0709 19:35:38.801353 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:38.804389 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:38.814140 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:38.817515 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:38.817581 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:40.139436 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:40.299440 10939 iamrole.go:89] ListRoles: { } I0709 19:35:40.301338 10939 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0709 19:35:40.301752 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:40.301749 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } W0709 19:35:40.301882 10939 api.go:53] PageSize not implemented I0709 19:35:40.301936 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:40.302065 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:40.302153 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:40.302177 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:40.302221 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:40.302502 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0709 19:35:40.302811 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:40.302941 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0709 19:35:40.303041 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:40.303181 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0709 19:35:40.304390 10939 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0709 19:35:40.304496 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:40.304542 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:40.304636 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:40.304648 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:40.304650 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:40.304701 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:40.304751 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:40.304682 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:40.304754 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:40.304842 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:40.304817 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:40.304879 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:40.304963 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:40.305119 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:40.305181 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:40.305346 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:40.305386 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:40.305499 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:40.305570 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:40.305716 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:40.305756 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:40.305829 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:40.305889 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:40.305927 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0709 19:35:40.306040 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:40.306272 10939 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0709 19:35:40.306380 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:40.306497 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:40.306575 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:40.306706 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:40.306816 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:40.306992 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:40.307186 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:40.307304 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:40.307529 10939 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0709 19:35:40.307597 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:40.307653 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:40.307668 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:40.307697 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:40.307595 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:40.307722 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:40.307750 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:40.307774 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:40.307796 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:40.307933 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0709 19:35:40.307961 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:40.307982 10939 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0709 19:35:40.308006 10939 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0709 19:35:40.308028 10939 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0709 19:35:40.308098 10939 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0709 19:35:40.308147 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:40.308171 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0709 19:35:40.308201 10939 api.go:53] PageSize not implemented I0709 19:35:40.308240 10939 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0709 19:35:40.308300 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:40.308334 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:40.308302 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:40.308360 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:40.308355 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:40.308388 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:40.308377 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:40.308500 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:40.308575 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:40.308600 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:40.308674 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:40.308707 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:40.308784 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:40.308810 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:40.313046 10939 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0709 19:35:40.313142 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:40.313282 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:40.313343 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:40.313483 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:40.313967 10939 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0709 19:35:40.314160 10939 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0709 19:35:40.314391 10939 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0709 19:35:40.314439 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:40.314472 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:40.314531 10939 dns.go:235] Pre-creating DNS records I0709 19:35:40.320855 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:40.324277 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:40.324353 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:41.612394 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:41.759539 10939 iamrole.go:89] ListRoles: { } I0709 19:35:41.761163 10939 executor.go:111] Tasks: 0 done / 135 total; 51 can run W0709 19:35:41.761581 10939 api.go:53] PageSize not implemented I0709 19:35:41.761537 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.761711 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.761910 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:41.761921 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:41.762022 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0709 19:35:41.762160 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0709 19:35:41.762269 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0709 19:35:41.762362 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.762483 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:41.762509 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:41.762555 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:41.762600 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.763722 10939 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0709 19:35:41.763831 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:41.763845 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:41.763834 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.763987 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:41.763923 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:41.764003 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.764070 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:41.764160 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:41.764167 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:41.764203 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:41.764245 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:41.764282 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:41.764292 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:41.764441 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:41.764490 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:41.764569 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0709 19:35:41.764682 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:41.764803 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:41.764842 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.764950 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:41.764986 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:41.765159 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:41.765214 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:41.765722 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:41.765787 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.765967 10939 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0709 19:35:41.766118 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:41.766218 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.766359 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:41.766597 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:41.766677 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:41.766820 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:41.766885 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:41.766983 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:41.767220 10939 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0709 19:35:41.767288 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:41.767343 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:41.767357 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:41.767387 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:41.767286 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:41.767412 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:41.767439 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:41.767462 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:41.767484 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0709 19:35:41.767554 10939 api.go:53] PageSize not implemented I0709 19:35:41.767592 10939 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0709 19:35:41.767648 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:41.767640 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:41.767682 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:41.767682 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:41.767699 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:41.767695 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:41.767754 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:41.767774 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:41.767797 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:41.767897 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:41.767918 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:41.767979 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:41.768016 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:41.768027 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:41.772434 10939 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0709 19:35:41.772599 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:41.772742 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:41.772801 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:41.772945 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:41.773377 10939 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0709 19:35:41.773588 10939 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0709 19:35:41.773800 10939 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0709 19:35:41.776488 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:41.779471 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:41.789096 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:41.792653 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:41.792724 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:43.109160 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:43.272458 10939 iamrole.go:89] ListRoles: { } I0709 19:35:43.274004 10939 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0709 19:35:43.274306 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.274449 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.274648 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.274739 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:43.274764 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:43.274811 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:43.274839 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:43.274847 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0709 19:35:43.274942 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0709 19:35:43.274978 10939 api.go:53] PageSize not implemented I0709 19:35:43.275390 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:43.275654 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0709 19:35:43.275981 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0709 19:35:43.276092 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.277405 10939 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0709 19:35:43.277574 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:43.277613 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:43.277693 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:43.277685 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:43.277678 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.277772 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:43.277753 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:43.277791 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:43.277889 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:43.277907 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:43.277989 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:43.278023 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:43.278048 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:43.278097 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:43.278223 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:43.278296 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.278456 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:43.278509 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.278628 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:43.278667 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.278784 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:43.278866 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:43.278935 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:43.279064 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:43.279114 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.279326 10939 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0709 19:35:43.279488 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:43.279575 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:43.279673 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:43.280011 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:43.280117 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:43.280241 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:43.280335 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:43.280494 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:43.280656 10939 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0709 19:35:43.280727 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:43.280786 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:43.280800 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:43.280786 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:43.280833 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:43.280936 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:43.280978 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:43.281006 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:43.281031 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0709 19:35:43.281111 10939 api.go:53] PageSize not implemented I0709 19:35:43.281171 10939 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0709 19:35:43.281221 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0709 19:35:43.281247 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:43.281291 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:43.281317 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:43.281337 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0709 19:35:43.281267 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:43.281369 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:43.281440 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:43.281493 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:43.281514 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:43.281591 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:43.281620 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:43.281700 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:43.281751 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:43.285926 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:35:43.286075 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:43.286227 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:43.286293 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:43.286445 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:43.286876 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:43.286933 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:43.287151 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:35:43.287358 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:35:43.287587 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:35:43.287633 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:43.287668 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:43.287729 10939 dns.go:235] Pre-creating DNS records I0709 19:35:43.293948 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:43.297399 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:43.297472 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:44.597309 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:44.766332 10939 iamrole.go:89] ListRoles: { } I0709 19:35:44.767888 10939 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0709 19:35:44.768124 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0709 19:35:44.768253 10939 api.go:53] PageSize not implemented I0709 19:35:44.768670 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0709 19:35:44.768996 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.769134 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:44.769124 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.769280 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0709 19:35:44.769617 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0709 19:35:44.769823 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.769966 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:44.770114 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.770224 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:44.770250 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:44.770299 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:44.771082 10939 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0709 19:35:44.771173 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:44.771202 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:44.771279 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:44.771310 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:44.771279 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.771415 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:44.771387 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.771512 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:44.771508 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:44.771550 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:44.771564 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:44.771600 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:44.771662 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:44.771759 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:44.771826 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.771929 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:44.772067 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:44.772113 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:44.772218 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:44.772252 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.772351 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:44.772380 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:44.772453 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:44.772557 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:44.772618 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.772851 10939 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0709 19:35:44.773116 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:44.773251 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:44.773359 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:44.773472 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:44.773604 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:44.773727 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:44.773838 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:44.773917 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:44.774073 10939 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0709 19:35:44.774128 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:44.774175 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:44.774255 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:44.774271 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:44.774310 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:44.774338 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:44.774370 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:44.774397 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:44.774421 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0709 19:35:44.774507 10939 api.go:53] PageSize not implemented I0709 19:35:44.774551 10939 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0709 19:35:44.774591 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:44.774630 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:44.774642 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:44.774642 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:44.774697 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:44.774732 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:44.774772 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:44.774832 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:44.774752 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:44.774892 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:44.774944 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:44.774964 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:44.775041 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:44.775094 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:44.779448 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:35:44.779613 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:44.779743 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:44.779808 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:44.779947 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:44.780380 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:35:44.780618 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:35:44.780767 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0709 19:35:44.784587 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:44.787541 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:44.787611 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:44.795211 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:44.798798 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:44.798870 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:44.798911 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:46.096786 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:46.261647 10939 iamrole.go:89] ListRoles: { } I0709 19:35:46.262973 10939 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0709 19:35:46.263193 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:46.263425 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:46.263449 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0709 19:35:46.263591 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:46.263988 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0709 19:35:46.264094 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:46.264910 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0709 19:35:46.265116 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0709 19:35:46.266243 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0709 19:35:46.266951 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0709 19:35:46.267250 10939 api.go:53] PageSize not implemented I0709 19:35:46.267244 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:46.267422 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:46.267539 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:46.270025 10939 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0709 19:35:46.270128 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:46.270202 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:46.270277 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:46.270316 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:46.270314 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:46.270255 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:46.270437 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:46.270513 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:46.270474 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:46.270584 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:46.270621 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:46.270643 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:46.271238 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:46.271274 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:46.271408 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:46.271457 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:46.271523 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:46.271616 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:46.271752 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:46.271883 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:46.271933 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:46.272050 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:46.272158 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:46.272231 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:46.272294 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:46.272560 10939 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0709 19:35:46.272659 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:46.272743 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:46.272882 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:46.273020 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:46.273394 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:46.273491 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:46.273617 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:46.273749 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:46.273886 10939 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0709 19:35:46.273952 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:46.273953 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:46.274043 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:46.274060 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:46.274097 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:46.274123 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:46.274151 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:46.274175 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:46.274197 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0709 19:35:46.274268 10939 api.go:53] PageSize not implemented I0709 19:35:46.274321 10939 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0709 19:35:46.274351 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:46.274398 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:46.274390 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:46.274430 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:46.274410 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:46.274482 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:46.274537 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:46.274532 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:46.274574 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:46.274594 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:46.274679 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:46.274711 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:46.274809 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:46.274854 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:46.278859 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:35:46.278951 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:46.279083 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:46.279169 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:46.279317 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:46.279786 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:35:46.280033 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:35:46.280162 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:35:46.280197 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:46.280229 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:46.280283 10939 dns.go:235] Pre-creating DNS records I0709 19:35:46.287291 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:46.290750 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:46.290823 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:46.290862 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.599764 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:47.762127 10939 iamrole.go:89] ListRoles: { } I0709 19:35:47.763673 10939 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0709 19:35:47.763975 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.764182 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0709 19:35:47.764312 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.764408 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:47.764434 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:47.764497 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:47.764574 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:47.764620 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0709 19:35:47.764715 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.764854 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W0709 19:35:47.764890 10939 api.go:53] PageSize not implemented I0709 19:35:47.764939 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0709 19:35:47.765017 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.765153 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:47.766587 10939 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0709 19:35:47.766714 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:47.766694 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.766830 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:47.766905 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:47.766968 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:47.766987 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:47.766999 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:47.766971 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:47.767052 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:47.767102 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:47.767126 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:47.767111 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:47.767208 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:47.767279 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:47.767331 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.767437 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:47.767552 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:47.767602 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:47.767685 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:47.767751 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.767857 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.767965 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:47.767994 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:47.768035 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.768127 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:47.768222 10939 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0709 19:35:47.768358 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:47.768506 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:47.768573 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:47.768733 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:47.768872 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:47.769160 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:47.769299 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:47.769535 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:47.769630 10939 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0709 19:35:47.769697 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:47.769753 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:47.769708 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:47.769768 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:47.769807 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:47.769836 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:47.769866 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:47.769891 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:47.769913 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0709 19:35:47.769980 10939 api.go:53] PageSize not implemented I0709 19:35:47.770019 10939 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0709 19:35:47.770058 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:47.770095 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:47.770093 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:47.770134 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:47.770106 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:47.770157 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:47.770206 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:47.770227 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:47.770252 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:47.770321 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:47.770373 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:47.770395 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:47.770475 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:47.770498 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:47.774889 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:35:47.775009 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.775167 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.775232 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.775378 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.775863 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:35:47.776077 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:35:47.776248 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0709 19:35:47.778578 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:47.781365 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.781434 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.781469 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.789244 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:47.792662 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.792731 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.792770 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:47.792802 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:49.092169 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:49.260797 10939 iamrole.go:89] ListRoles: { } I0709 19:35:49.262413 10939 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0709 19:35:49.262759 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0709 19:35:49.262849 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.263042 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0709 19:35:49.263150 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:49.263270 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0709 19:35:49.263317 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:49.263350 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.263473 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.263560 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:49.263584 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } W0709 19:35:49.263639 10939 api.go:53] PageSize not implemented I0709 19:35:49.263607 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.263730 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0709 19:35:49.263819 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:49.265329 10939 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0709 19:35:49.265877 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:49.265919 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.266142 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:49.266091 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:49.266103 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.266189 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:49.266229 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:49.266247 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:49.266269 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:49.266358 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:49.266393 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:49.266288 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.266478 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:49.266556 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.266656 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:49.266772 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:49.266820 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:49.266953 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:49.266991 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:49.267060 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:49.267181 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:49.267254 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:49.267371 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:49.267442 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.267551 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:49.267656 10939 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0709 19:35:49.267727 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:49.267851 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:49.267965 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:49.268350 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:49.268557 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:49.268685 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:49.268799 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:49.268913 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:49.269047 10939 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0709 19:35:49.269107 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:49.269121 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:49.269187 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:49.269201 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:49.269254 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:49.269282 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:49.269311 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:49.269334 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:49.269356 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0709 19:35:49.269434 10939 api.go:53] PageSize not implemented I0709 19:35:49.269481 10939 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0709 19:35:49.269541 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:49.269543 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:49.269596 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:49.269590 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:49.269615 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:49.269578 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:49.269612 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:49.269710 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:49.269763 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:49.269784 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:49.269867 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:49.269904 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:49.269995 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:49.270036 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:49.274079 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:35:49.274197 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:49.274347 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:49.274408 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:49.274538 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:49.275011 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:35:49.275297 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:35:49.275492 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:35:49.275541 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:49.275571 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:49.275627 10939 dns.go:235] Pre-creating DNS records I0709 19:35:49.281956 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0709 19:35:49.287894 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:49.288064 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:49.288338 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:49.288554 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:50.574797 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:50.736915 10939 iamrole.go:89] ListRoles: { } I0709 19:35:50.738291 10939 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0709 19:35:50.738537 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.738617 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:50.738706 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:50.738773 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:35:50.738838 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:50.738881 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0709 19:35:50.738980 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.739133 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0709 19:35:50.739200 10939 api.go:53] PageSize not implemented I0709 19:35:50.739322 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0709 19:35:50.739499 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.739680 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0709 19:35:50.739813 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0709 19:35:50.739885 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0709 19:35:50.741791 10939 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0709 19:35:50.741935 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.742142 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:50.742087 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0709 19:35:50.742093 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.742197 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:50.742248 10939 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:50.742246 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:50.742276 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0709 19:35:50.742336 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0709 19:35:50.742421 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:50.742438 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:50.742463 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0709 19:35:50.742490 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:50.742593 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0709 19:35:50.742717 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:50.742749 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.742843 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.742937 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:35:50.742964 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:50.743030 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0709 19:35:50.743149 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:50.743184 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0709 19:35:50.743299 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:50.743358 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:50.743508 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:50.743965 10939 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0709 19:35:50.744166 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:50.744376 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:50.744614 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:50.744705 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.744825 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0709 19:35:50.744917 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:50.745026 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:50.745182 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:50.745393 10939 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0709 19:35:50.745453 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:35:50.745487 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:50.745567 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:50.745583 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:50.745634 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:50.745668 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0709 19:35:50.745697 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0709 19:35:50.745735 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0709 19:35:50.745768 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0709 19:35:50.745851 10939 api.go:53] PageSize not implemented I0709 19:35:50.745902 10939 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0709 19:35:50.745939 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:50.745991 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:50.745991 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:50.746011 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:50.746061 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:50.746128 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:50.746087 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:50.746159 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:50.746050 10939 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0709 19:35:50.746177 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:50.746288 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:50.746326 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:50.746435 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0709 19:35:50.746456 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:50.752907 10939 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0709 19:35:50.753172 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:50.753465 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:50.753885 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:50.754168 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:50.754726 10939 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0709 19:35:50.754925 10939 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0709 19:35:50.755785 10939 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0709 19:35:50.755907 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:35:50.755952 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:50.755981 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:35:50.756002 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:35:50.756024 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:35:50.756045 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:35:50.756064 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:50.756086 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:35:50.756114 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:35:50.756138 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:50.756157 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:50.756179 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:50.756202 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:35:50.756220 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:35:50.756242 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:50.756267 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:50.756289 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:50.756310 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:50.756335 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:50.756354 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:35:50.756378 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0709 19:35:50.756399 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:50.756417 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:35:50.756435 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:50.756457 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:50.756479 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:50.756503 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:35:50.758642 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:35:50.758698 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:35:50.758714 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:35:50.758742 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.758785 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0709 19:35:50.758829 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.758873 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.758906 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.758946 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.758978 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.759009 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0709 19:35:50.759049 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.759096 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0709 19:35:50.759124 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0709 19:35:50.759169 10939 api.go:53] PageSize not implemented I0709 19:35:50.759184 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:50.759204 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:50.759216 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0709 19:35:50.759247 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:35:50.759265 10939 targetgroups.go:35] PageSize not implemented I0709 19:35:50.759279 10939 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0709 19:35:50.759330 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:35:50.759361 10939 iamrole.go:89] ListRoles: { } I0709 19:35:50.759398 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:50.759420 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:50.759452 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:35:50.759488 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:50.759522 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } autoscaling-config:lt-1 ok I0709 19:35:50.759981 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:50.760030 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0709 19:35:50.759995 10939 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0709 19:35:50.760072 10939 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I0709 19:35:50.760066 10939 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0709 19:35:50.760104 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0709 19:35:50.760136 10939 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5 ok I0709 19:35:50.760162 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I0709 19:35:50.760172 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } autoscaling-group:nodes.complex.example.com ok subnet:subnet-1 ok I0709 19:35:50.760253 10939 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } autoscaling-group:master-us-test-1a.masters.complex.example.com ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4 ok I0709 19:35:50.760287 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0709 19:35:50.760117 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.complex.example.com. ok I0709 19:35:50.760339 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } internet-gateway:igw-2 ok I0709 19:35:50.760343 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0709 19:35:50.760410 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok I0709 19:35:50.760378 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 } ] } W0709 19:35:50.760548 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:50.760567 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-2 ok I0709 19:35:50.760608 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0709 19:35:50.760653 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:50.760693 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 } ] } W0709 19:35:50.761051 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:50.761079 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0709 19:35:50.761132 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0709 19:35:50.761275 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0709 19:35:50.761340 10939 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0709 19:35:50.761360 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0709 19:35:50.761409 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0709 19:35:50.761388 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0709 19:35:50.761461 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0709 19:35:50.761532 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0709 19:35:50.761554 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0709 19:35:50.761532 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0709 19:35:50.761601 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0709 19:35:50.761746 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0709 19:35:50.761837 10939 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0709 19:35:50.761897 10939 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (14.97s) === RUN TestLifecycleExternalLB I0709 19:35:50.762470 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:50.762696 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:50.762730 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:50.762763 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:50.762793 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:50.762830 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:50.762866 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:50.762888 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:50.762918 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:50.762941 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0709 19:35:50.783744 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:50.786409 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:50.786554 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:52.113959 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:52.256552 10939 iamrole.go:89] ListRoles: { } I0709 19:35:52.257608 10939 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0709 19:35:52.257858 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W0709 19:35:52.258066 10939 api.go:53] PageSize not implemented I0709 19:35:52.257989 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0709 19:35:52.258155 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0709 19:35:52.258198 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0709 19:35:52.258096 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:52.258273 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:52.258262 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } W0709 19:35:52.258380 10939 api.go:53] PageSize not implemented I0709 19:35:52.258337 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:52.258422 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0709 19:35:52.258538 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0709 19:35:52.258526 10939 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.258605 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0709 19:35:52.258518 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I0709 19:35:52.258659 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0709 19:35:52.258646 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:52.258793 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:52.258804 10939 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.258892 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:52.258869 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0709 19:35:52.258969 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0709 19:35:52.258998 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0709 19:35:52.258932 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0709 19:35:52.259041 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:52.259077 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:52.259104 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:52.259235 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.259350 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:52.259480 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:52.259580 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:52.259987 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0709 19:35:52.260046 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } W0709 19:35:52.260156 10939 api.go:53] PageSize not implemented I0709 19:35:52.261584 10939 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0709 19:35:52.261735 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0709 19:35:52.261789 10939 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0709 19:35:52.261756 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:52.261836 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0709 19:35:52.261866 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0709 19:35:52.261929 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0709 19:35:52.261892 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0709 19:35:52.261936 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0709 19:35:52.262008 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:52.262047 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0709 19:35:52.262104 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:52.262274 10939 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.262345 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:52.262368 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0709 19:35:52.262386 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0709 19:35:52.262528 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:35:52.262602 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:52.262646 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:52.262684 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }], VpcId: "vpc-1" } I0709 19:35:52.262783 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:52.262831 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:52.262863 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] }] } I0709 19:35:52.262948 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:52.263010 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:52.263061 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0709 19:35:52.263184 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:52.264418 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:52.264537 10939 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0709 19:35:52.264643 10939 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0709 19:35:52.264746 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0709 19:35:52.269169 10939 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0709 19:35:52.269366 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.269574 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.269694 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:52.270477 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0709 19:35:52.270530 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0709 19:35:52.270567 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.270738 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.270854 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:52.270932 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:52.271007 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0709 19:35:52.271236 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.271417 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.271528 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" }] }] } I0709 19:35:52.271654 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:52.271786 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" }] }] } I0709 19:35:52.271980 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0709 19:35:52.272101 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.272217 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.272316 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0709 19:35:52.272413 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:52.272504 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:52.272612 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:35:52.272706 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:52.272832 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:52.272920 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0709 19:35:52.273328 10939 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0709 19:35:52.273572 10939 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0709 19:35:52.273822 10939 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0709 19:35:52.273864 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:52.273896 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:52.273953 10939 dns.go:235] Pre-creating DNS records I0709 19:35:52.273978 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:52.279612 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:52.282162 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:52.282234 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:53.620089 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:53.768132 10939 iamrole.go:89] ListRoles: { } I0709 19:35:53.769168 10939 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0709 19:35:53.769364 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:53.769492 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.769559 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0709 19:35:53.769617 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:35:53.769663 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } W0709 19:35:53.769695 10939 api.go:53] PageSize not implemented I0709 19:35:53.769629 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } W0709 19:35:53.769777 10939 api.go:53] PageSize not implemented I0709 19:35:53.769781 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0709 19:35:53.769728 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:53.769916 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.769981 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0709 19:35:53.770096 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0709 19:35:53.770129 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0709 19:35:53.770121 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.770223 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } W0709 19:35:53.770312 10939 api.go:53] PageSize not implemented I0709 19:35:53.770308 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0709 19:35:53.770342 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0709 19:35:53.770258 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.770490 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:53.771293 10939 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0709 19:35:53.771385 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0709 19:35:53.771418 10939 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0709 19:35:53.771469 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0709 19:35:53.771617 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0709 19:35:53.771751 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:53.771834 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:53.771892 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:53.771931 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.772030 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.772134 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:35:53.772165 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.772254 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:35:53.780010 10939 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0709 19:35:53.780236 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:53.780388 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:53.780554 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:53.780725 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:53.780885 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:53.780977 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:53.781179 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:35:53.781465 10939 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0709 19:35:53.781639 10939 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0709 19:35:53.781869 10939 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0709 19:35:53.784210 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:35:53.784265 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:35:53.784294 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:35:53.784315 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:35:53.784335 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:35:53.784354 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:35:53.784373 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:35:53.784395 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:35:53.784424 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:35:53.784451 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:35:53.784476 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:53.784494 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:53.784511 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:35:53.784532 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:35:53.784549 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:53.784569 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:53.784589 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:35:53.784613 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:53.784631 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:53.784649 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:35:53.784670 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:53.784692 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:53.784716 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:35:53.784737 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:35:53.785788 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:35:53.785842 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:35:53.785856 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:35:53.785890 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.785931 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0709 19:35:53.785978 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.786024 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.786059 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.786101 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.786132 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.786159 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0709 19:35:53.786193 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.786232 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0709 19:35:53.786258 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0709 19:35:53.786297 10939 api.go:53] PageSize not implemented I0709 19:35:53.786316 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:53.786335 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:53.786349 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:35:53.786364 10939 targetgroups.go:35] PageSize not implemented I0709 19:35:53.786378 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0709 19:35:53.786419 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:35:53.786451 10939 iamrole.go:89] ListRoles: { } I0709 19:35:53.786492 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:53.786518 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:53.786552 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:35:53.786586 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:53.786611 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok autoscaling-config:lt-1 ok I0709 19:35:53.787081 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:53.787081 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0709 19:35:53.787200 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok autoscaling-group:nodes.externallb.example.com ok I0709 19:35:53.787156 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0709 19:35:53.787352 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:53.787378 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0709 19:35:53.787433 10939 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0709 19:35:53.787449 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0709 19:35:53.787585 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I0709 19:35:53.787238 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.externallb.example.com. ok I0709 19:35:53.787549 10939 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0709 19:35:53.787723 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:53.787815 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0709 19:35:53.787986 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:53.788005 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0709 19:35:53.788039 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0709 19:35:53.788081 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0709 19:35:53.788134 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I0709 19:35:53.788236 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0709 19:35:53.788273 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0709 19:35:53.788285 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0709 19:35:53.788311 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0709 19:35:53.788294 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0709 19:35:53.788334 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0709 19:35:53.788410 10939 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0709 19:35:53.788429 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0709 19:35:53.788461 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0709 19:35:53.788534 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0709 19:35:53.788617 10939 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0709 19:35:53.788731 10939 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (3.03s) === RUN TestLifecycleSharedSubnet I0709 19:35:53.789625 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:53.789859 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:53.789892 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:53.789927 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:53.789958 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:53.789995 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:53.790028 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:53.790048 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:53.790074 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:53.790096 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0709 19:35:53.809282 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:53.811932 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:53.811999 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:55.094226 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:55.237083 10939 iamrole.go:89] ListRoles: { } I0709 19:35:55.237832 10939 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0709 19:35:55.238129 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:55.238262 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0709 19:35:55.238313 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:55.238374 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0709 19:35:55.238462 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:55.238488 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0709 19:35:55.238541 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0709 19:35:55.238555 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:55.238722 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:55.239978 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:35:55.240120 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0709 19:35:55.240180 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0709 19:35:55.240322 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:55.240526 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:55.241582 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:55.242082 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0709 19:35:55.246357 10939 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0709 19:35:55.246483 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:35:55.246522 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0709 19:35:55.246633 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0709 19:35:55.246670 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0709 19:35:55.246812 10939 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0709 19:35:55.246857 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:35:55.246886 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0709 19:35:55.246941 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:55.246989 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:55.247023 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0709 19:35:55.247060 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0709 19:35:55.247168 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0709 19:35:55.247394 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:35:55.247488 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:55.247553 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:55.247615 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:55.247671 10939 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" } ] } I0709 19:35:55.248365 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0709 19:35:55.251401 10939 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0709 19:35:55.251597 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0709 19:35:55.251778 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0709 19:35:55.251904 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:55.251997 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:55.252146 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0709 19:35:55.252363 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0709 19:35:55.252576 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0709 19:35:55.252746 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0709 19:35:55.252888 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" }] }] } I0709 19:35:55.252987 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0709 19:35:55.253084 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:55.253165 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:55.253260 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0709 19:35:55.253442 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0709 19:35:55.253583 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0709 19:35:55.253714 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0709 19:35:55.253848 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0709 19:35:55.253992 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0709 19:35:55.254175 10939 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0709 19:35:55.254376 10939 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0709 19:35:55.254567 10939 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0709 19:35:55.254609 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:55.254648 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:55.254706 10939 dns.go:235] Pre-creating DNS records I0709 19:35:55.254731 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:55.259631 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:55.262229 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:55.262298 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:56.572479 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:56.719673 10939 iamrole.go:89] ListRoles: { } I0709 19:35:56.720584 10939 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0709 19:35:56.720880 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:56.721082 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.721207 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.721280 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:35:56.721357 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0709 19:35:56.721391 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0709 19:35:56.722006 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:56.723371 10939 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0709 19:35:56.723638 10939 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0709 19:35:56.723573 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0709 19:35:56.723760 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0709 19:35:56.723799 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:56.723876 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:35:56.723996 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0709 19:35:56.724124 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:56.724186 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0709 19:35:56.727840 10939 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0709 19:35:56.727964 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:56.728118 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:56.728374 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:56.728547 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:56.729129 10939 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0709 19:35:56.729322 10939 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0709 19:35:56.729494 10939 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0709 19:35:56.731574 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:35:56.731627 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:35:56.731652 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:35:56.731677 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:35:56.731696 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:35:56.731718 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:35:56.731765 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:35:56.731797 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:35:56.731824 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:56.731849 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:56.731871 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:35:56.731889 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:56.731912 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:56.731932 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:56.731953 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:56.731973 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:35:56.731991 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:56.732013 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:56.732035 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:35:56.733109 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:35:56.733164 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:35:56.733179 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:35:56.733209 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.733246 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0709 19:35:56.733286 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.733330 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.733361 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.733393 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.733428 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.733453 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0709 19:35:56.733479 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.733514 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0709 19:35:56.733537 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0709 19:35:56.733572 10939 api.go:53] PageSize not implemented I0709 19:35:56.733590 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:56.733611 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:56.733627 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:35:56.733646 10939 targetgroups.go:35] PageSize not implemented I0709 19:35:56.733662 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0709 19:35:56.733704 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:35:56.733739 10939 iamrole.go:89] ListRoles: { } I0709 19:35:56.733777 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:56.733802 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:56.733836 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:35:56.733869 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:35:56.734171 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:nodes.sharedsubnet.example.com ok autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I0709 19:35:56.734221 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0709 19:35:56.734293 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok I0709 19:35:56.734222 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0709 19:35:56.734386 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:56.734403 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0709 19:35:56.734442 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0709 19:35:56.734381 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedsubnet.example.com. ok I0709 19:35:56.734490 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0709 19:35:56.734557 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0709 19:35:56.734591 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0709 19:35:56.734631 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok I0709 19:35:56.734650 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:56.734714 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0709 19:35:56.734818 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:56.734839 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I0709 19:35:56.734917 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0709 19:35:56.734961 10939 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0709 19:35:56.734974 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0709 19:35:56.735011 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I0709 19:35:56.735042 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0709 19:35:56.735095 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0709 19:35:56.735105 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0709 19:35:56.735128 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (2.95s) === RUN TestLifecyclePrivateSharedSubnet I0709 19:35:56.735661 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:56.735901 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:56.735936 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:56.735971 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:56.735999 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:56.736038 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:56.736071 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:56.736091 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:56.736117 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:56.736138 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0709 19:35:56.757904 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:56.760671 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:56.760812 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:56.760854 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:58.112789 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:58.251254 10939 iamrole.go:89] ListRoles: { } I0709 19:35:58.252611 10939 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0709 19:35:58.252926 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:58.253070 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:58.253119 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0709 19:35:58.253227 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0709 19:35:58.253232 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.253367 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] }] } I0709 19:35:58.253511 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:58.253519 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0709 19:35:58.253622 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:58.253662 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:35:58.253745 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:58.253777 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:35:58.253834 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0709 19:35:58.253856 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0709 19:35:58.253656 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0709 19:35:58.253970 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0709 19:35:58.254038 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0709 19:35:58.254083 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:58.255248 10939 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0709 19:35:58.255374 10939 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0709 19:35:58.255404 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0709 19:35:58.255436 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:35:58.255505 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0709 19:35:58.255576 10939 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0709 19:35:58.255608 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0709 19:35:58.255567 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0709 19:35:58.255684 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0709 19:35:58.255698 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0709 19:35:58.255792 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0709 19:35:58.255854 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0709 19:35:58.255889 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:35:58.255991 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:58.256036 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:58.256002 10939 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0709 19:35:58.256063 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0709 19:35:58.256069 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:35:58.256175 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:58.256150 10939 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0709 19:35:58.256246 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0709 19:35:58.256408 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0709 19:35:58.256598 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0709 19:35:58.256682 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:58.256721 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:58.256752 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0709 19:35:58.256893 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:35:58.256964 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0709 19:35:58.257033 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:58.257076 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:58.257111 10939 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I0709 19:35:58.257166 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:58.257194 10939 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I0709 19:35:58.257246 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0709 19:35:58.257278 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:35:58.257318 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0709 19:35:58.257636 10939 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0709 19:35:58.257776 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.257845 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:58.257916 10939 loadbalancers.go:35] PageSize not implemented W0709 19:35:58.258002 10939 api.go:53] PageSize not implemented I0709 19:35:58.258005 10939 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I0709 19:35:58.257955 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0709 19:35:58.258152 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:58.258168 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I0709 19:35:58.258243 10939 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0709 19:35:58.258329 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:58.258298 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.258374 10939 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0709 19:35:58.258437 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0709 19:35:58.258471 10939 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0709 19:35:58.258520 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.258625 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.258787 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0709 19:35:58.258952 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.259087 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0709 19:35:58.259192 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.259284 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0709 19:35:58.259361 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:58.259444 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0709 19:35:58.259503 10939 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } W0709 19:35:58.259612 10939 api.go:53] PageSize not implemented I0709 19:35:58.259630 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:58.259482 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.259684 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.259811 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.259930 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0709 19:35:58.260011 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0709 19:35:58.260108 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" }] }] } I0709 19:35:58.260209 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.260310 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0709 19:35:58.260382 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" }] }] } I0709 19:35:58.260481 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0709 19:35:58.260579 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:58.260672 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" }] }] } I0709 19:35:58.260776 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0709 19:35:58.260912 10939 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0709 19:35:58.260960 10939 api.go:53] PageSize not implemented I0709 19:35:58.260993 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:58.261002 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0709 19:35:58.261031 10939 api.go:53] PageSize not implemented I0709 19:35:58.261131 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:58.261117 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:58.261251 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:58.261327 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:58.270569 10939 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0709 19:35:58.270855 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:58.270980 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:58.271067 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:58.271169 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:58.271719 10939 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0709 19:35:58.271976 10939 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0709 19:35:58.272216 10939 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0709 19:35:58.272268 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:58.272300 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:58.272360 10939 dns.go:235] Pre-creating DNS records I0709 19:35:58.272384 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:58.278288 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:58.281297 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:58.281365 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:58.281406 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:59.594708 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:59.738951 10939 iamrole.go:89] ListRoles: { } I0709 19:35:59.740190 10939 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0709 19:35:59.740484 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:59.740892 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:35:59.740999 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0709 19:35:59.741031 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0709 19:35:59.741406 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] }] } I0709 19:35:59.741742 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:35:59.741974 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:35:59.743111 10939 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0709 19:35:59.743198 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0709 19:35:59.743225 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0709 19:35:59.743308 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0709 19:35:59.743339 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0709 19:35:59.743317 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0709 19:35:59.743274 10939 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0709 19:35:59.743427 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:35:59.743469 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0709 19:35:59.743539 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0709 19:35:59.743558 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:59.743572 10939 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0709 19:35:59.743591 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0709 19:35:59.743698 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0709 19:35:59.743785 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:59.743819 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0709 19:35:59.743917 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:35:59.743963 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:35:59.745025 10939 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0709 19:35:59.745346 10939 api.go:53] PageSize not implemented I0709 19:35:59.745296 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:59.745287 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0709 19:35:59.745405 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0709 19:35:59.745427 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:59.745388 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:59.745453 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0709 19:35:59.745507 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:59.745562 10939 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0709 19:35:59.745504 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0709 19:35:59.745678 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0709 19:35:59.745718 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0709 19:35:59.745754 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } W0709 19:35:59.745822 10939 api.go:53] PageSize not implemented I0709 19:35:59.745836 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:59.745892 10939 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0709 19:35:59.745947 10939 api.go:53] PageSize not implemented I0709 19:35:59.745963 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:59.745995 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:59.746015 10939 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0709 19:35:59.746021 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:35:59.746077 10939 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0709 19:35:59.746037 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:59.746159 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0709 19:35:59.746285 10939 api.go:53] PageSize not implemented I0709 19:35:59.746351 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:59.754947 10939 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0709 19:35:59.755093 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:59.755232 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:59.755321 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:59.755458 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:59.756018 10939 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0709 19:35:59.756150 10939 api.go:53] PageSize not implemented I0709 19:35:59.756189 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:59.756470 10939 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0709 19:35:59.756847 10939 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0709 19:35:59.759932 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:35:59.759987 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:35:59.760011 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:35:59.760030 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:35:59.760050 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:35:59.760068 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:35:59.760090 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:35:59.760122 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:35:59.760148 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0709 19:35:59.760174 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:35:59.760192 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:35:59.760211 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:35:59.760234 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:35:59.760255 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:35:59.760278 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:35:59.760299 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0709 19:35:59.760319 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:35:59.760340 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:35:59.760361 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:35:59.760383 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:35:59.760404 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:35:59.760427 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:35:59.761747 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:35:59.761806 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:35:59.761821 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:35:59.761853 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:59.761898 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0709 19:35:59.761948 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:59.761998 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:59.762028 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:59.762059 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:59.762091 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:59.762115 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0709 19:35:59.762144 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:59.762177 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0709 19:35:59.762204 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0709 19:35:59.762236 10939 api.go:53] PageSize not implemented I0709 19:35:59.762251 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0709 19:35:59.762282 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:35:59.762304 10939 loadbalancers.go:35] PageSize not implemented I0709 19:35:59.762316 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0709 19:35:59.762348 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:35:59.762366 10939 targetgroups.go:35] PageSize not implemented I0709 19:35:59.762380 10939 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I0709 19:35:59.762423 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:35:59.762458 10939 iamrole.go:89] ListRoles: { } I0709 19:35:59.762496 10939 zones.go:93] ListHostedZonesPages { } I0709 19:35:59.762520 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:35:59.762552 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:35:59.762584 10939 routetable.go:53] DescribeRouteTables: { } autoscaling-config:lt-1 ok autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0709 19:35:59.762984 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:bastion.private-shared-subnet.example.com ok I0709 19:35:59.763053 10939 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I0709 19:35:59.763032 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } I0709 19:35:59.763141 10939 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok W0709 19:35:59.763203 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:59.763164 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0709 19:35:59.763220 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-3 ok I0709 19:35:59.763237 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok I0709 19:35:59.763249 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:35:59.763234 10939 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok I0709 19:35:59.763274 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } autoscaling-group:nodes.private-shared-subnet.example.com ok I0709 19:35:59.763338 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok I0709 19:35:59.763193 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-subnet.example.com. ok I0709 19:35:59.763286 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W0709 19:35:59.763385 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:59.763373 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0709 19:35:59.763412 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0709 19:35:59.763397 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0709 19:35:59.763450 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:35:59.763507 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W0709 19:35:59.763603 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:35:59.763621 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok autoscaling-config:lt-2 ok I0709 19:35:59.763654 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0709 19:35:59.763705 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0709 19:35:59.763754 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0709 19:35:59.763824 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0709 19:35:59.763861 10939 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0709 19:35:59.763849 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:35:59.763873 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0709 19:35:59.763898 10939 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I0709 19:35:59.763921 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0709 19:35:59.763949 10939 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0709 19:35:59.763959 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0709 19:35:59.763900 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0709 19:35:59.763984 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } W0709 19:35:59.763989 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-role:masters.private-shared-subnet.example.com ok I0709 19:35:59.764003 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0709 19:35:59.764007 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0709 19:35:59.764053 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0709 19:35:59.764064 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0709 19:35:59.764087 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (3.03s) === RUN TestLifecyclePrivateSharedIP I0709 19:35:59.764588 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:35:59.764810 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:35:59.764843 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:35:59.764877 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:35:59.764906 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:35:59.764941 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:35:59.764972 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:35:59.764993 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:35:59.765019 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:35:59.765042 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0709 19:35:59.786780 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:35:59.789643 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:59.789708 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:35:59.789753 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:01.087106 10939 zones.go:93] ListHostedZonesPages { } I0709 19:36:01.229461 10939 iamrole.go:89] ListRoles: { } I0709 19:36:01.230642 10939 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0709 19:36:01.230828 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:01.230937 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0709 19:36:01.230980 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:36:01.231060 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-ip.example.com" }] } I0709 19:36:01.232888 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:36:01.232987 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:36:01.233202 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.234107 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0709 19:36:01.234264 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" }] } I0709 19:36:01.234732 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:36:01.234907 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:36:01.234944 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0709 19:36:01.235034 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0709 19:36:01.235477 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:01.235899 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:36:01.236520 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:36:01.236555 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0709 19:36:01.237178 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0709 19:36:01.238989 10939 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0709 19:36:01.239125 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0709 19:36:01.239156 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:01.239211 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0709 19:36:01.239265 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0709 19:36:01.239289 10939 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0709 19:36:01.239402 10939 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0709 19:36:01.239382 10939 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0709 19:36:01.239345 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:36:01.239456 10939 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0709 19:36:01.239369 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I0709 19:36:01.239489 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0709 19:36:01.239477 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:01.239551 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0709 19:36:01.239657 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0709 19:36:01.239684 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0709 19:36:01.239786 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0709 19:36:01.239815 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:36:01.239855 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:36:01.239874 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0709 19:36:01.239892 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0709 19:36:01.239968 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0709 19:36:01.240012 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:36:01.240064 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:36:01.240102 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0709 19:36:01.240271 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:36:01.240340 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:36:01.240373 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:36:01.240399 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0709 19:36:01.240542 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:36:01.240629 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:01.240725 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:01.240798 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0709 19:36:01.240819 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I0709 19:36:01.240885 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:36:01.240947 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:36:01.240990 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:36:01.241037 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0709 19:36:01.241112 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0709 19:36:01.241206 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0709 19:36:01.241254 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:36:01.241287 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0709 19:36:01.241194 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0709 19:36:01.241410 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0709 19:36:01.241449 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:36:01.241499 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:36:01.241537 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:36:01.241574 10939 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0709 19:36:01.241667 10939 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0709 19:36:01.241819 10939 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } W0709 19:36:01.241933 10939 api.go:53] PageSize not implemented I0709 19:36:01.241893 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:01.241979 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:36:01.242073 10939 loadbalancers.go:35] PageSize not implemented I0709 19:36:01.242068 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0709 19:36:01.242107 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:01.242115 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.242204 10939 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0709 19:36:01.242200 10939 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0709 19:36:01.242280 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:01.242300 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:36:01.242306 10939 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0709 19:36:01.242359 10939 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0709 19:36:01.242338 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0709 19:36:01.242342 10939 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } W0709 19:36:01.242559 10939 api.go:53] PageSize not implemented I0709 19:36:01.242500 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.242587 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:01.242608 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0709 19:36:01.242693 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.242814 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:36:01.242928 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:36:01.242962 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:36:01.243020 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" }] }] } I0709 19:36:01.243146 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:36:01.243242 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:36:01.243303 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.243526 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" }] }] } I0709 19:36:01.243662 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0709 19:36:01.243802 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.243931 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0709 19:36:01.243963 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.244061 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.244160 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:01.244257 10939 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0709 19:36:01.244297 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0709 19:36:01.244335 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" }] }] } I0709 19:36:01.244437 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0709 19:36:01.244530 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.244626 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0709 19:36:01.244696 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.244789 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-2" } I0709 19:36:01.244826 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0709 19:36:01.244864 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.244958 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0709 19:36:01.245022 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0709 19:36:01.245139 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.245237 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I0709 19:36:01.245330 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:01.245367 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.245459 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0709 19:36:01.245502 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.245672 10939 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0709 19:36:01.245726 10939 api.go:53] PageSize not implemented I0709 19:36:01.245758 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:01.245763 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0709 19:36:01.245859 10939 api.go:53] PageSize not implemented I0709 19:36:01.245904 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:01.245865 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:01.245866 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:36:01.245956 10939 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:36:01.245996 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:36:01.246051 10939 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0709 19:36:01.246063 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:36:01.246127 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0709 19:36:01.246158 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:36:01.246187 10939 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0709 19:36:01.249986 10939 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0709 19:36:01.250189 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:01.250291 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:01.250371 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:01.250512 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0709 19:36:01.250627 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:01.250706 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:01.251071 10939 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0709 19:36:01.251274 10939 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0709 19:36:01.251456 10939 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0709 19:36:01.251498 10939 zones.go:93] ListHostedZonesPages { } I0709 19:36:01.251543 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:36:01.251598 10939 dns.go:235] Pre-creating DNS records I0709 19:36:01.251618 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:36:01.256585 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:36:01.259323 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:01.259389 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:01.259429 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:02.560488 10939 zones.go:93] ListHostedZonesPages { } I0709 19:36:02.710667 10939 iamrole.go:89] ListRoles: { } I0709 19:36:02.712088 10939 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0709 19:36:02.712313 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0709 19:36:02.712435 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0709 19:36:02.712471 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0709 19:36:02.712518 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.713050 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.713222 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:36:02.713490 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:36:02.714951 10939 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0709 19:36:02.715176 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0709 19:36:02.715147 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0709 19:36:02.715293 10939 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0709 19:36:02.715257 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.715342 10939 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0709 19:36:02.715369 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0709 19:36:02.715401 10939 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0709 19:36:02.715487 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0709 19:36:02.715515 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:36:02.715522 10939 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0709 19:36:02.715567 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.715715 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0709 19:36:02.715750 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0709 19:36:02.715867 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:36:02.715912 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.716013 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:36:02.716041 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0709 19:36:02.716162 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:36:02.716205 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0709 19:36:02.716356 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:36:02.716428 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.716621 10939 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0709 19:36:02.716784 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:36:02.716866 10939 loadbalancers.go:35] PageSize not implemented I0709 19:36:02.716881 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0709 19:36:02.716869 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:02.716913 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0709 19:36:02.716958 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:36:02.717017 10939 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } W0709 19:36:02.717001 10939 api.go:53] PageSize not implemented I0709 19:36:02.717078 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:36:02.717127 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:02.717217 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:02.717180 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:02.717249 10939 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0709 19:36:02.717070 10939 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0709 19:36:02.717265 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:02.717299 10939 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } W0709 19:36:02.717383 10939 api.go:53] PageSize not implemented I0709 19:36:02.717400 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:02.717452 10939 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0709 19:36:02.717529 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:36:02.717612 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0709 19:36:02.717798 10939 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0709 19:36:02.717849 10939 api.go:53] PageSize not implemented I0709 19:36:02.717869 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0709 19:36:02.717884 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:02.717912 10939 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0709 19:36:02.717889 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:02.717931 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:02.717977 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0709 19:36:02.718019 10939 api.go:53] PageSize not implemented I0709 19:36:02.717965 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0709 19:36:02.718053 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:02.718021 10939 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0709 19:36:02.718093 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:02.722386 10939 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0709 19:36:02.722475 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:02.722563 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:02.722710 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:02.722770 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:02.722912 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:02.723489 10939 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0709 19:36:02.723570 10939 api.go:53] PageSize not implemented I0709 19:36:02.723586 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:02.723747 10939 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0709 19:36:02.723969 10939 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0709 19:36:02.726534 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:36:02.726590 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:36:02.726614 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:36:02.726637 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:36:02.726657 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:36:02.726676 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:36:02.726699 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:36:02.726730 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:36:02.726753 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0709 19:36:02.726782 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0709 19:36:02.726803 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:36:02.726823 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:36:02.726847 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:36:02.726870 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:36:02.726891 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0709 19:36:02.726912 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:36:02.726935 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:36:02.726960 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0709 19:36:02.726984 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0709 19:36:02.727005 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:36:02.727029 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:36:02.727049 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0709 19:36:02.727071 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:36:02.727091 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:36:02.727110 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:36:02.727141 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:36:02.727166 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:36:02.728274 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:36:02.728333 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:36:02.728348 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:36:02.728380 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.728456 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0709 19:36:02.728508 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.728559 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.728590 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.728624 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.728654 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.728686 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0709 19:36:02.728728 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.728766 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:36:02.728786 10939 natgateway.go:117] DescribeNatGateways: { } I0709 19:36:02.728818 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0709 19:36:02.728845 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0709 19:36:02.728877 10939 api.go:53] PageSize not implemented I0709 19:36:02.728891 10939 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0709 19:36:02.728919 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:36:02.728939 10939 loadbalancers.go:35] PageSize not implemented I0709 19:36:02.728950 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0709 19:36:02.728977 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:36:02.728995 10939 targetgroups.go:35] PageSize not implemented I0709 19:36:02.729007 10939 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" ] } I0709 19:36:02.729053 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:36:02.729085 10939 iamrole.go:89] ListRoles: { } I0709 19:36:02.729122 10939 zones.go:93] ListHostedZonesPages { } I0709 19:36:02.729144 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:36:02.729176 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:36:02.729214 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:36:02.729239 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0709 19:36:02.729268 10939 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0709 19:36:02.729295 10939 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } autoscaling-group:bastion.private-shared-ip.example.com ok I0709 19:36:02.729794 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I0709 19:36:02.729832 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0709 19:36:02.729881 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } autoscaling-config:lt-1 ok I0709 19:36:02.729900 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok I0709 19:36:02.729919 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0709 19:36:02.729913 10939 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0709 19:36:02.729944 10939 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok volume:vol-2 ok I0709 19:36:02.729974 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } autoscaling-group:nodes.private-shared-ip.example.com ok I0709 19:36:02.730038 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I0709 19:36:02.729968 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0709 19:36:02.730131 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:36:02.730147 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0709 19:36:02.730152 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0709 19:36:02.730223 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I0709 19:36:02.730071 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:36:02.730178 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.private-shared-ip.example.com ok I0709 19:36:02.730223 10939 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } keypair:key-1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok load-balancer:api-private-shared-ip-exa-ohatqj ok I0709 19:36:02.730282 10939 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok autoscaling-config:lt-3 ok I0709 19:36:02.730348 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:36:02.730402 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0709 19:36:02.730502 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:36:02.730522 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0709 19:36:02.730548 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:36:02.730583 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0709 19:36:02.730699 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:36:02.730716 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0709 19:36:02.730794 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0709 19:36:02.730823 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I0709 19:36:02.730838 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0709 19:36:02.730876 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0709 19:36:02.730891 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0709 19:36:02.730922 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } I0709 19:36:02.730875 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } iam-role:nodes.private-shared-ip.example.com ok W0709 19:36:02.730947 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:36:02.730959 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } I0709 19:36:02.730950 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } security-group:sg-3 ok I0709 19:36:02.730981 10939 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0709 19:36:02.730992 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0709 19:36:02.730998 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0709 19:36:02.731013 10939 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0709 19:36:02.731047 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0709 19:36:02.731082 10939 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0709 19:36:02.731094 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0709 19:36:02.731115 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0709 19:36:02.731191 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0709 19:36:02.731242 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (2.97s) === RUN TestLifecycleManyAddons I0709 19:36:02.731799 10939 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:36:02.732054 10939 internetgateways.go:66] CreateInternetGateway: { } I0709 19:36:02.732090 10939 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:36:02.732126 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:36:02.732153 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:36:02.732190 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:36:02.732224 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:36:02.732246 10939 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:36:02.732277 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:36:02.732300 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0709 19:36:02.758044 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:36:02.761414 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:02.761566 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:04.037892 10939 zones.go:93] ListHostedZonesPages { } I0709 19:36:04.695592 10939 iamrole.go:89] ListRoles: { } I0709 19:36:04.696413 10939 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0709 19:36:04.696598 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:36:04.696893 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:04.697127 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0709 19:36:04.697152 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] }] } I0709 19:36:04.697242 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0709 19:36:04.697340 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:36:04.697463 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:36:04.698881 10939 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.699064 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:36:04.699123 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:04.699355 10939 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.699396 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:04.699566 10939 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0709 19:36:04.699656 10939 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0709 19:36:04.699767 10939 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0709 19:36:04.700021 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:36:04.700164 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0709 19:36:04.700214 10939 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0709 19:36:04.700286 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:36:04.700361 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:36:04.700416 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:36:04.700504 10939 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.706640 10939 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0709 19:36:04.706938 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0709 19:36:04.707058 10939 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0709 19:36:04.706989 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0709 19:36:04.707135 10939 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0709 19:36:04.707171 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0709 19:36:04.707139 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0709 19:36:04.707338 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:36:04.707419 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:36:04.707461 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:36:04.707528 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:04.707546 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0709 19:36:04.707610 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0709 19:36:04.707743 10939 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0709 19:36:04.707803 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:04.708012 10939 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.708107 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:36:04.708150 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:36:04.708263 10939 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0709 19:36:04.708308 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0709 19:36:04.708425 10939 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0709 19:36:04.708543 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:36:04.708647 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:36:04.708562 10939 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], VpcId: "vpc-1" } I0709 19:36:04.708703 10939 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0709 19:36:04.708799 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:36:04.708855 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:36:04.708882 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:36:04.708923 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:36:04.708955 10939 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0709 19:36:04.708968 10939 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0709 19:36:04.711160 10939 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0709 19:36:04.711329 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I0709 19:36:04.711539 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.711711 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.711871 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:04.711984 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:04.712130 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.712374 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0709 19:36:04.712497 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:04.712562 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:04.712626 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:04.712698 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0709 19:36:04.712807 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.712907 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0709 19:36:04.713008 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0709 19:36:04.713108 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.713234 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I0709 19:36:04.713339 10939 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:36:04.713383 10939 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0709 19:36:04.713418 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.713526 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.713624 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0709 19:36:04.713660 10939 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0709 19:36:04.713693 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:04.713776 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:04.713861 10939 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0709 19:36:04.714017 10939 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0709 19:36:04.714181 10939 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0709 19:36:04.714369 10939 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0709 19:36:04.714544 10939 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0709 19:36:04.714583 10939 zones.go:93] ListHostedZonesPages { } I0709 19:36:04.714617 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:36:04.714677 10939 dns.go:235] Pre-creating DNS records I0709 19:36:04.714702 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:36:04.719581 10939 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0709 19:36:04.722455 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:04.722524 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:05.989658 10939 zones.go:93] ListHostedZonesPages { } I0709 19:36:06.672080 10939 iamrole.go:89] ListRoles: { } I0709 19:36:06.672836 10939 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0709 19:36:06.673122 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.673412 10939 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0709 19:36:06.673614 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] }] } I0709 19:36:06.673776 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.673992 10939 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0709 19:36:06.674213 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.674373 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:36:06.674417 10939 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:36:06.674487 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:36:06.676356 10939 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0709 19:36:06.676474 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:36:06.676552 10939 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0709 19:36:06.676617 10939 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0709 19:36:06.676580 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0709 19:36:06.676740 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0709 19:36:06.676919 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:36:06.676998 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.677131 10939 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:36:06.677227 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.677355 10939 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:36:06.677397 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0709 19:36:06.677531 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:36:06.680812 10939 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0709 19:36:06.681009 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:06.681198 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:06.681314 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:06.681422 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:06.681550 10939 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0709 19:36:06.681682 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:06.681789 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:06.682187 10939 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0709 19:36:06.682345 10939 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0709 19:36:06.682537 10939 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0709 19:36:06.684827 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0709 19:36:06.684877 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0709 19:36:06.684904 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0709 19:36:06.684923 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0709 19:36:06.684943 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0709 19:36:06.684962 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0709 19:36:06.684980 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0709 19:36:06.685009 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0709 19:36:06.685029 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0709 19:36:06.685051 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0709 19:36:06.685104 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0709 19:36:06.685125 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0709 19:36:06.685143 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0709 19:36:06.685164 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0709 19:36:06.685187 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:36:06.685206 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0709 19:36:06.685227 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:36:06.685248 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0709 19:36:06.685268 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0709 19:36:06.685286 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0709 19:36:06.685304 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0709 19:36:06.685327 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0709 19:36:06.685349 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:36:06.685369 10939 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0709 19:36:06.686640 10939 delete_cluster.go:128] Looking for cloud resources to delete W0709 19:36:06.686689 10939 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0709 19:36:06.686703 10939 keypairs.go:95] DescribeKeyPairs: { } I0709 19:36:06.686734 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.686775 10939 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0709 19:36:06.686817 10939 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.686861 10939 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.686892 10939 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.686930 10939 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.686960 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.686986 10939 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0709 19:36:06.687017 10939 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.687052 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0709 19:36:06.687078 10939 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0709 19:36:06.687109 10939 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0709 19:36:06.687135 10939 api.go:53] PageSize not implemented I0709 19:36:06.687151 10939 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0709 19:36:06.687174 10939 loadbalancers.go:35] PageSize not implemented I0709 19:36:06.687188 10939 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0709 19:36:06.687206 10939 targetgroups.go:35] PageSize not implemented I0709 19:36:06.687221 10939 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0709 19:36:06.687263 10939 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0709 19:36:06.687295 10939 iamrole.go:89] ListRoles: { } I0709 19:36:06.687330 10939 zones.go:93] ListHostedZonesPages { } I0709 19:36:06.687354 10939 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0709 19:36:06.687384 10939 internetgateways.go:101] DescribeInternetGateways: { } I0709 19:36:06.687418 10939 routetable.go:53] DescribeRouteTables: { } I0709 19:36:06.687444 10939 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0709 19:36:06.687769 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok I0709 19:36:06.687831 10939 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0709 19:36:06.687827 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } keypair:key-1 ok I0709 19:36:06.687890 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0709 19:36:06.687888 10939 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } iam-instance-profile:nodes.minimal.example.com ok volume:vol-1 ok I0709 19:36:06.687927 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0709 19:36:06.687866 10939 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok I0709 19:36:06.687992 10939 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } autoscaling-group:nodes.minimal.example.com ok I0709 19:36:06.688072 10939 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0709 19:36:06.687966 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0709 19:36:06.688139 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:36:06.688159 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok I0709 19:36:06.688195 10939 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0709 19:36:06.688245 10939 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0709 19:36:06.688273 10939 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0709 19:36:06.688307 10939 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0709 19:36:06.688387 10939 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0709 19:36:06.688419 10939 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0709 19:36:06.688484 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0709 19:36:06.688519 10939 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0709 19:36:06.688498 10939 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0709 19:36:06.688531 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0709 19:36:06.688556 10939 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0709 19:36:06.688585 10939 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0709 19:36:06.688616 10939 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0709 19:36:06.688627 10939 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0709 19:36:06.688645 10939 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0709 19:36:06.688687 10939 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0709 19:36:06.688744 10939 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0709 19:36:06.688796 10939 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (3.96s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 206.442s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.004s ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0709 19:32:40.539696 11106 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.004s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I0709 19:32:40.553602 11108 pod.go:59] starting pod controller I0709 19:32:40.553722 11108 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS I0709 19:32:40.553805 11108 pod.go:107] Got stop signal ok k8s.io/kops/dns-controller/pkg/watchers 0.020s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035630} route53_test.go:93: Got zone list: [0xc000035660] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baa48} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035760} route53_test.go:93: Got zone list: [0xc000035790] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baa58} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000035860} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003d9e00 0xc0000baa70} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000359e0} route53_test.go:93: Got zone list: [0xc000035a10] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baa88} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035b40} route53_test.go:93: Got zone list: [0xc000035b70] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baaa8} route53_test.go:187: Successfully added resource record set: {0xc0003ddd40 0xc0000baac8} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035e20} route53_test.go:93: Got zone list: [0xc000035e50] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bab50} route53_test.go:199: Successfully added resource record set: {0xc0003ddef0 0xc0000bab70} route53_test.go:118: Got 1 recordsets: [0xc00040a070] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040a1d0} route53_test.go:93: Got zone list: [0xc00040a200] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bac08} route53_test.go:221: Successfully added resource record set: {0xc000408120 0xc0000bac28} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000408120 0xc0000bac28}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040a590} route53_test.go:93: Got zone list: [0xc00040a5c0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bace0} route53_test.go:246: Successfully removed resource set {0xc000408360 0xc0000bad00} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040a870} route53_test.go:93: Got zone list: [0xc00040a8a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bad88} route53_test.go:264: Successfully removed resource set {0xc000408510 0xc0000bada8} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040ab80} route53_test.go:93: Got zone list: [0xc00040abb0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bae38} commontests.go:192: Successfully added resource record set: {0xc0004086c0 0xc0000bae58} commontests.go:45: Correctly replaced resource record {0xc0004086c0 0xc0000bae58} -> {0xc0004087e0 0xc0000baea8} commontests.go:142: Got 1 recordsets: [0xc00040aec0] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040b0c0} route53_test.go:93: Got zone list: [0xc00040b0f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000baf58} commontests.go:192: Successfully added resource record set: {0xc000408ab0 0xc0000baf78} commontests.go:70: Correctly replaced resource record {0xc000408ab0 0xc0000baf78} -> {0xc000408bd0 0xc0000bafc8} commontests.go:142: Got 1 recordsets: [0xc00040b400] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040b650} route53_test.go:93: Got zone list: [0xc00040b680] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bb088} commontests.go:192: Successfully added resource record set: {0xc000408ea0 0xc0000bb0a8} commontests.go:142: Got 2 recordsets: [0xc00040b8f0 0xc00040b910] commontests.go:142: Got 2 recordsets: [0xc00040b980 0xc00040b9a0] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00040bb70} route53_test.go:93: Got zone list: [0xc00040bba0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003d9bc0 0xc0000bb1a8} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.010s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.005s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e83a0} clouddns_test.go:71: Got zone list: [0xc000780120] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc0007800f0} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e8500} clouddns_test.go:71: Got zone list: [0xc0007801e0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc0007801b0} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e8600} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc000368a40 0xc0007802a0} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e86c0} clouddns_test.go:71: Got zone list: [0xc0007803d8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc000780378} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e87e0} clouddns_test.go:71: Got zone list: [0xc000780648] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc0007805e8} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e8920} clouddns_test.go:71: Got zone list: [0xc000780918] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc0007808b8} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e8a80} clouddns_test.go:71: Got zone list: [0xc000780d38] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc000780cd8} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e8ea0} clouddns_test.go:71: Got zone list: [0xc000781068] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc000781008} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e8fe0} clouddns_test.go:71: Got zone list: [0xc000781338] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc0007812d8} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e9140} clouddns_test.go:71: Got zone list: [0xc0007816c8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc000781668} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e92a0} clouddns_test.go:71: Got zone list: [0xc000781e48] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc000781e18} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e9420} clouddns_test.go:71: Got zone list: [0xc0005ce1f8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc0005ce1c8} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc00040c038 0xc0002e9600} clouddns_test.go:71: Got zone list: [0xc0005ce5d0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc0003688c0 0xc0005ce5a0} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.038s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.018s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.005s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.049s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0709 19:32:45.585474 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.585642 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.585666 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.585695 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.585712 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.585749 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.585770 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.585778 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.585795 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.585809 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.590225 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I0709 19:32:45.592705 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.592806 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.592828 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.592845 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.592858 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.592873 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.592895 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.592904 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.592917 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.592926 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.593456 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I0709 19:32:45.596428 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.596568 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.596584 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.596603 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.596617 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.596631 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.596644 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.596652 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.596663 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.596671 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.597257 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:45.598168 11810 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0709 19:32:45.598178 11810 assetstore.go:111] bin/containerd I0709 19:32:45.598195 11810 assetstore.go:111] bin/containerd-shim I0709 19:32:45.598198 11810 assetstore.go:111] bin/containerd-shim-runc-v1 I0709 19:32:45.598201 11810 assetstore.go:111] bin/containerd-shim-runc-v2 I0709 19:32:45.598204 11810 assetstore.go:111] bin/containerd-stress I0709 19:32:45.598206 11810 assetstore.go:111] bin/ctr I0709 19:32:45.598226 11810 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0709 19:32:45.598232 11810 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.00s) === RUN TestContainerdBuilder_Flatcar I0709 19:32:45.599970 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.600046 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.600060 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.600072 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.600084 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.600097 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.600108 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.600115 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.600125 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.600133 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.600663 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:45.601463 11810 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0709 19:32:45.602036 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.602137 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.602149 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.602161 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.602172 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.602186 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.602198 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.602206 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.602216 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.602223 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.602763 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:45.603623 11810 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0709 19:32:45.603982 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.604058 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.604071 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.604082 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.604094 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.604106 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.604117 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.604126 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.604138 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.604145 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.604626 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:45.605548 11810 assetstore.go:108] Matching assets for "^docker/": I0709 19:32:45.605558 11810 assetstore.go:111] docker/containerd I0709 19:32:45.605572 11810 assetstore.go:111] docker/containerd-shim I0709 19:32:45.605575 11810 assetstore.go:111] docker/ctr I0709 19:32:45.605577 11810 assetstore.go:111] docker/docker I0709 19:32:45.605580 11810 assetstore.go:111] docker/docker-init I0709 19:32:45.605582 11810 assetstore.go:111] docker/docker-proxy I0709 19:32:45.605584 11810 assetstore.go:111] docker/dockerd I0709 19:32:45.605586 11810 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.00s) === RUN TestDockerBuilder_LogFlags I0709 19:32:45.607025 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.607107 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.607121 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.607133 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.607144 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.607156 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.607167 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.607174 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.607184 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.607191 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.607652 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:45.608504 11810 assetstore.go:108] Matching assets for "^docker/": I0709 19:32:45.608513 11810 assetstore.go:111] docker/containerd I0709 19:32:45.608517 11810 assetstore.go:111] docker/containerd-shim I0709 19:32:45.608520 11810 assetstore.go:111] docker/ctr I0709 19:32:45.608522 11810 assetstore.go:111] docker/docker I0709 19:32:45.608525 11810 assetstore.go:111] docker/docker-init I0709 19:32:45.608528 11810 assetstore.go:111] docker/docker-proxy I0709 19:32:45.608530 11810 assetstore.go:111] docker/dockerd I0709 19:32:45.608532 11810 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.00s) === RUN TestDockerBuilder_SkipInstall I0709 19:32:45.609911 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.609990 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.610004 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.610016 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.610027 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.610039 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.610050 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.610059 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.610069 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.610076 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.610562 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:45.611390 11810 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0709 19:32:45.611501 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.611574 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.611587 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.611600 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.611612 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.611624 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.611635 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.611643 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.611653 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.611660 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.612181 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:45.613021 11810 assetstore.go:108] Matching assets for "^docker/": I0709 19:32:45.613030 11810 assetstore.go:111] docker/docker I0709 19:32:45.613045 11810 assetstore.go:111] docker/docker-containerd I0709 19:32:45.613047 11810 assetstore.go:111] docker/docker-containerd-ctr I0709 19:32:45.613050 11810 assetstore.go:111] docker/docker-containerd-shim I0709 19:32:45.613052 11810 assetstore.go:111] docker/docker-init I0709 19:32:45.613054 11810 assetstore.go:111] docker/docker-proxy I0709 19:32:45.613056 11810 assetstore.go:111] docker/docker-runc I0709 19:32:45.613058 11810 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.00s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0709 19:32:45.614999 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.615113 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.615128 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.615140 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.615152 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.615166 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.615177 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.615186 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.615197 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.615205 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.616383 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.00s) === RUN TestDockerHooksBuilder I0709 19:32:45.617629 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.617713 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.617725 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.617743 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.617754 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.617766 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.617776 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.617784 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.617797 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.617805 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.621898 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I0709 19:32:45.623359 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.623444 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.623474 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.623491 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.623502 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.623515 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.623529 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.623537 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.623549 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.623557 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.624447 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.00s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0709 19:32:45.627466 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.627544 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.627556 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.627568 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.627578 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.627590 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.627599 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.627606 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.627616 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.627623 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.628447 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I0709 19:32:45.632937 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.633017 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.633030 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.633053 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.633064 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.633078 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.633089 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.633097 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.633109 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.633116 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.634231 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0709 19:32:45.639503 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.639618 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.639638 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.639656 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.639669 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.639686 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.639702 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.639722 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.639749 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.639759 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.642554 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I0709 19:32:45.646858 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.646957 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.646973 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.646993 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.647007 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.647024 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.647037 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.647046 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.647059 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.647068 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.648061 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0709 19:32:45.652050 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.652142 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.652157 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.652172 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.652186 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.652201 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.652213 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.652222 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.652236 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.652244 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.653081 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.00s) === RUN TestAwsIamAuthenticator I0709 19:32:45.656886 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.656973 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.656988 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.657002 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.657013 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.657028 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.657041 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.657049 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.657061 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.657070 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.658027 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0709 19:32:45.664397 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:45.664488 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:45.664503 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:45.664519 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:45.664533 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:45.664547 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:45.664561 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:45.664570 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:45.664581 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:45.664589 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:45.665549 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.70s) === RUN TestKubeAPIServerBuilderARM64 I0709 19:32:47.361636 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:47.361769 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:47.361793 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:47.361815 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:47.361830 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:47.361850 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:47.361867 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:47.361876 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:47.361891 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:47.361903 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:47.362939 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.28s) === RUN TestKubeControllerManagerBuilder I0709 19:32:48.636807 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:48.636950 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:48.636977 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:48.637007 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:48.637027 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:48.637053 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:48.637078 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:48.637093 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:48.637113 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:48.637128 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:48.638634 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0709 19:32:48.644366 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:48.644517 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:48.644540 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:48.644564 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:48.644583 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:48.644608 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:48.644630 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:48.644644 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:48.644663 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:48.644679 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:48.646190 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.26s) === RUN TestKubeControllerManagerBuilderARM64 I0709 19:32:49.900719 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:49.900841 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:49.900867 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:49.900893 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:49.900909 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:49.900930 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:49.900949 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:49.900958 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:49.900972 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:49.900983 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:49.902133 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.28s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0709 19:32:51.179265 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:51.179475 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:51.179512 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:51.179562 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:51.179591 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:51.179628 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:51.179657 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:51.179677 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:51.179705 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:51.179731 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:51.181850 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I0709 19:32:51.186436 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:51.186605 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:51.186635 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:51.186668 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:51.186695 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:51.186729 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:51.186756 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:51.186778 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:51.186801 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:51.186819 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:51.188763 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.24s) === RUN TestKubeProxyBuilderARM64 I0709 19:32:52.430534 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:52.430761 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:52.430802 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:52.430844 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:52.430874 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:52.430911 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:52.430947 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:52.430968 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:52.430996 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:52.431018 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:52.433194 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.26s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0709 19:32:53.692067 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:53.692280 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:53.692318 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:53.692354 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:53.692385 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:53.692421 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:53.692461 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:53.692482 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:53.692512 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:53.692534 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:53.697021 11810 zones.go:93] ListHostedZonesPages { } W0709 19:32:53.700211 11810 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0709 19:32:53.702481 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:53.702681 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:53.702715 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:53.702765 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:53.702793 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:53.702837 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:53.702866 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:53.702886 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:53.702927 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:53.702952 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:53.704905 11810 zones.go:93] ListHostedZonesPages { } W0709 19:32:54.950404 11810 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.25s) === RUN TestKubeSchedulerBuilderARM64 I0709 19:32:54.953526 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:54.953756 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:54.953793 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:54.953846 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:54.953914 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:54.953954 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:54.953988 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:54.954006 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:54.954037 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:54.954058 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:54.956226 11810 zones.go:93] ListHostedZonesPages { } W0709 19:32:56.227905 11810 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.28s) === RUN TestKubectlBuilder I0709 19:32:56.230424 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:56.230660 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:56.230704 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:56.230748 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:56.230787 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:56.230827 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:56.230902 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:56.230930 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:56.230963 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:56.230989 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:56.233239 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:56.235728 11810 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0709 19:32:56.238279 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:56.238503 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:56.238537 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:56.238569 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:56.238597 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:56.238630 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:56.238658 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:56.238679 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:56.238707 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:56.238727 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:56.240444 11810 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I0709 19:32:56.245402 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:56.245591 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:56.245625 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:56.245662 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:56.245690 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:56.245723 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:56.245751 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:56.245772 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:56.245798 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:56.245817 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:56.247404 11810 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0709 19:32:56.254545 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:56.254758 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:56.254795 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:56.254835 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:56.254868 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:56.254906 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:56.254939 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:56.254961 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:56.254990 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:56.255013 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:56.257165 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:56.259627 11810 assetstore.go:108] Matching assets for "protokube$": I0709 19:32:56.259654 11810 assetstore.go:111] /opt/kops/bin/protokube I0709 19:32:56.259667 11810 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0709 19:32:56.259693 11810 assetstore.go:108] Matching assets for "channels$": I0709 19:32:56.259703 11810 assetstore.go:111] /opt/kops/bin/channels I0709 19:32:56.259712 11810 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I0709 19:32:56.261944 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:56.262131 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:56.262163 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:56.262193 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:56.262224 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:56.262264 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:56.262290 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:56.262312 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:56.262337 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:56.262356 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:56.264306 11810 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0709 19:32:56.267364 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:56.267559 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:56.267590 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:56.267617 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:56.267645 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:56.267683 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:56.267709 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:56.267730 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:56.267755 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:56.267774 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:56.269732 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:56.271965 11810 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I0709 19:32:56.272463 11810 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:56.272629 11810 internetgateways.go:66] CreateInternetGateway: { } I0709 19:32:56.272658 11810 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:32:56.272692 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:32:56.272719 11810 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:32:56.272750 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:32:56.272780 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:32:56.272800 11810 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:32:56.272827 11810 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:32:56.272845 11810 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:32:56.274808 11810 zones.go:93] ListHostedZonesPages { } I0709 19:32:56.276976 11810 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 10.749s ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.025s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.023s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.020s ? k8s.io/kops/pkg/apis/kops/registry [no test files] === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0709 19:32:45.543717 11814 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0709 19:32:45.543781 11814 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.007s ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0709 19:32:45.721139 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721219 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721248 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721267 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721293 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0709 19:32:45.721443 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721470 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721486 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721503 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721537 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721560 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721577 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721590 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721608 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721623 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721642 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721665 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721679 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721692 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721704 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721725 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721737 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721765 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0709 19:32:45.721778 11962 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0709 19:32:45.721883 11962 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0709 19:32:45.721936 11962 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.062s ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.008s ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0709 19:32:45.700091 11967 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0709 19:32:45.701068 11967 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0709 19:32:45.701812 11967 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0709 19:32:45.702326 11967 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0709 19:32:45.702802 11967 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0709 19:32:45.703233 11967 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host W0709 19:32:45.703640 11967 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0709 19:32:45.704019 11967 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0709 19:32:45.704025 11967 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0709 19:32:45.704029 11967 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0709 19:32:45.704034 11967 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.039s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.005s ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.050s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.022s ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.082s ? k8s.io/kops/pkg/commands/commandutils [no test files] === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.074s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.023s ? k8s.io/kops/pkg/configserver [no test files] === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.004s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.006s ? k8s.io/kops/pkg/dump [no test files] === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.037s === RUN TestFlagToFalse I0709 19:32:45.920595 12549 featureflag_test.go:32] Created flag Unittest1 I0709 19:32:45.920633 12549 featureflag.go:164] FeatureFlag "UnitTest1"=false I0709 19:32:45.920640 12549 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0709 19:32:45.920687 12549 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.006s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.027s === RUN TestRenderInstanceGroupZones W0709 19:32:45.937231 12551 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.022s === RUN TestWarmPoolOnlyRoll I0709 19:32:58.415500 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.415557 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.415569 13687 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0709 19:32:58.415868 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.415885 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.417013 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.417037 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.422235 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.422282 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.422296 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.422306 13687 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0709 19:32:58.423727 13687 instancegroups.go:431] Draining the node: "master-1a.local". I0709 19:32:58.424166 13687 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0709 19:32:58.424234 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:58.424258 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.425375 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.425392 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.430576 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.430634 13687 instancegroups.go:431] Draining the node: "master-1b.local". I0709 19:32:58.431338 13687 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0709 19:32:58.431412 13687 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0709 19:32:58.431433 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.432483 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.432526 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.437742 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.437802 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.437818 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.437828 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.438579 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.439082 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.439107 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.440205 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.440226 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.445886 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.445942 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:58.446611 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.446634 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.447763 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.447793 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.453017 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.453082 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:58.453734 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:58.453761 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.454892 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.454907 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.460102 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.460136 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.460151 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.460164 13687 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0709 19:32:58.460894 13687 instancegroups.go:431] Draining the node: "node-2a.local". I0709 19:32:58.461451 13687 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0709 19:32:58.461475 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.462625 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.462646 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.467843 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.467906 13687 instancegroups.go:431] Draining the node: "node-2b.local". I0709 19:32:58.468567 13687 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0709 19:32:58.468590 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.469700 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.469722 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.474950 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.475015 13687 instancegroups.go:431] Draining the node: "node-2c.local". I0709 19:32:58.475741 13687 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0709 19:32:58.475770 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.476876 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.476893 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.483515 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.483559 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0709 19:32:58.483960 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.483980 13687 instancegroups.go:469] waiting for 1ms after terminating instance W0709 19:32:58.485313 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.485357 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.485383 13687 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0709 19:32:58.485394 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:58.485411 13687 instancegroups.go:469] waiting for 1ms after terminating instance W0709 19:32:58.487586 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.487626 13687 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0709 19:32:58.487636 13687 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0709 19:32:58.487655 13687 instancegroups.go:469] waiting for 1ms after terminating instance W0709 19:32:58.488754 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.488772 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.488797 13687 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0709 19:32:58.488805 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.488832 13687 instancegroups.go:469] waiting for 1ms after terminating instance W0709 19:32:58.489934 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.489955 13687 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0709 19:32:58.489961 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.489969 13687 instancegroups.go:469] waiting for 1ms after terminating instance W0709 19:32:58.491072 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.491090 13687 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0709 19:32:58.491094 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:58.491103 13687 instancegroups.go:469] waiting for 1ms after terminating instance W0709 19:32:58.492203 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.492216 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.492232 13687 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0709 19:32:58.492236 13687 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0709 19:32:58.492245 13687 instancegroups.go:469] waiting for 1ms after terminating instance W0709 19:32:58.493344 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.493366 13687 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0709 19:32:58.493371 13687 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0709 19:32:58.493381 13687 instancegroups.go:469] waiting for 1ms after terminating instance W0709 19:32:58.494475 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0709 19:32:58.494495 13687 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0709 19:32:58.494500 13687 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0709 19:32:58.494508 13687 instancegroups.go:469] waiting for 1ms after terminating instance W0709 19:32:58.495597 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0709 19:32:58.495618 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0709 19:32:58.495874 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.495889 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.496991 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.497014 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.497027 13687 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.497062 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.497073 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.497081 13687 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.497088 13687 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0709 19:32:58.497588 13687 instancegroups.go:431] Draining the node: "master-1a.local". I0709 19:32:58.497977 13687 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0709 19:32:58.498026 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:58.498041 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.499135 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.499154 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.499166 13687 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.499185 13687 instancegroups.go:431] Draining the node: "master-1b.local". I0709 19:32:58.499597 13687 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0709 19:32:58.499633 13687 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0709 19:32:58.499649 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.500739 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.500755 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.500764 13687 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.500776 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.500787 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.500794 13687 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.500802 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.501312 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.501754 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.501772 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.502884 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.502899 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.502909 13687 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.502942 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:58.503372 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.503390 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.504484 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.504502 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.504514 13687 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.504539 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:58.505071 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:58.505101 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.506200 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.506218 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.506228 13687 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.506238 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.506246 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.506253 13687 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.506260 13687 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0709 19:32:58.506811 13687 instancegroups.go:431] Draining the node: "node-2a.local". I0709 19:32:58.507228 13687 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0709 19:32:58.507245 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.508364 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.508397 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.508425 13687 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.508464 13687 instancegroups.go:431] Draining the node: "node-2b.local". I0709 19:32:58.509037 13687 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0709 19:32:58.509059 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.510164 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.510186 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.510198 13687 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.510220 13687 instancegroups.go:431] Draining the node: "node-2c.local". I0709 19:32:58.510724 13687 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0709 19:32:58.510744 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.511853 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.511882 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0709 19:32:58.511915 13687 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0709 19:32:58.511933 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I0709 19:32:58.512179 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0709 19:32:58.512338 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.512356 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.513598 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.513619 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.518765 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.518851 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.518866 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.518876 13687 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0709 19:32:58.519368 13687 instancegroups.go:431] Draining the node: "master-1a.local". I0709 19:32:58.519710 13687 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0709 19:32:58.519748 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:58.519771 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.520901 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.520924 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.526078 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.526133 13687 instancegroups.go:431] Draining the node: "master-1b.local". I0709 19:32:58.526707 13687 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0709 19:32:58.526754 13687 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0709 19:32:58.526772 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.527997 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.528021 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.533212 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.533244 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.533253 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.533259 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.533709 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.534003 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.534018 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.535103 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.535116 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.540306 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.540359 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:58.541016 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.541038 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.542141 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.542161 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.547368 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.547412 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:58.548364 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:58.548381 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.549514 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.549529 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.554728 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.554771 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.554798 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.554812 13687 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0709 19:32:58.555401 13687 instancegroups.go:431] Draining the node: "node-2a.local". I0709 19:32:58.555680 13687 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0709 19:32:58.555697 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.556807 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.556830 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.562015 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.562052 13687 instancegroups.go:431] Draining the node: "node-2b.local". I0709 19:32:58.562433 13687 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0709 19:32:58.562450 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.563573 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.563592 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.568772 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.568816 13687 instancegroups.go:431] Draining the node: "node-2c.local". I0709 19:32:58.569247 13687 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0709 19:32:58.569270 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.570387 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.570402 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.575640 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.575681 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.06s) === RUN TestRollingUpdateEmptyGroup I0709 19:32:58.575797 13687 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0709 19:32:58.576086 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.576100 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.577221 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.577247 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0709 19:32:58.577259 13687 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0709 19:32:58.577904 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.577929 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.579009 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.579033 13687 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0709 19:32:58.579045 13687 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0709 19:32:58.579183 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.579193 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0709 19:32:58.579198 13687 instancegroups.go:509] Cluster did not validate within 0s E0709 19:32:58.579205 13687 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0709 19:32:58.579284 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.579291 13687 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0709 19:32:58.579296 13687 instancegroups.go:509] Cluster did not validate within 0s E0709 19:32:58.579302 13687 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0709 19:32:58.579385 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.579396 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.580504 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.580528 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.585738 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.585798 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.585814 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.585823 13687 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0709 19:32:58.586331 13687 instancegroups.go:431] Draining the node: "master-1a.local". I0709 19:32:58.586704 13687 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0709 19:32:58.586754 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:58.586773 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.587880 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.587902 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0709 19:32:58.587917 13687 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0709 19:32:58.588123 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.588141 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.589247 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.589265 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.594457 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.594519 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.594539 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.594548 13687 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0709 19:32:58.595181 13687 instancegroups.go:431] Draining the node: "master-1a.local". I0709 19:32:58.595621 13687 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0709 19:32:58.595674 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:58.595696 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.596798 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.596816 13687 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0709 19:32:58.596826 13687 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0709 19:32:58.597005 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.597020 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.597028 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.597578 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.598009 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.598028 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.599129 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.599146 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.604307 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.604331 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:58.604738 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.604757 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.605862 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.605875 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.611035 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.611068 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:58.611578 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:58.611595 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.612699 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.612718 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.617909 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.617948 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0709 19:32:58.618211 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.618229 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0709 19:32:58.618245 13687 instancegroups.go:509] Cluster did not validate within 0s E0709 19:32:58.618255 13687 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0709 19:32:58.618398 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.618420 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0709 19:32:58.618430 13687 instancegroups.go:509] Cluster did not validate within 0s E0709 19:32:58.618442 13687 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0709 19:32:58.618573 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.618586 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0709 19:32:58.618595 13687 instancegroups.go:509] Cluster did not validate within 0s E0709 19:32:58.618606 13687 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0709 19:32:58.618744 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.618756 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.618764 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.619407 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.619846 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.619867 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.620994 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.621007 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.626183 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.626218 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:58.626758 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.626782 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.627913 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.627926 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.633096 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.633149 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:58.633502 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:58.633516 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.634613 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.634627 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.639812 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.639826 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.639835 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0709 19:32:58.639843 13687 instancegroups.go:509] Cluster did not validate within 0s E0709 19:32:58.639851 13687 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0709 19:32:58.639981 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.639990 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.639995 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.640356 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.640600 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.640612 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.641752 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.641768 13687 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0709 19:32:58.641776 13687 instancegroups.go:509] Cluster did not validate within 0s E0709 19:32:58.641784 13687 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0709 19:32:58.641859 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.641868 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.641872 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.642211 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.642440 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.642452 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.643561 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.643573 13687 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0709 19:32:58.643581 13687 instancegroups.go:509] Cluster did not validate within 0s E0709 19:32:58.643588 13687 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0709 19:32:58.643684 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.643694 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.644808 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.644829 13687 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0709 19:32:58.645914 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.651089 13687 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0709 19:32:58.652200 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.657402 13687 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0709 19:32:58.658511 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.663717 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.663759 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.663770 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.663776 13687 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0709 19:32:58.664154 13687 instancegroups.go:431] Draining the node: "master-1a.local". I0709 19:32:58.664412 13687 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0709 19:32:58.664445 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:58.664458 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.665561 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.665576 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.670757 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.670791 13687 instancegroups.go:431] Draining the node: "master-1b.local". I0709 19:32:58.671131 13687 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0709 19:32:58.671167 13687 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0709 19:32:58.671179 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.672327 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.672357 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.677519 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.677540 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.677553 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.677562 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.678093 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.678529 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.678548 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.679662 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.679682 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.684839 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.684869 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:58.685353 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.685377 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.686479 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.686501 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.691662 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.691700 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:58.692200 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:58.692219 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.693332 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.693356 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.698515 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.698534 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.698549 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.698558 13687 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0709 19:32:58.699123 13687 instancegroups.go:431] Draining the node: "node-2a.local". I0709 19:32:58.699559 13687 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0709 19:32:58.699586 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.700723 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.700743 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.705912 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.705952 13687 instancegroups.go:431] Draining the node: "node-2b.local". I0709 19:32:58.706477 13687 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0709 19:32:58.706498 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.707641 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.707663 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.712852 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.712898 13687 instancegroups.go:431] Draining the node: "node-2c.local". I0709 19:32:58.713440 13687 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0709 19:32:58.713459 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.714546 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.714567 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.719741 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.719778 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0709 19:32:58.720032 13687 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0709 19:32:58.720053 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.721166 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.721190 13687 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0709 19:32:58.722276 13687 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0709 19:32:58.723363 13687 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0709 19:32:58.724443 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.729614 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.729676 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.729691 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.729700 13687 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0709 19:32:58.730217 13687 instancegroups.go:431] Draining the node: "master-1a.local". I0709 19:32:58.730586 13687 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0709 19:32:58.730633 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:58.730651 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.731764 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.731784 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.736979 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.737018 13687 instancegroups.go:431] Draining the node: "master-1b.local". I0709 19:32:58.737372 13687 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0709 19:32:58.737407 13687 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0709 19:32:58.737420 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.738538 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.738555 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.743719 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.743748 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.743758 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.743766 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.744190 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.744446 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.744461 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.745584 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.745596 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.750802 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.750836 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:58.751302 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.751324 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.752466 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.752478 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.757667 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.757696 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:58.758046 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:58.758061 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.759200 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.759223 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.764417 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.764443 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.764453 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.764460 13687 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0709 19:32:58.764874 13687 instancegroups.go:431] Draining the node: "node-2a.local". I0709 19:32:58.765320 13687 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0709 19:32:58.765343 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.766445 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.766465 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.771629 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.771668 13687 instancegroups.go:431] Draining the node: "node-2b.local". I0709 19:32:58.772043 13687 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0709 19:32:58.772062 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.773180 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.773194 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.778364 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.778420 13687 instancegroups.go:431] Draining the node: "node-2c.local". I0709 19:32:58.778829 13687 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0709 19:32:58.778848 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.779984 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.779998 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.785125 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.785150 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0709 19:32:58.785431 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.785441 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.785446 13687 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0709 19:32:58.785750 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.786016 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.786030 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.787167 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.787180 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.792367 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.792401 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:58.792761 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.792777 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.793918 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.793931 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.799103 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.799137 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0709 19:32:58.799414 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.799434 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.799442 13687 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0709 19:32:58.800009 13687 instancegroups.go:431] Draining the node: "master-1a.local". I0709 19:32:58.800497 13687 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0709 19:32:58.800548 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:58.800568 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.801643 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.801656 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.806838 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.806868 13687 instancegroups.go:431] Draining the node: "master-1b.local". I0709 19:32:58.807222 13687 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0709 19:32:58.807261 13687 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0709 19:32:58.807276 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.808403 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.808440 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.813619 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.813642 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0709 19:32:58.813817 13687 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0709 19:32:58.813834 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0709 19:32:58.813853 13687 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0709 19:32:58.813860 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0709 19:32:58.813866 13687 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0709 19:32:58.813870 13687 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0709 19:32:58.813873 13687 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0709 19:32:58.813879 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0709 19:32:58.813981 13687 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0709 19:32:58.814002 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:58.815146 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.815171 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.820415 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.820442 13687 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0709 19:32:58.820479 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.820494 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.820504 13687 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0709 19:32:58.821025 13687 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0709 19:32:58.821042 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.821056 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.821065 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:32:58.821548 13687 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0709 19:32:58.821589 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:58.822723 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.822747 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.827992 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.828024 13687 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0709 19:32:58.828037 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.828049 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.828058 13687 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0709 19:32:58.828684 13687 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0709 19:32:58.828725 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:58.829865 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.829878 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:58.835071 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.835111 13687 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0709 19:32:58.835123 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0709 19:32:58.835280 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.835293 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.835298 13687 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0709 19:32:58.836093 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:58.836390 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:58.836412 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.837604 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.837637 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.837668 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:58.837694 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:58.838014 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:58.838208 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:58.838223 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.839318 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.839366 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.939758 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.939803 13687 instancegroups.go:431] Draining the node: "node-1e.local". I0709 19:32:58.939824 13687 instancegroups.go:431] Draining the node: "node-1d.local". I0709 19:32:58.940208 13687 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0709 19:32:58.940424 13687 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0709 19:32:58.940442 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.941606 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.941636 13687 instancegroups.go:540] Cluster validated. I0709 19:32:58.941667 13687 instancegroups.go:431] Draining the node: "node-1f.local". I0709 19:32:58.942410 13687 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0709 19:32:58.942448 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:58.943560 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:58.943596 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.044004 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.044066 13687 instancegroups.go:431] Draining the node: "node-1g.local". I0709 19:32:59.044812 13687 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0709 19:32:59.044852 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.046001 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.046037 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.046058 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0709 19:32:59.046278 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.046302 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.046312 13687 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0709 19:32:59.047529 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:59.047591 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:59.048319 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:59.048557 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:59.048589 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.049721 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.049756 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.150155 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.150197 13687 instancegroups.go:431] Draining the node: "node-1d.local". I0709 19:32:59.150219 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:59.150768 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:59.151143 13687 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0709 19:32:59.151183 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.152337 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.152364 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.152390 13687 instancegroups.go:431] Draining the node: "node-1e.local". I0709 19:32:59.152722 13687 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0709 19:32:59.152744 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.153893 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.153926 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.254407 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.254482 13687 instancegroups.go:431] Draining the node: "node-1f.local". I0709 19:32:59.255243 13687 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0709 19:32:59.255286 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.256499 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.256544 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.256564 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0709 19:32:59.256770 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.256793 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.256804 13687 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0709 19:32:59.258287 13687 instancegroups.go:431] Draining the node: "master-1a.local". I0709 19:32:59.258858 13687 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0709 19:32:59.258913 13687 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0709 19:32:59.258941 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.260149 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.260188 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.260220 13687 instancegroups.go:431] Draining the node: "master-1c.local". I0709 19:32:59.260267 13687 instancegroups.go:431] Draining the node: "master-1b.local". I0709 19:32:59.261510 13687 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0709 19:32:59.261560 13687 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0709 19:32:59.261646 13687 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0709 19:32:59.261683 13687 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0709 19:32:59.261703 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.262906 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.262969 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.363429 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.363471 13687 instancegroups.go:431] Draining the node: "master-1e.local". I0709 19:32:59.363549 13687 instancegroups.go:431] Draining the node: "master-1d.local". I0709 19:32:59.364315 13687 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0709 19:32:59.364374 13687 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0709 19:32:59.364540 13687 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0709 19:32:59.364598 13687 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0709 19:32:59.364633 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.365787 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.365809 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.365824 13687 instancegroups.go:431] Draining the node: "master-1f.local". I0709 19:32:59.366306 13687 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0709 19:32:59.366352 13687 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0709 19:32:59.366378 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.367580 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.367638 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.468128 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.468194 13687 instancegroups.go:431] Draining the node: "master-1g.local". I0709 19:32:59.468875 13687 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0709 19:32:59.468931 13687 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0709 19:32:59.468964 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.470138 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.470177 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.470190 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0709 19:32:59.470348 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.470363 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.470370 13687 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0709 19:32:59.471596 13687 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0709 19:32:59.471647 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:59.472788 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.472823 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.472834 13687 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0709 19:32:59.472887 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:59.474028 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.474049 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.474085 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:59.474151 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:59.474772 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:59.474877 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:59.474892 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.476010 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.476037 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.576496 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.576567 13687 instancegroups.go:431] Draining the node: "node-1d.local". I0709 19:32:59.576619 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:59.580389 13687 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0709 19:32:59.580594 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:59.580640 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.581826 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.581855 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.581888 13687 instancegroups.go:431] Draining the node: "node-1e.local". I0709 19:32:59.582402 13687 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0709 19:32:59.582441 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.583590 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.583610 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.683832 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.683896 13687 instancegroups.go:431] Draining the node: "node-1f.local". I0709 19:32:59.684632 13687 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0709 19:32:59.684688 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.685866 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.685905 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.685920 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.22s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0709 19:32:59.686095 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.686113 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.686121 13687 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0709 19:32:59.687174 13687 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0709 19:32:59.687205 13687 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0709 19:32:59.687233 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:59.688455 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.688494 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.688534 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:59.688602 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:59.689406 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:59.689524 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:59.689543 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.690709 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.690748 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.791096 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.791145 13687 instancegroups.go:431] Draining the node: "node-1d.local". I0709 19:32:59.791186 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:59.791949 13687 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0709 19:32:59.792085 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:59.792112 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.793235 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.793287 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.793318 13687 instancegroups.go:431] Draining the node: "node-1e.local". I0709 19:32:59.793891 13687 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0709 19:32:59.793936 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.795110 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.795150 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.895655 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.895717 13687 instancegroups.go:431] Draining the node: "node-1f.local". I0709 19:32:59.896441 13687 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0709 19:32:59.896495 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.897699 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.897755 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.897768 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0709 19:32:59.897926 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.897938 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.897944 13687 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0709 19:32:59.898297 13687 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0709 19:32:59.898312 13687 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0709 19:32:59.898329 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:59.899526 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.899564 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:59.904847 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.904903 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:59.904960 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:59.905822 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:59.905853 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.906032 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:59.906063 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.907019 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.907034 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:59.912432 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.912454 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0709 19:32:59.912585 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.912597 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.912603 13687 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0709 19:32:59.912930 13687 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0709 19:32:59.912959 13687 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0709 19:32:59.912965 13687 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0709 19:32:59.912983 13687 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0709 19:32:59.912996 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:59.914184 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.914210 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:59.919459 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.919498 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:59.919521 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:59.920391 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:59.920420 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.920609 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:59.920637 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.921619 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.921651 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:32:59.926897 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.926939 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0709 19:32:59.927160 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.927186 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.927197 13687 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0709 19:32:59.927825 13687 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0709 19:32:59.927864 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:59.929069 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.929105 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.929116 13687 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0709 19:32:59.929159 13687 instancegroups.go:203] waiting for 1ms after detaching instance I0709 19:32:59.930301 13687 instancegroups.go:504] Validating the cluster. I0709 19:32:59.930329 13687 instancegroups.go:540] Cluster validated. I0709 19:32:59.930354 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:32:59.930374 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:32:59.930432 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:32:59.931211 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:32:59.931249 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.931393 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:32:59.931430 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.931617 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:32:59.931649 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:32:59.932396 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.033405 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.033452 13687 instancegroups.go:431] Draining the node: "node-1d.local". I0709 19:33:00.033911 13687 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0709 19:33:00.033937 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.035052 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.035071 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.035101 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0709 19:33:00.035245 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.035257 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.035262 13687 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0709 19:33:00.035903 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:33:00.036151 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:33:00.036167 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.037294 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.037309 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.037321 13687 instancegroups.go:431] Draining the node: "node-1e.local". I0709 19:33:00.037385 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:33:00.037782 13687 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0709 19:33:00.037936 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:33:00.037958 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.039053 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.039081 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.139595 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.139647 13687 instancegroups.go:431] Draining the node: "node-1g.local". I0709 19:33:00.139698 13687 instancegroups.go:431] Draining the node: "node-1f.local". I0709 19:33:00.140089 13687 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0709 19:33:00.140301 13687 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0709 19:33:00.140318 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.141471 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.141491 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.141520 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:33:00.141913 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:33:00.141932 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.143055 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.143074 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.243871 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.243934 13687 instancegroups.go:431] Draining the node: "node-1d.local". I0709 19:33:00.244654 13687 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0709 19:33:00.244701 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.245865 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.245895 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.245906 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0709 19:33:00.246030 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.246041 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.246048 13687 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0709 19:33:00.246056 13687 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0709 19:33:00.246061 13687 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0709 19:33:00.246073 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0709 19:33:00.246152 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.246169 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.246179 13687 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0709 19:33:00.246848 13687 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0709 19:33:00.246871 13687 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0709 19:33:00.246880 13687 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0709 19:33:00.246909 13687 instancegroups.go:431] Draining the node: "node-1a.local". I0709 19:33:00.247441 13687 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0709 19:33:00.247472 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.248622 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.248643 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:33:00.253885 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.253934 13687 instancegroups.go:431] Draining the node: "node-1b.local". I0709 19:33:00.254594 13687 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0709 19:33:00.254629 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.255778 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.255807 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:33:00.261294 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.261321 13687 instancegroups.go:431] Draining the node: "node-1c.local". I0709 19:33:00.261693 13687 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0709 19:33:00.261709 13687 instancegroups.go:469] waiting for 1ms after terminating instance I0709 19:33:00.263540 13687 instancegroups.go:504] Validating the cluster. I0709 19:33:00.263567 13687 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0709 19:33:00.268804 13687 instancegroups.go:540] Cluster validated. I0709 19:33:00.268843 13687 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.929s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.006s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.012s === RUN TestParse E0709 19:32:58.357262 13690 versions.go:96] unable to parse Kubernetes version "" E0709 19:32:58.357349 13690 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.011s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.036s ? k8s.io/kops/pkg/kopscontrollerclient [no test files] === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.14s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.198s ? k8s.io/kops/pkg/kubemanifest [no test files] === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.081s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.071s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.070s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0709 19:32:58.402668 13697 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.059s ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] === RUN Test_RunEtcdManagerBuilder I0709 19:32:58.412535 13704 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0709 19:32:58.439781 13704 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0709 19:32:58.440869 13704 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.03s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.00s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.00s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.098s ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] === RUN Test_RunKubeApiserverBuilder I0709 19:32:58.413532 13707 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.074s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.071s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.023s ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.070s === RUN TestServerGroupBuilder I0709 19:32:58.412614 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.419938 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.430076 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.446453 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.453120 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.466902 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.477778 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.489516 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.500856 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.514127 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.520173 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.528216 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.594837 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.598895 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.603619 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.607208 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.610658 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:32:58.615071 13710 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.21s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.275s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.031s ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.032s ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.022s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.00s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.88s) --- PASS: TestIssueCert/ca (0.49s) --- PASS: TestIssueCert/client (0.23s) --- PASS: TestIssueCert/clientOneYear (0.16s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 0.889s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.003s ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] === RUN TestAddUntaggedRouteTables I0709 19:33:03.079498 15356 routetable.go:53] DescribeRouteTables: { } I0709 19:33:03.079571 15356 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") W0709 19:33:03.079580 15356 tags.go:67] cluster tag not found on route-table:rtb-1234 --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0709 19:33:03.079662 15356 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0709 19:33:03.079716 15356 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0709 19:33:03.079760 15356 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0709 19:33:03.079813 15356 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0709 19:33:03.079850 15356 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0709 19:33:03.079891 15356 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0709 19:33:03.079947 15356 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0709 19:33:03.079964 15356 volumes.go:128] DescribeVolumes: { } W0709 19:33:03.079982 15356 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0709 19:33:03.080066 15356 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:03.080190 15356 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:03.080211 15356 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:03.080250 15356 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:03.080265 15356 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:03.080298 15356 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:03.080320 15356 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:03.080330 15356 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:03.080343 15356 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:03.080377 15356 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:03.080396 15356 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0709 19:33:03.080409 15356 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0709 19:33:03.080420 15356 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0709 19:33:03.080437 15356 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0709 19:33:03.080447 15356 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0709 19:33:03.080463 15356 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0709 19:33:03.080479 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0709 19:33:03.080491 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0709 19:33:03.080503 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0709 19:33:03.080512 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0709 19:33:03.080525 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0709 19:33:03.080534 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0709 19:33:03.080547 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0709 19:33:03.080556 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0709 19:33:03.080567 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0709 19:33:03.080576 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0709 19:33:03.080586 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0709 19:33:03.080599 15356 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.051s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.025s ? k8s.io/kops/pkg/resources/digitalocean [no test files] === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.046s ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.004s ? k8s.io/kops/pkg/try [no test files] === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.004s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.005s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.005s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.00s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.035s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.079s ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.011s ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] === RUN TestRemovesDuplicateGuardedBlocks W0709 19:33:03.307851 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.307898 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.307902 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.307906 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.307909 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.307912 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.307915 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.307918 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.307921 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.307923 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.307926 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.307929 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.307931 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.307934 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.307938 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.307943 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.327526 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.327567 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.327626 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.327637 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.327686 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.327694 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.327738 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.327744 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.327788 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.327794 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.327843 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.327850 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.327904 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.327912 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.327979 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.327986 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328032 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328039 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328083 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328089 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328132 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328138 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328191 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328204 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328264 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328270 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328316 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328322 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328366 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328372 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328429 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328436 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328489 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328502 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328551 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328559 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328620 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328628 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328728 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328736 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328786 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328793 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328845 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328852 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328901 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328908 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.328956 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.328963 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329012 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329020 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329069 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329084 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329137 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329145 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329199 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329206 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329256 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329264 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329313 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329320 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329368 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329375 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329438 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329446 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329504 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329511 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329559 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329567 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329614 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329620 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329667 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329674 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329731 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329739 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329795 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329802 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329854 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329861 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329914 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.329921 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.329994 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.330001 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.330069 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.330076 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.330138 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.330148 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.330198 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.330205 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.330254 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.330262 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.330322 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.330330 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.330385 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.330393 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.330447 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.330454 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.331404 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.331453 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.331515 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.331652 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.331760 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.331808 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.331897 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.331908 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.331969 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.331977 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332036 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332044 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332097 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332104 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332155 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332163 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332213 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332220 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332270 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332277 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332328 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332336 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332389 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332397 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332446 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332454 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332503 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332510 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332590 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332599 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332664 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332672 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332724 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332731 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332782 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332790 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332841 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332849 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332901 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332907 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.332962 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.332969 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333019 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333026 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333076 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333084 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333136 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333155 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333208 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333215 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333263 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333269 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333318 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333326 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333378 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333385 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333433 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333440 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333490 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333496 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333543 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333550 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333603 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333610 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333664 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333673 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333726 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333761 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333836 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333865 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.333947 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.333974 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334042 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334068 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334135 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334164 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334231 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334258 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334325 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334350 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334417 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334442 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334507 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334532 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334598 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334624 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334688 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334712 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334776 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334800 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334869 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334896 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.334965 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.334992 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.335061 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.335093 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.335161 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.335186 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.335250 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.335274 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.335338 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.335365 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.03s) === RUN TestRecoversFromBadNesting W0709 19:33:03.336117 15792 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0709 19:33:03.336150 15792 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0709 19:33:03.336175 15792 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0709 19:33:03.336199 15792 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0709 19:33:03.336221 15792 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0709 19:33:03.336242 15792 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0709 19:33:03.336263 15792 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0709 19:33:03.336300 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336325 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336349 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.336372 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336393 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.336415 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336438 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.336446 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336452 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.336457 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336464 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336469 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336474 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336479 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.336485 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.336490 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.354988 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355022 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355102 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355112 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355165 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355173 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355227 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355235 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355459 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355468 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355522 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355531 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355583 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355591 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355662 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355676 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355731 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355742 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355794 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355801 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355849 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355856 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355910 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355918 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.355970 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.355978 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356029 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356037 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356088 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356095 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356144 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356151 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356204 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356212 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356262 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356269 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356318 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356325 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356377 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356384 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356436 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356445 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356495 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356503 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356557 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356565 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356613 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356619 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356696 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356704 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356756 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356763 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356820 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356833 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356887 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356898 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.356966 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.356978 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357030 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357041 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357093 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357107 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357157 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357164 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357212 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357219 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357267 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357274 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357322 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357329 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357388 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357396 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357445 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357452 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357510 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357523 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357576 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357585 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357635 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357643 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357691 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357698 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357746 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357754 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357809 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357816 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.357924 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.357957 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.358030 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.358060 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.358134 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.358187 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.358275 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.358303 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.358376 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.358415 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.358473 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.358508 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.358579 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.358608 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.358678 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.358708 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.358783 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.358813 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.358901 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.358932 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359006 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.359038 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359110 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.359138 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359209 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.359237 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359306 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.359363 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359443 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.359472 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359546 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.359574 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359645 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.359674 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359744 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.359772 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359874 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.359905 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.359978 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360005 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360079 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360109 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360183 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360212 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360282 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360309 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360377 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360406 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360477 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360505 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360578 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360607 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360681 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360691 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360743 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360751 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360808 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360815 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360865 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360872 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360922 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360929 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.360978 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.360985 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361036 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361044 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361109 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361118 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361169 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361176 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361226 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361233 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361282 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361289 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361340 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361348 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361398 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361405 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361455 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361462 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361512 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361519 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361569 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361577 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361629 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361637 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361688 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361696 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361759 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361767 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361820 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361827 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361880 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361889 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361938 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.361945 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.361995 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.362002 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.362050 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.362057 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.362107 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.362114 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.362163 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.362171 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.362222 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.362229 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.362278 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.362285 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.362335 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.362341 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0709 19:33:03.362394 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0709 19:33:03.362402 15792 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.03s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.061s ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.00s) PASS ok k8s.io/kops/tests/codecs 0.035s ? k8s.io/kops/tests/fuzz [no test files] === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.01s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.063s ? k8s.io/kops/tests/integration/channel/simple [no test files] === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.032s ? k8s.io/kops/upup/models [no test files] === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0709 19:33:05.554074 17727 files.go:57] Writing file "/tmp/TestWriteFile1726214858/001/SubDir/test1.tmp" I0709 19:33:05.554197 17727 files.go:113] Changing file mode for "/tmp/TestWriteFile1726214858/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.027s === RUN TestBootstrapChannelBuilder_BuildTasks I0709 19:33:09.756894 18034 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:09.757068 18034 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:09.757092 18034 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:09.757117 18034 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:09.757152 18034 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:09.757204 18034 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:09.757241 18034 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:09.757259 18034 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:09.757300 18034 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:09.757329 18034 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:09.762403 18034 zones.go:93] ListHostedZonesPages { } I0709 19:33:09.821589 18034 zones.go:93] ListHostedZonesPages { } I0709 19:33:09.918526 18034 zones.go:93] ListHostedZonesPages { } I0709 19:33:10.030171 18034 zones.go:93] ListHostedZonesPages { } I0709 19:33:10.158503 18034 zones.go:93] ListHostedZonesPages { } I0709 19:33:10.255756 18034 zones.go:93] ListHostedZonesPages { } I0709 19:33:10.371061 18034 zones.go:93] ListHostedZonesPages { } I0709 19:33:10.538072 18034 zones.go:93] ListHostedZonesPages { } I0709 19:33:11.110167 18034 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.48s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0709 19:33:11.236044 18034 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:11.236230 18034 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:11.236306 18034 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:11.236347 18034 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:11.236376 18034 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:11.236416 18034 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:11.236447 18034 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:11.236468 18034 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:11.236494 18034 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:11.236514 18034 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:11.236535 18034 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0709 19:33:11.237903 18034 zones.go:93] ListHostedZonesPages { } I0709 19:33:11.380377 18034 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.14s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0709 19:33:11.380637 18034 featureflag.go:164] FeatureFlag "ImageDigest"=false I0709 19:33:11.380837 18034 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:11.380901 18034 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0709 19:33:11.380943 18034 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0709 19:33:11.380977 18034 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0709 19:33:11.381015 18034 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0709 19:33:11.381048 18034 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0709 19:33:11.381070 18034 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0709 19:33:11.381099 18034 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0709 19:33:11.381122 18034 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0709 19:33:11.382529 18034 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.13s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.74s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0709 19:33:12.271616 18034 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0709 19:33:12.318942 18034 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0709 19:33:12.319063 18034 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0709 19:33:12.319080 18034 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0709 19:33:12.319183 18034 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0709 19:33:12.319202 18034 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0709 19:33:12.319306 18034 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0709 19:33:12.319413 18034 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0709 19:33:12.319521 18034 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0709 19:33:12.319554 18034 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0709 19:33:12.319658 18034 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0709 19:33:12.319695 18034 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0709 19:33:12.319880 18034 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0709 19:33:12.320058 18034 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0709 19:33:12.320173 18034 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0709 19:33:12.320204 18034 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0709 19:33:12.320218 18034 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0709 19:33:12.320250 18034 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0709 19:33:12.320262 18034 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0709 19:33:12.320274 18034 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0709 19:33:12.320284 18034 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0709 19:33:12.320295 18034 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0709 19:33:12.324399 18034 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0709 19:33:12.324665 18034 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.653s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0709 19:33:09.749152 18035 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4073924133/001 I0709 19:33:09.749408 18035 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4073924133/001 I0709 19:33:09.749619 18035 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender4073924133/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0709 19:33:09.752398 18035 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0709 19:33:09.752450 18035 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0709 19:33:09.752484 18035 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0709 19:33:09.752556 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.752626 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.752678 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.752691 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.752785 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:33:09.752803 18035 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0709 19:33:09.752820 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.752857 18035 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0709 19:33:09.752906 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0709 19:33:09.752936 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.752957 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.752978 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.752985 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.753001 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.753018 18035 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0709 19:33:09.753046 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0709 19:33:09.753131 18035 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0709 19:33:09.753160 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.753204 18035 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0709 19:33:09.753224 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:33:09.753236 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.753249 18035 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0709 19:33:09.753278 18035 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0709 19:33:09.753365 18035 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0709 19:33:09.753394 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:33:09.753408 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.753420 18035 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0709 19:33:09.753451 18035 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:33:09.753516 18035 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0709 19:33:09.753543 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:33:09.753566 18035 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I0709 19:33:09.753583 18035 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0709 19:33:09.753625 18035 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0709 19:33:09.753646 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.753667 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.753675 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.753686 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.753699 18035 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0709 19:33:09.753717 18035 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0709 19:33:09.753744 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.753755 18035 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0709 19:33:09.753782 18035 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:33:09.753807 18035 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0709 19:33:09.753828 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0709 19:33:09.753853 18035 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0709 19:33:09.753887 18035 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0709 19:33:09.753903 18035 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0709 19:33:09.753921 18035 internetgateways.go:66] CreateInternetGateway: { } I0709 19:33:09.753932 18035 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0709 19:33:09.753956 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.753975 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.753994 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.754001 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.754031 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:33:09.754042 18035 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0709 19:33:09.754057 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.754085 18035 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0709 19:33:09.754122 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0709 19:33:09.754148 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.754167 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.754192 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.754199 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.754213 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.754230 18035 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0709 19:33:09.754255 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0709 19:33:09.754550 18035 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender1068837365/001 I0709 19:33:09.754752 18035 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender1068837365/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0709 19:33:09.755014 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.755050 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.755123 18035 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0709 19:33:09.755144 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:33:09.755155 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.755168 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.755204 18035 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0709 19:33:09.755310 18035 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0709 19:33:09.755337 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0709 19:33:09.755352 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0709 19:33:09.755379 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.755400 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.755431 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.755439 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.755451 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.755462 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.755480 18035 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0709 19:33:09.755514 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0709 19:33:09.755619 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.755641 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.755681 18035 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0709 19:33:09.755707 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:33:09.755719 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.755730 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.755747 18035 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0709 19:33:09.755788 18035 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0709 19:33:09.755806 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:33:09.755817 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.755828 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0709 19:33:09.755860 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.755879 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.755916 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.755928 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.755939 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.755951 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.755968 18035 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0709 19:33:09.755993 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.756013 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0709 19:33:09.756078 18035 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0709 19:33:09.756098 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.756137 18035 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0709 19:33:09.756163 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:33:09.756174 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.756185 18035 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0709 19:33:09.756216 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.756275 18035 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0709 19:33:09.756443 18035 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0709 19:33:09.756425 18035 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0709 19:33:09.756506 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:33:09.756538 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.756559 18035 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0709 19:33:09.756638 18035 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0709 19:33:09.756677 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.756719 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.756733 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.756755 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.756777 18035 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0709 19:33:09.756807 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.756836 18035 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0709 19:33:09.756863 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.756875 18035 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0709 19:33:09.756937 18035 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0709 19:33:09.756957 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.756996 18035 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0709 19:33:09.757019 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:33:09.757030 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.757041 18035 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0709 19:33:09.757070 18035 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0709 19:33:09.757155 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.757184 18035 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0709 19:33:09.757215 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:33:09.757229 18035 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0709 19:33:09.757258 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.757280 18035 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0709 19:33:09.757351 18035 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0709 19:33:09.757390 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.757430 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.757444 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.757465 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.757486 18035 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0709 19:33:09.757515 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.757555 18035 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0709 19:33:09.757606 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.757622 18035 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0709 19:33:09.757652 18035 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0709 19:33:09.757698 18035 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0709 19:33:09.757735 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.757756 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.757803 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.757811 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.757843 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:33:09.757855 18035 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0709 19:33:09.757874 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.757890 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.757952 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0709 19:33:09.757972 18035 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0709 19:33:09.757986 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0709 19:33:09.758020 18035 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0709 19:33:09.758039 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.758059 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.758066 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.758080 18035 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0709 19:33:09.758094 18035 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0709 19:33:09.758120 18035 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0709 19:33:09.758167 18035 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.758186 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.758224 18035 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0709 19:33:09.758241 18035 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0709 19:33:09.758251 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.758261 18035 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0709 19:33:09.758293 18035 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.758312 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0709 19:33:09.758332 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.758340 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.758350 18035 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0709 19:33:09.758361 18035 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0709 19:33:09.758423 18035 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0709 19:33:09.758456 18035 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.758485 18035 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0709 19:33:09.758506 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0709 19:33:09.758520 18035 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0709 19:33:09.758535 18035 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.057s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.045s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.032s === RUN TestDiskRenderAzure I0709 19:33:09.730616 18038 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0709 19:33:09.731061 18038 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0709 19:33:09.731287 18038 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0709 19:33:09.731848 18038 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0709 19:33:09.731987 18038 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0709 19:33:09.732203 18038 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0709 19:33:09.732378 18038 resourcegroup.go:108] Creating a new Resource Group with name: rg I0709 19:33:09.732394 18038 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0709 19:33:09.732561 18038 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0709 19:33:09.733108 18038 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0709 19:33:09.733328 18038 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0709 19:33:09.733509 18038 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0709 19:33:09.733747 18038 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0709 19:33:09.734025 18038 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.032s ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.034s ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] === RUN TestProjectIAMBinding I0709 19:33:09.753341 18039 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.753738 18039 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0709 19:33:09.753755 18039 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.754009 18039 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0709 19:33:09.754026 18039 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.754118 18039 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0709 19:33:09.754197 18039 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.754255 18039 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0709 19:33:09.754266 18039 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.754334 18039 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0709 19:33:09.754348 18039 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.754377 18039 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0709 19:33:09.754447 18039 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.754599 18039 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0709 19:33:09.754614 18039 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.754824 18039 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0709 19:33:09.754841 18039 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0709 19:33:09.754924 18039 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.053s ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.057s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.039s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.034s ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.036s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.008s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.034s ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0709 19:33:09.758783 18047 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0709 19:33:09.758825 18047 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0709 19:33:09.758833 18047 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0709 19:33:09.758841 18047 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0709 19:33:09.758846 18047 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0709 19:33:09.758852 18047 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0709 19:33:09.758857 18047 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0709 19:33:09.759179 18047 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.057s ? k8s.io/kops/upup/pkg/fi/secrets [no test files] === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.008s ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.008s ? k8s.io/kops/util/pkg/env [no test files] === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.006s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.009s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.009s ? k8s.io/kops/util/pkg/mirrors [no test files] === RUN TestGetProxyEnvVars W0709 19:33:09.731866 18051 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.026s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.030s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.008s ? k8s.io/kops/util/pkg/tables [no test files] === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.007s ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.022s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0709 19:33:13.783677 18513 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.050s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... kubernetes >>> kops*: Package size: 146.3 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r11.apk >>> kops: Build complete at Wed, 09 Jul 2025 19:36:09 +0000 elapsed time 0h 5m 6s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/4) Purging .makedepends-kops (20250709.193104) (2/4) Purging kubernetes (1.33.1-r1) (3/4) Purging go (1.24.5-r0) (4/4) Purging bash (5.3.0-r0) bash-5.3.0-r0.pre-deinstall: Executing script... busybox-1.37.0-r19.trigger: Executing script... OK: 413 MiB in 106 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...