>>> kops: Building testing/kops 1.28.4-r12 (using abuild 3.15.0-r2) started Fri, 08 Aug 2025 12:46:19 +0000 >>> kops: Validating /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/4) Installing kubernetes (1.33.2-r2) (2/4) Installing go (1.24.6-r0) (3/4) Installing bash (5.3.3-r0) bash-5.3.3-r0.post-install: Executing script... (4/4) Installing .makedepends-kops (20250808.124621) busybox-1.37.0-r22.trigger: Executing script... OK: 635 MiB in 110 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz Connecting to distfiles.alpinelinux.org (172.105.82.32:443) saving to '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' kops-1.28.4.tar.gz.p 100% |********************************| 32.7M 0:00:00 ETA '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' saved >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz >>> kops: Checking sha512sums... kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/spf13/pflag v1.0.5 go: downloading github.com/spf13/cobra v1.7.0 go: downloading golang.org/x/crypto v0.14.0 go: downloading github.com/spf13/viper v1.16.0 go: downloading go.uber.org/multierr v1.11.0 go: downloading k8s.io/api v0.28.1 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/client-go v0.28.1 go: downloading k8s.io/apimachinery v0.28.1 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading k8s.io/klog v1.0.0 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading golang.org/x/net v0.17.0 go: downloading google.golang.org/api v0.138.0 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/gogo/protobuf v1.3.2 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading golang.org/x/sys v0.13.0 go: downloading github.com/kr/fs v0.1.0 go: downloading golang.org/x/term v0.13.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading golang.org/x/text v0.13.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading google.golang.org/protobuf v1.31.0 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading github.com/morikuni/aec v1.0.0 go: downloading google.golang.org/appengine v1.6.7 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0808 12:47:48.618724 17157 addon.go:250] addon test wants to update all nodes I0808 12:47:48.619566 17157 addon.go:250] addon test wants to update workers nodes I0808 12:47:48.619740 17157 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0808 12:47:48.619911 17157 addon.go:283] installing PKI for "test" I0808 12:47:48.906535 17157 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.71s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.750s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.039s ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN TestCreateClusterMinimal I0808 12:47:52.108223 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.108408 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.108440 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.108469 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.108489 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.108520 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.108542 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.108550 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.108576 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.108592 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.111530 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.111563 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.136967 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:52.137102 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:52.137341 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:52.147648 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.147758 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.147780 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.147802 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.147816 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.147835 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.147853 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.147862 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.147877 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.147888 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.150549 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.150581 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.191724 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:52.191830 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:52.192031 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:52.195553 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.195648 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.195665 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.195685 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.195697 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.195715 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.195730 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.195739 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.195754 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.195764 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.197798 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.197823 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.312225 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:52.312344 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:52.312531 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:52.315861 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.315961 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.315977 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.315996 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.316009 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.316026 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.316043 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.316052 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.316066 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.316076 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.318224 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.318248 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.398786 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:52.399005 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:52.399385 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:52.406888 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.407076 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.407109 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.407146 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.407175 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.407209 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.407240 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.407259 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.407290 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.407313 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.411399 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.411451 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.501135 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:52.501262 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:52.501481 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:52.504964 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.505099 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.505116 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.505136 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.505149 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.505167 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.505186 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.505195 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.505209 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.505219 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.508572 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.508622 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.647528 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:52.647613 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:52.647827 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:52.651191 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.651289 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.651306 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.651327 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.651341 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.651357 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.651377 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.651385 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.651406 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.651416 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.653805 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.653828 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.745902 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:52.746027 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:52.746256 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.64s) === RUN TestCreateClusterHetzner I0808 12:47:52.750248 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.750376 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.750395 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.750416 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.750430 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.750448 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.750464 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.750474 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.750489 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.750499 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.753852 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.753893 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0808 12:47:52.836546 18255 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0808 12:47:52.836575 18255 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0808 12:47:52.840771 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.840862 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.840881 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.840903 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.840919 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.840938 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.840961 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.840969 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.840984 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.840994 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.843758 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.843799 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.944147 18255 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.20s) === RUN TestCreateClusterOpenStack I0808 12:47:52.947601 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:52.947702 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:52.947722 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:52.947742 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:52.947758 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:52.947775 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:52.947792 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:52.947801 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:52.947815 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:52.947825 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:52.950607 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:52.950632 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0808 12:47:53.040533 18255 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0808 12:47:53.040585 18255 new_cluster.go:1373] Cloud Provider ID: "openstack" I0808 12:47:53.046066 18255 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.11s) === RUN TestCreateClusterOpenStackOctavia I0808 12:47:53.055668 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:53.055856 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:53.055893 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:53.055934 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:53.055963 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:53.056026 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:53.056059 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:53.056080 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:53.056107 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:53.056128 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:53.059956 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.060033 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0808 12:47:53.153740 18255 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0808 12:47:53.153779 18255 new_cluster.go:1373] Cloud Provider ID: "openstack" I0808 12:47:53.156116 18255 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0808 12:47:53.156154 18255 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.11s) === RUN TestCreateClusterOpenStackNoDNS I0808 12:47:53.167435 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:53.167636 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:53.167671 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:53.167712 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:53.167744 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:53.167782 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:53.167815 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:53.167835 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:53.167863 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:53.167885 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:53.171222 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.171264 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0808 12:47:53.213789 18255 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0808 12:47:53.213830 18255 new_cluster.go:1373] Cloud Provider ID: "openstack" I0808 12:47:53.213868 18255 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0808 12:47:53.213881 18255 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.05s) === RUN TestCreateClusterCilium I0808 12:47:53.220082 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:53.220202 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:53.220234 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:53.220257 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:53.220273 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:53.220294 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:53.220315 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:53.220328 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:53.220351 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:53.220364 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:53.222646 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.222668 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.342091 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:53.342215 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:53.342432 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.13s) === RUN TestCreateClusterOverride I0808 12:47:53.349654 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:53.349823 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:53.349850 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:53.349877 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:53.349898 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:53.349926 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:53.349949 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:53.349963 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:53.349985 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:53.350000 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:53.352845 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.352878 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.459717 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:53.460018 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:53.460201 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.11s) === RUN TestCreateClusterKubernetesFeatureGates I0808 12:47:53.463577 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:53.463675 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:53.463692 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:53.463711 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:53.463725 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:53.463741 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:53.463758 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:53.463767 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:53.463781 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:53.463790 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:53.467255 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.467309 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.534071 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:53.534225 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:53.534542 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.08s) === RUN TestCreateClusterComplex I0808 12:47:53.540044 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:53.540172 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:53.540192 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:53.540215 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:53.540231 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:53.540252 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:53.540273 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:53.540284 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:53.540302 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:53.540314 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:53.543529 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.543559 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.728580 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:53.728773 18255 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0808 12:47:53.728782 18255 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0808 12:47:53.728785 18255 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0808 12:47:53.729013 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.20s) === RUN TestCreateClusterComplexPrivate I0808 12:47:53.742030 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:53.742223 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:53.742257 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:53.742302 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:53.742329 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:53.742363 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:53.742392 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:53.742415 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:53.742441 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:53.742461 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:53.746982 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.747042 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.890288 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:53.890526 18255 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0808 12:47:53.890533 18255 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0808 12:47:53.890537 18255 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0808 12:47:53.890539 18255 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0808 12:47:53.890542 18255 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0808 12:47:53.890544 18255 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0808 12:47:53.890547 18255 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0808 12:47:53.890554 18255 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0808 12:47:53.890559 18255 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0808 12:47:53.890562 18255 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0808 12:47:53.890878 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.16s) === RUN TestCreateClusterHA I0808 12:47:53.897853 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:53.897952 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:53.897970 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:53.897989 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:53.898002 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:53.898020 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:53.898037 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:53.898046 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:53.898060 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:53.898071 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:53.901315 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:53.901367 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.003661 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:54.003863 18255 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0808 12:47:54.003871 18255 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0808 12:47:54.003876 18255 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0808 12:47:54.004113 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:54.009506 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.009600 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.009618 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.009639 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.009657 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.009675 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.009693 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.009702 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.009716 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.009727 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.012075 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.012100 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.244271 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:54.244497 18255 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0808 12:47:54.244506 18255 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0808 12:47:54.244509 18255 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0808 12:47:54.244720 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.35s) === RUN TestCreateClusterMinimalGCE I0808 12:47:54.249697 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.249804 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.249820 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.249839 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.249851 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.249867 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.249882 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.249890 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.249904 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.249913 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.252694 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.252738 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.299990 18255 new_cluster.go:1373] Cloud Provider ID: "gce" I0808 12:47:54.300075 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0808 12:47:54.304633 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.304735 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.304755 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.304773 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.304788 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.304807 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.304822 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.304833 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.304851 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.304865 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.308362 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.308414 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.395858 18255 new_cluster.go:1373] Cloud Provider ID: "gce" I0808 12:47:54.395950 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.15s) === RUN TestCreateClusterHAGCE I0808 12:47:54.401658 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.401859 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.401886 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.401914 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.401944 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.401997 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.402020 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.402032 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.402051 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.402066 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.405327 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.405374 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.467961 18255 new_cluster.go:1373] Cloud Provider ID: "gce" I0808 12:47:54.468067 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.07s) === RUN TestCreateClusterGCE I0808 12:47:54.476134 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.476245 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.476263 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.476283 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.476302 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.476322 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.476339 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.476348 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.476363 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.476373 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.521806 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.521871 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.598409 18255 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0808 12:47:54.598470 18255 new_cluster.go:1373] Cloud Provider ID: "gce" I0808 12:47:54.598530 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.13s) === RUN TestCreateClusterHASharedZone I0808 12:47:54.602015 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.602116 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.602134 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.602153 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.602165 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.602182 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.602198 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.602208 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.602222 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.602232 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.605748 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.605801 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0808 12:47:54.647757 18255 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0808 12:47:54.647811 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:54.648088 18255 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0808 12:47:54.648435 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.05s) === RUN TestCreateClusterHASharedZones I0808 12:47:54.656604 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.656762 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.656788 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.656815 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.656836 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.656864 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.656889 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.656903 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.656924 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.656938 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.659853 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.659886 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0808 12:47:54.716016 18255 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0808 12:47:54.716049 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:54.716255 18255 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0808 12:47:54.716262 18255 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0808 12:47:54.716447 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.07s) === RUN TestCreateClusterPrivate I0808 12:47:54.722280 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.722372 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.722387 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.722406 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.722420 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.722436 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.722453 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.722462 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.722476 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.722487 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.725211 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.725238 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.809213 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:54.809403 18255 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0808 12:47:54.809421 18255 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0808 12:47:54.809698 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:54.809750 18255 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.09s) === RUN TestCreateClusterPrivateGCE I0808 12:47:54.815746 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.815875 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.815898 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.815926 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.815945 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.815970 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.815991 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.816002 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.816019 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.816032 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.819397 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.819448 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.972764 18255 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0808 12:47:54.972827 18255 new_cluster.go:1373] Cloud Provider ID: "gce" I0808 12:47:54.972886 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.16s) === RUN TestCreateClusterWithNGWSpecified I0808 12:47:54.976818 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:54.976914 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:54.976932 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:54.976950 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:54.976963 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:54.976982 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:54.976998 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:54.977007 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:54.977021 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:54.977030 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:54.980893 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:54.980944 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.032262 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:55.032483 18255 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0808 12:47:55.032503 18255 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0808 12:47:55.032805 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.032849 18255 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.06s) === RUN TestCreateClusterWithINGWSpecified I0808 12:47:55.039837 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.039976 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.040000 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.040026 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.040047 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.040072 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.040094 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.040109 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.040137 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.040152 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.043340 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.043379 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.069243 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:55.069470 18255 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0808 12:47:55.069490 18255 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0808 12:47:55.069730 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.069759 18255 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.04s) === RUN TestCreateClusterSharedVPC I0808 12:47:55.076396 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.076536 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.076560 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.076584 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.076605 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.076630 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.076655 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.076670 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.076695 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.076712 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.080217 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.080270 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.173748 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:55.173859 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.173899 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.173919 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.173929 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.173954 18255 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0808 12:47:55.174183 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.10s) === RUN TestCreateClusterSharedSubnets I0808 12:47:55.179743 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.179853 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.179872 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.179896 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.179911 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.179930 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.179948 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.179957 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.179970 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.179981 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.182247 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.182272 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.286903 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.286949 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.287015 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:55.287106 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.287118 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.287131 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.287139 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.287361 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.11s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0808 12:47:55.290981 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.291077 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.291094 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.291113 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.291126 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.291144 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.291161 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.291170 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.291183 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.291194 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.294396 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.294444 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.380382 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:47:55.380425 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.380439 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.380504 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:55.380588 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.380599 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.380610 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.380617 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.380840 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.09s) === RUN TestCreateClusterPrivateSharedSubnets I0808 12:47:55.384259 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.384360 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.384377 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.384393 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.384407 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.384424 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.384440 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.384449 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.384463 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.384474 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.388123 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.388154 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.509213 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.509243 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.509277 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.509285 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.509331 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:55.509419 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.509430 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.509441 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:47:55.509447 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:47:55.509661 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.13s) === RUN TestCreateClusterIPv6 I0808 12:47:55.513009 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.513112 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.513129 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.513145 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.513158 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.513173 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.513188 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.513196 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.513208 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.513218 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.516201 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.516224 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.531472 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:55.531555 18255 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0808 12:47:55.531570 18255 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0808 12:47:55.531812 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.02s) === RUN TestCreateClusterDifferentAMIs I0808 12:47:55.535291 18255 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0808 12:47:55.535298 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.535379 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.535392 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.535406 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.535417 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.535431 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.535444 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.535453 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.535464 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.535472 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.538362 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.538396 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.586464 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:55.586516 18255 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0808 12:47:55.586530 18255 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0808 12:47:55.586733 18255 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.599016 18255 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.06s) === RUN TestCreateClusterKarpenter I0808 12:47:55.599125 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.599303 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.599336 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.599372 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.599401 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.599436 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.599465 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.599486 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.599513 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.599532 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.603473 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.603525 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0808 12:47:55.663162 18255 new_cluster.go:1373] Cloud Provider ID: "aws" I0808 12:47:55.663315 18255 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0808 12:47:55.663326 18255 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0808 12:47:55.663333 18255 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0808 12:47:55.663631 18255 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.07s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0808 12:47:55.669417 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.669550 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.669573 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.669625 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.669645 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.669675 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.669699 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.669712 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.669732 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.669747 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.674183 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I0808 12:47:55.675180 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.675285 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.675303 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.675331 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.675347 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.675373 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.675388 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.675400 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.675417 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.675428 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.685568 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0808 12:47:55.686775 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:47:55.686808 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0808 12:47:59.619166 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:01.501234 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:48:01.504046 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:01.504070 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:01.504130 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:01.505140 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:48:01.512414 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:48:01.513180 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:01.513430 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:01.513706 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:01.513982 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:01.514064 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:48:01.514358 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:48:01.514712 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:48:01.520483 18255 target.go:111] Terraform output is in /tmp/test2748849535/out --- PASS: TestMinimal (5.85s) === RUN TestMinimal_v1_23 I0808 12:48:01.524775 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:01.524955 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:01.525005 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:01.525043 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:01.525072 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:01.525111 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:01.525143 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:01.525213 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:01.525245 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:01.525266 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:01.545379 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0808 12:48:01.547936 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:01.548004 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:03.120816 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:03.238382 18255 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0808 12:48:03.238912 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:03.238944 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:03.239061 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:03.241962 18255 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0808 12:48:03.250502 18255 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0808 12:48:03.251033 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:03.251296 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:03.251440 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:03.251918 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:03.252005 18255 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0808 12:48:03.252234 18255 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0808 12:48:03.252473 18255 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0808 12:48:03.258451 18255 target.go:111] Terraform output is in /tmp/test3941359156/out --- PASS: TestMinimal_v1_23 (1.74s) === RUN TestMinimal_v1_24 I0808 12:48:03.263069 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:03.263268 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:03.263313 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:03.263353 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:03.263382 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:03.263421 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:03.263455 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:03.263478 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:03.263506 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:03.263530 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:03.284745 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:48:03.287501 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:03.287571 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:04.909776 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:05.060941 18255 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0808 12:48:05.061551 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:05.061588 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:05.061691 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:05.063453 18255 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0808 12:48:05.066138 18255 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0808 12:48:05.066297 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:05.067387 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:05.067479 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:05.068650 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:05.068863 18255 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0808 12:48:05.069370 18255 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0808 12:48:05.070132 18255 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0808 12:48:05.077682 18255 target.go:111] Terraform output is in /tmp/test3284148591/out --- PASS: TestMinimal_v1_24 (1.82s) === RUN TestMinimal_v1_25 I0808 12:48:05.082556 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:05.082758 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:05.082798 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:05.082840 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:05.082870 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:05.082915 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:05.082950 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:05.082971 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:05.083002 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:05.083024 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:05.103856 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0808 12:48:05.106550 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:05.106623 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:06.460466 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:06.595465 18255 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0808 12:48:06.597147 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:06.597719 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:06.597835 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:06.602911 18255 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0808 12:48:06.607600 18255 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0808 12:48:06.607865 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:06.608110 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:06.608500 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:06.608561 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:06.608645 18255 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0808 12:48:06.608858 18255 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0808 12:48:06.609074 18255 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0808 12:48:06.614563 18255 target.go:111] Terraform output is in /tmp/test1505987100/out --- PASS: TestMinimal_v1_25 (1.54s) === RUN TestMinimal_v1_26 I0808 12:48:06.618950 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:06.619127 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:06.619159 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:06.619194 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:06.619222 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:06.619256 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:06.619284 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:06.619303 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:06.619333 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:06.619353 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:06.639163 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0808 12:48:06.642074 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:06.642143 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:07.991386 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:08.135945 18255 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0808 12:48:08.139485 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:08.139532 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:08.139642 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:08.143522 18255 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0808 12:48:08.148141 18255 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0808 12:48:08.148512 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:08.148716 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:08.148877 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:08.149344 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:08.149455 18255 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0808 12:48:08.149729 18255 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0808 12:48:08.149976 18255 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0808 12:48:08.155423 18255 target.go:111] Terraform output is in /tmp/test730402302/out --- PASS: TestMinimal_v1_26 (1.54s) === RUN TestMinimal_v1_27 I0808 12:48:08.159839 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:08.160026 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:08.160059 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:08.160095 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:08.160124 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:08.160162 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:08.160193 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:08.160215 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:08.160242 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:08.160262 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:08.181037 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0808 12:48:08.183670 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:08.183738 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:11.474235 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:11.588034 18255 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0808 12:48:11.588694 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:11.588712 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:11.588775 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:11.594317 18255 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0808 12:48:11.597395 18255 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0808 12:48:11.597809 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:11.598013 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:11.598202 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:11.598646 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:11.598766 18255 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0808 12:48:11.599001 18255 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0808 12:48:11.599178 18255 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0808 12:48:11.603236 18255 target.go:111] Terraform output is in /tmp/test1477156330/out --- PASS: TestMinimal_v1_27 (3.45s) === RUN TestMinimal_NoneDNS I0808 12:48:11.606400 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:11.606538 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:11.606562 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:11.606592 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:11.606613 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:11.606639 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:11.606662 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:11.606676 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:11.606696 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:11.606713 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0808 12:48:11.621762 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:11.621813 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:12.422841 18255 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0808 12:48:12.426032 18255 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0808 12:48:12.427216 18255 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0808 12:48:12.427805 18255 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0808 12:48:12.427856 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:12.427920 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:12.428014 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:12.428071 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:12.432133 18255 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0808 12:48:12.432305 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:12.432482 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:12.432658 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:12.433043 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:12.433122 18255 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0808 12:48:12.433344 18255 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0808 12:48:12.433580 18255 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0808 12:48:12.442540 18255 target.go:111] Terraform output is in /tmp/test3419945727/out --- PASS: TestMinimal_NoneDNS (0.84s) === RUN TestHetzner I0808 12:48:12.447844 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:48:13.917368 18255 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0808 12:48:13.925663 18255 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0808 12:48:13.926011 18255 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0808 12:48:13.930063 18255 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0808 12:48:13.930895 18255 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0808 12:48:13.933743 18255 target.go:111] Terraform output is in /tmp/test2579144793/out --- PASS: TestHetzner (1.49s) === RUN TestNvidia I0808 12:48:13.936650 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:13.936850 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:13.936890 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:13.936936 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:13.936967 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:13.937004 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:13.937038 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:13.937061 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:13.937089 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:13.937112 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:13.956565 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:13.959287 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:13.959361 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.099611 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:15.188726 18255 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0808 12:48:15.189104 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:15.189124 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:15.189192 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:15.192017 18255 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0808 12:48:15.196677 18255 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0808 12:48:15.196878 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.197003 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.197315 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.197363 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.197405 18255 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0808 12:48:15.197569 18255 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0808 12:48:15.197703 18255 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0808 12:48:15.201610 18255 target.go:111] Terraform output is in /tmp/test984216648/out --- PASS: TestNvidia (1.27s) === RUN TestMinimalGossip I0808 12:48:15.204780 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:15.204945 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:15.204992 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:15.205030 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:15.205057 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:15.205093 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:15.205119 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:15.205132 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:15.205152 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:15.205168 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:15.220943 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.221008 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.980855 18255 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0808 12:48:15.984186 18255 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0808 12:48:15.989653 18255 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0808 12:48:15.990058 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.990270 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.990502 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.990609 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:15.990687 18255 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0808 12:48:15.990903 18255 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0808 12:48:15.991042 18255 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0808 12:48:15.996296 18255 target.go:111] Terraform output is in /tmp/test2436032121/out --- PASS: TestMinimalGossip (0.80s) === RUN TestMinimalGossipIRSA I0808 12:48:16.000673 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:16.000885 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:16.000922 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:16.000959 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:16.000988 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:16.001023 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:16.001054 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:16.001075 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:16.001103 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:16.001124 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:16.016717 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:16.016762 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:16.813300 18255 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0808 12:48:16.822382 18255 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0808 12:48:16.826110 18255 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0808 12:48:16.826634 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:16.826811 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:16.826958 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:16.827081 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:16.827138 18255 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0808 12:48:16.827287 18255 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0808 12:48:16.827427 18255 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0808 12:48:16.833600 18255 target.go:111] Terraform output is in /tmp/test60759774/out --- PASS: TestMinimalGossipIRSA (0.84s) === RUN TestMinimalGCE I0808 12:48:16.839012 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:16.840527 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:48:18.404475 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:48:18.404556 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:48:18.404650 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0808 12:48:18.404671 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0808 12:48:18.404688 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0808 12:48:18.404735 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0808 12:48:18.405729 18255 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0808 12:48:18.412514 18255 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0808 12:48:18.417204 18255 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0808 12:48:18.418019 18255 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0808 12:48:18.418244 18255 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0808 12:48:18.421625 18255 target.go:111] Terraform output is in /tmp/test3986841173/out --- PASS: TestMinimalGCE (1.59s) === RUN TestMinimalGCEPrivate I0808 12:48:18.424865 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:18.426340 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:48:19.528356 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:48:19.528414 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:48:19.528481 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0808 12:48:19.528500 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0808 12:48:19.528513 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0808 12:48:19.528550 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0808 12:48:19.529269 18255 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0808 12:48:19.531798 18255 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0808 12:48:19.536152 18255 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0808 12:48:19.536928 18255 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0808 12:48:19.537063 18255 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0808 12:48:19.540631 18255 target.go:111] Terraform output is in /tmp/test2422966115/out --- PASS: TestMinimalGCEPrivate (1.12s) === RUN TestMinimalGCEInternalLoadBalancer I0808 12:48:19.543878 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:19.545463 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:48:20.584845 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:48:20.584889 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:48:20.584937 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0808 12:48:20.584951 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0808 12:48:20.584958 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0808 12:48:20.585005 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0808 12:48:20.585024 18255 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0808 12:48:20.585573 18255 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0808 12:48:20.587178 18255 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0808 12:48:20.587447 18255 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0808 12:48:20.587659 18255 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0808 12:48:20.589633 18255 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0808 12:48:20.589998 18255 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0808 12:48:20.590125 18255 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0808 12:48:20.590318 18255 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0808 12:48:20.590502 18255 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0808 12:48:20.593607 18255 target.go:111] Terraform output is in /tmp/test195662695/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.05s) === RUN TestMinimalGCEPublicLoadBalancer I0808 12:48:20.596073 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:20.596963 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:48:21.690906 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:48:21.690978 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:48:21.691089 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0808 12:48:21.691112 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0808 12:48:21.691130 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0808 12:48:21.691180 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0808 12:48:21.692432 18255 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0808 12:48:21.695720 18255 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0808 12:48:21.700023 18255 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0808 12:48:21.701167 18255 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0808 12:48:21.701296 18255 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0808 12:48:21.704794 18255 target.go:111] Terraform output is in /tmp/test3593548796/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.11s) === RUN TestMinimalGCELongClusterName I0808 12:48:21.708084 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:21.709537 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:48:22.809395 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:48:22.809492 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:48:22.809605 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0808 12:48:22.809630 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0808 12:48:22.809649 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0808 12:48:22.809704 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0808 12:48:22.810770 18255 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0808 12:48:22.815072 18255 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0808 12:48:22.819467 18255 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0808 12:48:22.820153 18255 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0808 12:48:22.820300 18255 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0808 12:48:22.823807 18255 target.go:111] Terraform output is in /tmp/test208701354/out --- PASS: TestMinimalGCELongClusterName (1.12s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0808 12:48:22.827152 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:22.828716 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:48:23.919811 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:48:23.919861 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:48:23.919943 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0808 12:48:23.919956 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0808 12:48:23.919964 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0808 12:48:23.919989 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0808 12:48:23.920007 18255 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0808 12:48:23.920624 18255 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0808 12:48:23.926442 18255 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0808 12:48:23.926843 18255 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0808 12:48:23.926962 18255 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0808 12:48:23.929214 18255 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0808 12:48:23.929778 18255 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0808 12:48:23.929925 18255 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0808 12:48:23.930056 18255 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0808 12:48:23.930173 18255 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0808 12:48:23.933647 18255 target.go:111] Terraform output is in /tmp/test3115141519/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.11s) === RUN TestMinimalGCEDNSNone I0808 12:48:23.937010 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:23.938566 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:48:25.014815 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:48:25.014871 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:48:25.014937 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0808 12:48:25.014949 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0808 12:48:25.014959 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0808 12:48:25.015003 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0808 12:48:25.015025 18255 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0808 12:48:25.016050 18255 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0808 12:48:25.019080 18255 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0808 12:48:25.019545 18255 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0808 12:48:25.019722 18255 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0808 12:48:25.023961 18255 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0808 12:48:25.024777 18255 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0808 12:48:25.024954 18255 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0808 12:48:25.025119 18255 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0808 12:48:25.025292 18255 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0808 12:48:25.028887 18255 target.go:111] Terraform output is in /tmp/test2285953902/out --- PASS: TestMinimalGCEDNSNone (1.09s) === RUN TestMinimalScaleway I0808 12:48:25.032017 18255 featureflag.go:164] FeatureFlag "Scaleway"=true I0808 12:48:25.032034 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:48:26.410640 18255 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0808 12:48:26.413673 18255 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0808 12:48:26.417778 18255 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0808 12:48:26.418649 18255 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0808 12:48:26.421541 18255 target.go:111] Terraform output is in /tmp/test2106636149/out I0808 12:48:26.424746 18255 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (1.39s) === RUN TestHA I0808 12:48:26.424867 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:26.425063 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:26.425098 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:26.425138 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:26.425167 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:26.425205 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:26.425237 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:26.425259 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:26.425287 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:26.425308 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:26.449683 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:26.452520 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:26.452584 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:26.452624 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:26.452657 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:27.127904 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:27.274098 18255 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0808 12:48:27.276119 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:27.276148 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:27.276232 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:27.278886 18255 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0808 12:48:27.283288 18255 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0808 12:48:27.283625 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:27.283813 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:27.284006 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:27.284174 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:27.284358 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:27.284440 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:27.284528 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:27.284603 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:27.284675 18255 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0808 12:48:27.284931 18255 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0808 12:48:27.285227 18255 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0808 12:48:27.292232 18255 target.go:111] Terraform output is in /tmp/test1365563262/out --- PASS: TestHA (0.87s) === RUN TestHighAvailabilityGCE I0808 12:48:27.297689 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:27.299356 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:48:28.436966 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:48:28.437048 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:48:28.437157 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0808 12:48:28.437182 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0808 12:48:28.437202 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0808 12:48:28.437259 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0808 12:48:28.437319 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0808 12:48:28.437367 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0808 12:48:28.438816 18255 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0808 12:48:28.442645 18255 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0808 12:48:28.447065 18255 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0808 12:48:28.449882 18255 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0808 12:48:28.450658 18255 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0808 12:48:28.457951 18255 target.go:111] Terraform output is in /tmp/test2391332551/out --- PASS: TestHighAvailabilityGCE (1.16s) === RUN TestComplex I0808 12:48:28.462376 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:28.462577 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:28.462619 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:28.462703 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:28.462739 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:28.462779 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:28.462814 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:28.462833 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:28.462864 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:28.462887 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:28.488619 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:48:28.492069 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:28.492140 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:29.755945 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:29.885036 18255 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0808 12:48:29.885639 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:29.885670 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:29.885757 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:29.888360 18255 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0808 12:48:29.890666 18255 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0808 12:48:29.892648 18255 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0808 12:48:29.892927 18255 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0808 12:48:29.893011 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:29.893107 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:29.893186 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:29.893214 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:29.897551 18255 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0808 12:48:29.897709 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:29.897767 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:29.897924 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:29.898441 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:29.898532 18255 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0808 12:48:29.898858 18255 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0808 12:48:29.899123 18255 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0808 12:48:29.909041 18255 target.go:111] Terraform output is in /tmp/test1406225962/out I0808 12:48:29.914010 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:29.914265 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:29.914322 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:29.914392 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:29.914457 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:29.914521 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:29.914578 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:29.914621 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:29.914662 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:29.914684 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:29.937443 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:48:29.939907 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:29.939957 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:30.639087 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:30.776535 18255 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0808 12:48:30.777503 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:30.777534 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:30.777620 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:30.780459 18255 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0808 12:48:30.783106 18255 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0808 12:48:30.783779 18255 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0808 12:48:30.784071 18255 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0808 12:48:30.784150 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:30.784240 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:30.784347 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:30.784406 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:30.788613 18255 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0808 12:48:30.788747 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:30.788937 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:30.789317 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:30.789386 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:30.789441 18255 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0808 12:48:30.789673 18255 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0808 12:48:30.789925 18255 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0808 12:48:30.797066 18255 target.go:111] Terraform output is in /tmp/test1153904417/out --- PASS: TestComplex (2.34s) === RUN TestCompress I0808 12:48:30.801413 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:30.801592 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:30.801625 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:30.801686 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:30.801714 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:30.801749 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:30.801778 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:30.801800 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:30.801827 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:30.801848 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:30.820014 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:30.822501 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:30.822563 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:31.500242 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:31.642208 18255 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0808 12:48:31.643247 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:31.643275 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:31.643377 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:31.644948 18255 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0808 12:48:31.649506 18255 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0808 12:48:31.649815 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:31.650099 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:31.652424 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:31.652535 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:31.652629 18255 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0808 12:48:31.653431 18255 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0808 12:48:31.654124 18255 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0808 12:48:31.661831 18255 target.go:111] Terraform output is in /tmp/test649001856/out --- PASS: TestCompress (0.86s) === RUN TestExternalPolicies I0808 12:48:31.666162 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:31.666352 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:31.666387 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:31.666426 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:31.666457 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:31.666496 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:31.666528 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:31.666548 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:31.666575 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:31.666596 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:31.688035 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:31.690917 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:31.690985 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:32.367130 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:32.513868 18255 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0808 12:48:32.514239 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:32.514270 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:32.514352 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:32.516919 18255 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0808 12:48:32.519601 18255 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0808 12:48:32.520390 18255 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0808 12:48:32.520487 18255 api.go:53] PageSize not implemented W0808 12:48:32.520584 18255 api.go:53] PageSize not implemented I0808 12:48:32.527077 18255 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0808 12:48:32.527767 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:32.528986 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:32.529364 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:32.529441 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:32.529530 18255 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0808 12:48:32.529751 18255 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0808 12:48:32.530025 18255 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0808 12:48:32.536173 18255 target.go:111] Terraform output is in /tmp/test1883413399/out --- PASS: TestExternalPolicies (0.87s) === RUN TestMinimalIPv6 I0808 12:48:32.540971 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:32.541150 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:32.541184 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:32.541221 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:32.541257 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:32.541293 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:32.541325 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:32.541345 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:32.541372 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:32.541394 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:32.563879 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:48:32.566909 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:32.566973 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:33.250083 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:33.394906 18255 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0808 12:48:33.398424 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:33.398466 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:33.398552 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:33.399081 18255 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0808 12:48:33.405705 18255 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0808 12:48:33.407267 18255 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0808 12:48:33.407709 18255 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0808 12:48:33.407855 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:33.407936 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:33.408052 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:33.408157 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:33.415186 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:48:33.415436 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:33.415667 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:33.416002 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:33.416352 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:33.416441 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:48:33.416701 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:48:33.416953 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:48:33.423890 18255 target.go:111] Terraform output is in /tmp/test465311660/out --- PASS: TestMinimalIPv6 (0.89s) === RUN TestMinimalIPv6Calico I0808 12:48:33.428764 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:33.428958 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:33.428997 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:33.429037 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:33.429068 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:33.429108 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:33.429143 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:33.429165 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:33.429197 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:33.429220 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:33.452568 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:48:33.455765 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:33.455828 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:34.136535 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:34.466105 18255 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0808 12:48:34.468054 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:34.468088 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:34.468178 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:34.470105 18255 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0808 12:48:34.471990 18255 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0808 12:48:34.472557 18255 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0808 12:48:34.472766 18255 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0808 12:48:34.472830 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:34.472895 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:34.472991 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:34.473051 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:34.477179 18255 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0808 12:48:34.477308 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:34.477483 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:34.477619 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:34.478049 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:34.478142 18255 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0808 12:48:34.478367 18255 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0808 12:48:34.478531 18255 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0808 12:48:34.483981 18255 target.go:111] Terraform output is in /tmp/test90044330/out --- PASS: TestMinimalIPv6Calico (1.06s) === RUN TestMinimalIPv6Cilium I0808 12:48:34.493509 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:34.493692 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:34.493725 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:34.493763 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:34.493792 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:34.493826 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:34.493858 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:34.493879 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:34.493907 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:34.493928 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:34.517509 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:48:34.520667 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:34.520730 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:35.194111 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:35.367144 18255 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0808 12:48:35.367586 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:35.367618 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:35.367705 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:35.370039 18255 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0808 12:48:35.372712 18255 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0808 12:48:35.373637 18255 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0808 12:48:35.373882 18255 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0808 12:48:35.374033 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:35.374113 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:35.374224 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:35.374294 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:35.378494 18255 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0808 12:48:35.378671 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:35.378911 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:35.379319 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:35.379396 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:35.379472 18255 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0808 12:48:35.379717 18255 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0808 12:48:35.379987 18255 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0808 12:48:35.386791 18255 target.go:111] Terraform output is in /tmp/test860470951/out --- PASS: TestMinimalIPv6Cilium (0.90s) === RUN TestMinimalIPv6NoSubnetPrefix I0808 12:48:35.392024 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:35.392199 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:35.392232 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:35.392268 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:35.392304 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:35.392342 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:35.392373 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:35.392393 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:35.392421 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:35.392441 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:35.415225 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:48:35.418284 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:35.418363 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:36.090734 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:36.235482 18255 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0808 12:48:36.237793 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:36.237835 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:36.237951 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:36.239198 18255 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0808 12:48:36.241330 18255 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0808 12:48:36.242141 18255 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0808 12:48:36.242418 18255 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0808 12:48:36.242498 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:36.242588 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:36.242693 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:48:36.242765 18255 loadbalancers.go:35] PageSize not implemented I0808 12:48:36.246738 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:48:36.246873 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:36.247042 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:36.247378 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:36.247445 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:36.247501 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:48:36.247702 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:48:36.247933 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:48:36.254406 18255 target.go:111] Terraform output is in /tmp/test1538626766/out --- PASS: TestMinimalIPv6NoSubnetPrefix (0.87s) === RUN TestMinimalWarmPool I0808 12:48:36.258976 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:36.259150 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:36.259184 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:36.259220 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:36.259252 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:36.259287 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:36.259318 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:36.259336 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:36.259365 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:36.259386 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:36.282280 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:36.285044 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:36.285112 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:36.963874 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:37.118609 18255 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0808 12:48:37.120947 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:37.121252 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:37.121438 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:37.126263 18255 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0808 12:48:37.130912 18255 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0808 12:48:37.131319 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:37.131541 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:37.131994 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:37.132071 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:37.132131 18255 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0808 12:48:37.132373 18255 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0808 12:48:37.132645 18255 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0808 12:48:37.138522 18255 target.go:111] Terraform output is in /tmp/test2378082560/out --- PASS: TestMinimalWarmPool (0.88s) === RUN TestMinimalEtcd I0808 12:48:37.143762 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:37.143952 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:37.143988 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:37.144025 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:37.144054 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:37.144090 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:37.144125 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:37.144146 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:37.144175 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:37.144198 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:37.164560 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:37.167260 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:37.167325 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:37.848218 18255 zones.go:93] ListHostedZonesPages { } W0808 12:48:37.986395 18255 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0808 12:48:37.986454 18255 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0808 12:48:37.988576 18255 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0808 12:48:37.998057 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:48:38.000896 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:38.000930 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:38.001038 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:38.002569 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:48:38.010944 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:48:38.011200 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.011483 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.011838 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.012125 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.012223 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:48:38.012732 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:48:38.013163 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:48:38.020053 18255 target.go:111] Terraform output is in /tmp/test3984554190/out --- PASS: TestMinimalEtcd (0.88s) === RUN TestMinimalGp3 I0808 12:48:38.024734 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:38.024929 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:38.024987 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:38.025033 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:38.025066 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:38.025105 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:38.025138 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:38.025162 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:38.025192 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:38.025214 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:38.045033 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:38.047530 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.047623 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.726503 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:38.864570 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:48:38.865096 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:38.865127 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:38.865208 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:38.867550 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:48:38.870943 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:48:38.871172 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.871329 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.871588 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.871733 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.871816 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:48:38.872010 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:48:38.872257 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:48:38.877683 18255 target.go:111] Terraform output is in /tmp/test3218879931/out --- PASS: TestMinimalGp3 (0.86s) === RUN TestMinimalLongClusterName I0808 12:48:38.881979 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:38.882158 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:38.882191 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:38.882227 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:38.882255 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:38.882291 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:38.882320 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:38.882340 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:38.882368 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:38.882391 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:38.904941 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:38.907970 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:38.908083 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0808 12:48:39.590103 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:39.728121 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:48:39.730475 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:39.730508 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:39.730613 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:39.732394 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:48:39.740897 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:48:39.741103 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:39.741774 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:39.741963 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:39.742189 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:39.742284 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:48:39.742504 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:48:39.742714 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:48:39.748180 18255 target.go:111] Terraform output is in /tmp/test1578093582/out --- PASS: TestMinimalLongClusterName (0.87s) === RUN TestExistingSG I0808 12:48:39.752693 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:39.752870 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:39.752903 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:39.752938 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:39.752965 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:39.753000 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:39.753028 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:39.753049 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:39.753075 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:39.753095 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:39.778293 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:39.781151 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:39.781210 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:39.781245 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:39.781279 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.453754 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:40.607164 18255 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0808 12:48:40.607633 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:40.607678 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:40.607783 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:40.610106 18255 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0808 12:48:40.612931 18255 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0808 12:48:40.613903 18255 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0808 12:48:40.613992 18255 api.go:53] PageSize not implemented W0808 12:48:40.614044 18255 api.go:53] PageSize not implemented W0808 12:48:40.614103 18255 api.go:53] PageSize not implemented W0808 12:48:40.614165 18255 api.go:53] PageSize not implemented I0808 12:48:40.618344 18255 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0808 12:48:40.618492 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.618615 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.618798 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.618977 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.619084 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.619135 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.619179 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.619556 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.619648 18255 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0808 12:48:40.620001 18255 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0808 12:48:40.620271 18255 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0808 12:48:40.627693 18255 target.go:111] Terraform output is in /tmp/test707829151/out --- PASS: TestExistingSG (0.88s) === RUN TestBastionAdditionalUserData I0808 12:48:40.632709 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:40.632881 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:40.632912 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:40.632948 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:40.632976 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:40.633008 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:40.633036 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:40.633054 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:40.633079 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:40.633098 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:40.658804 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:40.661422 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.661482 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:40.661516 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:41.342018 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:41.482131 18255 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0808 12:48:41.484448 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:41.484478 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:41.484559 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:41.486233 18255 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0808 12:48:41.488858 18255 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0808 12:48:41.489769 18255 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0808 12:48:41.489862 18255 api.go:53] PageSize not implemented W0808 12:48:41.489890 18255 api.go:53] PageSize not implemented W0808 12:48:41.489967 18255 api.go:53] PageSize not implemented I0808 12:48:41.493994 18255 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0808 12:48:41.494163 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:41.494355 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:41.494547 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:41.494791 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:41.494868 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:41.494939 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:41.495058 18255 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0808 12:48:41.495318 18255 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0808 12:48:41.495577 18255 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0808 12:48:41.507128 18255 target.go:111] Terraform output is in /tmp/test3122305099/out --- PASS: TestBastionAdditionalUserData (0.88s) === RUN TestPrivateFlannel I0808 12:48:41.512024 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:41.512206 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:41.512241 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:41.512280 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:41.512310 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:41.512348 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:41.512381 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:41.512401 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:41.512428 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:41.512449 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:41.533637 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:48:41.536296 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:41.536358 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:41.536395 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:42.212961 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:42.360630 18255 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0808 12:48:42.364140 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:42.364199 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:42.364408 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:42.368051 18255 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0808 12:48:42.370554 18255 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0808 12:48:42.370967 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:42.371119 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:42.371197 18255 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0808 12:48:42.371342 18255 api.go:53] PageSize not implemented W0808 12:48:42.371403 18255 api.go:53] PageSize not implemented I0808 12:48:42.375480 18255 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0808 12:48:42.375697 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:42.375869 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:42.376046 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:42.376430 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:42.376523 18255 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0808 12:48:42.376735 18255 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0808 12:48:42.376907 18255 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0808 12:48:42.383202 18255 target.go:111] Terraform output is in /tmp/test1298795595/out --- PASS: TestPrivateFlannel (0.88s) === RUN TestPrivateCalico I0808 12:48:42.387827 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:42.387993 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:42.388023 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:42.388057 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:42.388085 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:42.388120 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:42.388147 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:42.388165 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:42.388192 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:42.388211 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:42.409766 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:48:42.412450 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:42.412503 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:42.412538 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:43.113679 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:43.431557 18255 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0808 12:48:43.432528 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:43.432564 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:43.432678 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:43.434200 18255 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0808 12:48:43.436912 18255 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0808 12:48:43.437222 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:43.437351 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:43.437486 18255 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0808 12:48:43.437577 18255 api.go:53] PageSize not implemented W0808 12:48:43.437681 18255 api.go:53] PageSize not implemented I0808 12:48:43.441746 18255 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0808 12:48:43.441964 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:43.442152 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:43.442494 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:43.442694 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:43.442780 18255 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0808 12:48:43.443013 18255 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0808 12:48:43.443267 18255 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0808 12:48:43.450009 18255 target.go:111] Terraform output is in /tmp/test3950743211/out --- PASS: TestPrivateCalico (1.07s) === RUN TestPrivateCilium I0808 12:48:43.458505 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:43.458707 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:43.458739 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:43.458786 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:43.458816 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:43.458848 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:43.458877 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:43.458896 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:43.458920 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:43.458940 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:43.481164 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:43.484003 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:43.484061 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:43.484097 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:44.161213 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:44.324642 18255 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0808 12:48:44.330227 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:44.330259 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:44.330362 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:44.331988 18255 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0808 12:48:44.334535 18255 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0808 12:48:44.334852 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:44.335012 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:44.335306 18255 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0808 12:48:44.335418 18255 api.go:53] PageSize not implemented W0808 12:48:44.335537 18255 api.go:53] PageSize not implemented I0808 12:48:44.339762 18255 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0808 12:48:44.339946 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:44.340039 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:44.340427 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:44.340503 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:44.340594 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:48:44.340808 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:48:44.341011 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:48:44.347546 18255 target.go:111] Terraform output is in /tmp/test311154318/out --- PASS: TestPrivateCilium (0.89s) === RUN TestPrivateCilium2 I0808 12:48:44.352242 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:44.352410 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:44.352443 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:44.352481 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:44.352510 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:44.352545 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:44.352611 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:44.352631 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:44.352658 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:44.352678 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:44.377538 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:48:44.380471 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:44.380540 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:44.380577 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:45.060218 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:45.570808 18255 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0808 12:48:45.571069 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:45.571109 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:45.571225 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:45.578340 18255 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0808 12:48:45.580738 18255 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0808 12:48:45.581183 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:45.581321 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:45.581396 18255 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0808 12:48:45.581451 18255 api.go:53] PageSize not implemented W0808 12:48:45.581477 18255 api.go:53] PageSize not implemented I0808 12:48:45.585770 18255 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0808 12:48:45.585911 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:45.586096 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:45.586428 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:45.586491 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:45.586553 18255 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0808 12:48:45.586753 18255 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0808 12:48:45.586965 18255 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0808 12:48:45.594427 18255 target.go:111] Terraform output is in /tmp/test2595352308/out --- PASS: TestPrivateCilium2 (1.25s) === RUN TestPrivateCiliumAdvanced I0808 12:48:45.602281 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:45.602398 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:45.602421 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:45.602447 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:45.602464 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:45.602488 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:45.602509 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:45.602521 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:45.602537 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:45.602593 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:45.617682 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:45.619466 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:45.619505 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:45.619529 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:46.296057 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:46.479979 18255 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0808 12:48:46.480378 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:46.480396 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:46.480455 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:46.487596 18255 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0808 12:48:46.490586 18255 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0808 12:48:46.490969 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:46.491088 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:46.491163 18255 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0808 12:48:46.491269 18255 api.go:53] PageSize not implemented W0808 12:48:46.491372 18255 api.go:53] PageSize not implemented I0808 12:48:46.496195 18255 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0808 12:48:46.496313 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:46.496501 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:46.496692 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:46.496841 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:46.496928 18255 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0808 12:48:46.497109 18255 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0808 12:48:46.497314 18255 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0808 12:48:46.504077 18255 target.go:111] Terraform output is in /tmp/test3918863082/out --- PASS: TestPrivateCiliumAdvanced (0.91s) === RUN TestPrivateCiliumENI I0808 12:48:46.509166 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:46.509352 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:46.509388 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:46.509424 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:46.509452 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:46.509488 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:46.509519 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:46.509539 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:46.509567 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:46.509588 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:46.525135 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:46.526942 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:46.526981 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:46.527006 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:47.204007 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:47.385740 18255 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0808 12:48:47.386492 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:47.386539 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:47.386657 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:47.389237 18255 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0808 12:48:47.392281 18255 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0808 12:48:47.392714 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:47.392853 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:47.392930 18255 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0808 12:48:47.393007 18255 api.go:53] PageSize not implemented W0808 12:48:47.393123 18255 api.go:53] PageSize not implemented I0808 12:48:47.397174 18255 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0808 12:48:47.397309 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:47.397446 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:47.398684 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:47.399332 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:47.399581 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:48:47.400400 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:48:47.401419 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:48:47.410475 18255 target.go:111] Terraform output is in /tmp/test1299596617/out --- PASS: TestPrivateCiliumENI (0.91s) === RUN TestPrivateCanal I0808 12:48:47.415471 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:47.415667 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:47.415704 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:47.415741 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:47.415774 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:47.415813 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:47.415847 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:47.415867 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:47.415918 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:47.415942 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:47.437214 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:48:47.439993 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:47.440057 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:47.440096 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:48.153542 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:48.481336 18255 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0808 12:48:48.482239 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:48.482266 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:48.482335 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:48.485422 18255 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0808 12:48:48.487766 18255 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0808 12:48:48.488046 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:48.488158 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:48.488602 18255 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0808 12:48:48.488679 18255 api.go:53] PageSize not implemented W0808 12:48:48.488783 18255 api.go:53] PageSize not implemented I0808 12:48:48.492729 18255 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0808 12:48:48.492945 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:48.493154 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:48.493544 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:48.493614 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:48.493684 18255 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0808 12:48:48.493899 18255 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0808 12:48:48.494091 18255 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0808 12:48:48.501044 18255 target.go:111] Terraform output is in /tmp/test3359011188/out --- PASS: TestPrivateCanal (1.09s) === RUN TestPrivateKopeio I0808 12:48:48.506527 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:48.506723 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:48.506755 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:48.506790 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:48.506818 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:48.506856 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:48.506889 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:48.506910 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:48.506937 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:48.506958 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:48.532612 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:48.535065 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:48.535126 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:48.535162 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:49.211233 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:49.338251 18255 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0808 12:48:49.338575 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:49.338615 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:49.338712 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:49.341091 18255 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0808 12:48:49.343552 18255 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0808 12:48:49.343966 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:49.344084 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:49.344204 18255 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0808 12:48:49.344278 18255 api.go:53] PageSize not implemented W0808 12:48:49.344305 18255 api.go:53] PageSize not implemented I0808 12:48:49.350309 18255 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0808 12:48:49.350679 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:49.350990 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:49.351796 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:49.351981 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:49.352187 18255 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0808 12:48:49.353166 18255 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0808 12:48:49.354450 18255 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0808 12:48:49.361150 18255 target.go:111] Terraform output is in /tmp/test4238975976/out --- PASS: TestPrivateKopeio (0.86s) === RUN TestUnmanaged I0808 12:48:49.365764 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:49.365936 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:49.366025 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:49.366070 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:49.366103 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:49.366139 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:49.366170 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:49.366189 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:49.366216 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:49.366238 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:49.388252 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:49.390984 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:49.391041 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:49.391080 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.066654 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:50.201545 18255 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0808 12:48:50.204528 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:50.204582 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:50.204724 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:50.208459 18255 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0808 12:48:50.210959 18255 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0808 12:48:50.211269 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.211408 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.211487 18255 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0808 12:48:50.211555 18255 api.go:53] PageSize not implemented W0808 12:48:50.211656 18255 api.go:53] PageSize not implemented I0808 12:48:50.215659 18255 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0808 12:48:50.215816 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.215904 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.216066 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.216406 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.216493 18255 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0808 12:48:50.216703 18255 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0808 12:48:50.216918 18255 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0808 12:48:50.222987 18255 target.go:111] Terraform output is in /tmp/test269852329/out --- PASS: TestUnmanaged (0.86s) === RUN TestPrivateSharedSubnet I0808 12:48:50.227534 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:50.227727 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:50.227760 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:50.227795 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:50.227829 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:50.227864 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:50.227898 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:50.227920 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:50.227947 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:50.227972 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:50.249287 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:50.251995 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.252063 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.252101 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:50.929598 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:51.075666 18255 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0808 12:48:51.075976 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:51.076010 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:51.076115 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:51.080995 18255 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0808 12:48:51.082110 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:48:51.083547 18255 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0808 12:48:51.084002 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.084140 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.084219 18255 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0808 12:48:51.084271 18255 api.go:53] PageSize not implemented W0808 12:48:51.084370 18255 api.go:53] PageSize not implemented I0808 12:48:51.088597 18255 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0808 12:48:51.088755 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.088860 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.089210 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.089309 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.089389 18255 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0808 12:48:51.089561 18255 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0808 12:48:51.089782 18255 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0808 12:48:51.096112 18255 target.go:111] Terraform output is in /tmp/test2575326128/out --- PASS: TestPrivateSharedSubnet (0.87s) === RUN TestPrivateSharedIP I0808 12:48:51.100619 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:51.100798 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:51.100832 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:51.100868 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:51.100895 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:51.100929 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:51.100958 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:51.100977 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:51.101002 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:51.101020 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:51.121184 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:51.123513 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.123566 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.123599 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.796237 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:51.939544 18255 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0808 12:48:51.940064 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:51.940095 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:51.940167 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:51.941789 18255 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0808 12:48:51.942008 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:48:51.944343 18255 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0808 12:48:51.944670 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.944789 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.944915 18255 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0808 12:48:51.944990 18255 api.go:53] PageSize not implemented W0808 12:48:51.945094 18255 api.go:53] PageSize not implemented I0808 12:48:51.949237 18255 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0808 12:48:51.949390 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.949546 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.950987 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.951139 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.951463 18255 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0808 12:48:51.952309 18255 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0808 12:48:51.953765 18255 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0808 12:48:51.960538 18255 target.go:111] Terraform output is in /tmp/test1275821813/out --- PASS: TestPrivateSharedIP (0.86s) === RUN TestPrivateDns1 I0808 12:48:51.965179 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:51.965358 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:51.965390 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:51.965427 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:51.965457 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:51.965493 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:51.965522 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:51.965541 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:51.965567 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:51.965587 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0808 12:48:51.989181 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.989240 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:51.989277 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:52.847694 18255 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0808 12:48:52.852118 18255 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0808 12:48:52.852888 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0808 12:48:52.852956 18255 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0808 12:48:52.853114 18255 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0808 12:48:52.853191 18255 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0808 12:48:52.855330 18255 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0808 12:48:52.856171 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:52.856317 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:52.857895 18255 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0808 12:48:52.858001 18255 api.go:53] PageSize not implemented W0808 12:48:52.858102 18255 api.go:53] PageSize not implemented I0808 12:48:52.862322 18255 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0808 12:48:52.862539 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:52.862724 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:52.862872 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:52.863247 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:52.863334 18255 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0808 12:48:52.863552 18255 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0808 12:48:52.863766 18255 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0808 12:48:52.870263 18255 target.go:111] Terraform output is in /tmp/test19950028/out --- PASS: TestPrivateDns1 (0.91s) === RUN TestPrivateDns2 I0808 12:48:52.874642 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:52.874816 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:52.874849 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:52.874884 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:52.874912 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:52.874948 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:52.874995 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:52.875017 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:52.875042 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:52.875061 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:52.897753 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:52.897804 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:52.897835 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:53.809804 18255 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0808 12:48:53.812243 18255 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0808 12:48:53.812585 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0808 12:48:53.812526 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:48:53.812619 18255 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0808 12:48:53.812713 18255 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0808 12:48:53.812731 18255 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0808 12:48:53.812786 18255 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0808 12:48:53.813179 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:53.813306 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:53.815405 18255 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0808 12:48:53.815499 18255 api.go:53] PageSize not implemented W0808 12:48:53.815573 18255 api.go:53] PageSize not implemented I0808 12:48:53.822007 18255 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0808 12:48:53.822954 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:53.823156 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:53.823529 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:53.823603 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:53.823675 18255 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0808 12:48:53.823871 18255 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0808 12:48:53.824107 18255 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0808 12:48:53.830929 18255 target.go:111] Terraform output is in /tmp/test526253950/out --- PASS: TestPrivateDns2 (0.96s) === RUN TestDiscoveryFeatureGate I0808 12:48:53.835553 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:53.835734 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:53.835765 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:53.835800 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:53.835828 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:53.835872 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:53.835936 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:53.835957 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:53.835985 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:53.836007 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:53.855104 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:48:53.857704 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:53.857766 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:54.540638 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:54.686667 18255 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0808 12:48:54.686909 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:54.686932 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:54.687001 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:54.689647 18255 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0808 12:48:54.694383 18255 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0808 12:48:54.694721 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:54.694885 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:54.695109 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:54.695226 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:54.695314 18255 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0808 12:48:54.695486 18255 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0808 12:48:54.695724 18255 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0808 12:48:54.701935 18255 target.go:111] Terraform output is in /tmp/test174873789/out --- PASS: TestDiscoveryFeatureGate (0.87s) === RUN TestVFSServiceAccountIssuerDiscovery I0808 12:48:54.707397 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:54.707575 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:54.707610 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:54.707650 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:54.707677 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:54.707714 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:54.707742 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:54.707762 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:54.707788 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:54.707807 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:54.729987 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:54.732498 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:54.732569 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:55.410067 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:55.547314 18255 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0808 12:48:55.548114 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:55.548149 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:55.548265 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:55.550155 18255 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0808 12:48:55.554357 18255 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0808 12:48:55.554625 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:55.555045 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:55.555367 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:55.555439 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:55.555753 18255 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0808 12:48:55.555951 18255 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0808 12:48:55.556222 18255 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0808 12:48:55.561551 18255 target.go:111] Terraform output is in /tmp/test3108867693/out --- PASS: TestVFSServiceAccountIssuerDiscovery (0.86s) === RUN TestAWSLBController I0808 12:48:55.566131 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:55.566309 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:55.566355 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:55.566392 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:55.566422 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:55.566458 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:55.566492 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:55.566512 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:55.566541 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:55.566561 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:55.589752 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:55.592282 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:55.592345 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:56.331398 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:56.913611 18255 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0808 12:48:56.915204 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:56.915237 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:56.915311 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:56.921023 18255 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0808 12:48:56.925460 18255 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0808 12:48:56.925779 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:56.925951 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:56.926129 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:56.926532 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:56.926624 18255 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0808 12:48:56.926869 18255 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0808 12:48:56.927113 18255 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0808 12:48:56.934725 18255 target.go:111] Terraform output is in /tmp/test1729306800/out --- PASS: TestAWSLBController (1.38s) === RUN TestManyAddons I0808 12:48:56.943664 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:56.943862 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:56.943918 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:56.943958 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:56.943988 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:56.944027 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:56.944061 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:56.944082 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:56.944109 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:56.944130 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:56.964692 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:56.967506 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:56.967566 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:57.642647 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:58.257563 18255 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0808 12:48:58.258054 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:58.258094 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:58.258191 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:58.260594 18255 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0808 12:48:58.264944 18255 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0808 12:48:58.265271 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:58.265464 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:58.265614 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:58.266072 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:58.266171 18255 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0808 12:48:58.266418 18255 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0808 12:48:58.267059 18255 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0808 12:48:58.273493 18255 target.go:111] Terraform output is in /tmp/test3585435507/out --- PASS: TestManyAddons (1.34s) === RUN TestManyAddonsCCMIRSA I0808 12:48:58.286501 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:58.286719 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:58.286755 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:58.286799 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:58.286832 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:58.286871 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:58.286906 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:58.286927 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:58.286957 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:58.286979 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:58.309463 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:48:58.312520 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:58.312584 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:58.994466 18255 zones.go:93] ListHostedZonesPages { } I0808 12:48:59.678187 18255 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0808 12:48:59.678512 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:48:59.678551 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:48:59.678666 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:48:59.682059 18255 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0808 12:48:59.686810 18255 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0808 12:48:59.687180 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:59.687376 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:59.687733 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:59.687813 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:59.687871 18255 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0808 12:48:59.688077 18255 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0808 12:48:59.688338 18255 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0808 12:48:59.697135 18255 target.go:111] Terraform output is in /tmp/test3135782513/out --- PASS: TestManyAddonsCCMIRSA (1.43s) === RUN TestManyAddonsCCMIRSA23 I0808 12:48:59.712796 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:59.713142 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:59.713217 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:59.713293 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:59.713357 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:59.713420 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:59.713454 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:59.713473 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:59.713504 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:59.713527 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:59.735512 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0808 12:48:59.738553 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:48:59.738623 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:00.434625 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:01.099688 18255 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0808 12:49:01.101568 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:01.101603 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:01.101719 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:01.104049 18255 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0808 12:49:01.109713 18255 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0808 12:49:01.110074 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:01.110306 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:01.110495 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:01.110921 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:01.111010 18255 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0808 12:49:01.111270 18255 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0808 12:49:01.111505 18255 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0808 12:49:01.122586 18255 target.go:111] Terraform output is in /tmp/test2024453743/out --- PASS: TestManyAddonsCCMIRSA23 (1.42s) === RUN TestManyAddonsCCMIRSA24 I0808 12:49:01.131075 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:01.131224 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:01.131254 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:01.131288 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:01.131314 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:01.131344 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:01.131373 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:01.131389 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:01.131413 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:01.131431 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:01.148055 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:01.150221 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:01.150274 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:01.840232 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:02.476006 18255 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0808 12:49:02.477291 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:02.477317 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:02.477399 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:02.480162 18255 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0808 12:49:02.484413 18255 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0808 12:49:02.484670 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:02.484779 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:02.485143 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:02.485238 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:02.485315 18255 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0808 12:49:02.485514 18255 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0808 12:49:02.485735 18255 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0808 12:49:02.495259 18255 target.go:111] Terraform output is in /tmp/test700604598/out --- PASS: TestManyAddonsCCMIRSA24 (1.38s) === RUN TestManyAddonsCCMIRSA25 I0808 12:49:02.510050 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:02.510416 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:02.510480 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:02.510556 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:02.510610 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:02.510666 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:02.510698 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:02.510720 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:02.510747 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:02.510769 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:02.532028 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0808 12:49:02.534921 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:02.535032 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:03.225461 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:03.846354 18255 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0808 12:49:03.847963 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:03.848014 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:03.848135 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:03.850160 18255 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0808 12:49:03.859002 18255 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0808 12:49:03.859391 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:03.859630 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:03.859790 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:03.860189 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:03.860276 18255 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0808 12:49:03.860533 18255 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0808 12:49:03.861036 18255 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0808 12:49:03.869230 18255 target.go:111] Terraform output is in /tmp/test2071971475/out --- PASS: TestManyAddonsCCMIRSA25 (1.37s) === RUN TestManyAddonsCCMIRSA26 I0808 12:49:03.879937 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:03.880117 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:03.880152 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:03.880197 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:03.880226 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:03.880260 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:03.880292 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:03.880310 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:03.880340 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:03.880362 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:03.902315 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0808 12:49:03.904994 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:03.905059 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:04.587109 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:05.292852 18255 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0808 12:49:05.293894 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:05.293926 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:05.294020 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:05.297446 18255 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0808 12:49:05.306653 18255 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0808 12:49:05.307053 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:05.307244 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:05.307613 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:05.307685 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:05.307740 18255 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0808 12:49:05.307960 18255 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0808 12:49:05.308201 18255 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0808 12:49:05.317376 18255 target.go:111] Terraform output is in /tmp/test3442954191/out --- PASS: TestManyAddonsCCMIRSA26 (1.45s) === RUN TestManyAddonsGCE I0808 12:49:05.326343 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:49:06.852379 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:49:06.852443 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:49:06.852507 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0808 12:49:06.852524 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0808 12:49:06.852537 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0808 12:49:06.852581 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0808 12:49:06.853315 18255 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0808 12:49:06.856481 18255 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0808 12:49:06.860968 18255 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0808 12:49:06.863613 18255 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0808 12:49:06.863886 18255 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0808 12:49:06.870358 18255 target.go:111] Terraform output is in /tmp/test830259324/out --- PASS: TestManyAddonsGCE (1.55s) === RUN TestCCM I0808 12:49:06.877647 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:06.877828 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:06.877863 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:06.877904 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:06.877934 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:06.877970 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:06.878001 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:06.878021 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:06.878048 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:06.878067 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:06.898778 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:06.901500 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:06.901562 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:07.575029 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:08.200181 18255 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0808 12:49:08.200821 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:08.200847 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:08.200903 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:08.203361 18255 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0808 12:49:08.208420 18255 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0808 12:49:08.208822 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:08.209029 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:08.209188 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:08.209599 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:08.209691 18255 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0808 12:49:08.209941 18255 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0808 12:49:08.210183 18255 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0808 12:49:08.217303 18255 target.go:111] Terraform output is in /tmp/test2029469180/out --- PASS: TestCCM (1.35s) === RUN TestExternalDNS I0808 12:49:08.226827 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:08.227127 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:08.227419 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:08.227500 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:08.227533 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:08.227583 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:08.227623 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:08.227644 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:08.227673 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:08.227695 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:08.248201 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:08.250642 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:08.250704 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:08.924739 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:09.064426 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:49:09.064694 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:09.064731 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:09.064837 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:09.067367 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:49:09.071707 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:49:09.072097 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.072284 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.072620 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.072682 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.072760 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:49:09.072977 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:49:09.073190 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:49:09.078526 18255 target.go:111] Terraform output is in /tmp/test2943656290/out --- PASS: TestExternalDNS (0.86s) === RUN TestExternalDNSIRSA I0808 12:49:09.082827 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:09.083003 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:09.083035 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:09.083079 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:09.083112 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:09.083148 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:09.083178 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:09.083199 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:09.083226 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:09.083246 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:09.101768 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:09.103260 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.103300 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.780748 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:09.946552 18255 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0808 12:49:09.950263 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:09.950369 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:09.950505 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:09.954280 18255 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0808 12:49:09.959106 18255 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0808 12:49:09.959303 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.959658 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.959866 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.960379 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:09.960474 18255 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0808 12:49:09.960712 18255 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0808 12:49:09.960999 18255 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0808 12:49:09.967561 18255 target.go:111] Terraform output is in /tmp/test309920625/out --- PASS: TestExternalDNSIRSA (0.89s) === RUN TestKarpenter I0808 12:49:09.973385 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:09.973586 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:09.973623 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:09.973663 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:09.973693 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:09.973731 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:09.973766 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:09.973787 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:09.973815 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:09.973839 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:09.998919 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:49:10.001741 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.001800 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.001835 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.680221 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:10.841785 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.841873 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.841932 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0808 12:49:10.959686 18255 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0808 12:49:10.959758 18255 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0808 12:49:10.959787 18255 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0808 12:49:10.959802 18255 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0808 12:49:10.959817 18255 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0808 12:49:10.976045 18255 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0808 12:49:10.976862 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:10.976896 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:10.977003 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:10.983644 18255 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0808 12:49:10.989477 18255 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0808 12:49:10.989785 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.989986 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.990221 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.990398 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.990689 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.990779 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.990842 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.990900 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:10.990966 18255 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0808 12:49:10.991181 18255 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0808 12:49:10.991365 18255 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0808 12:49:10.998884 18255 target.go:111] Terraform output is in /tmp/test3955892103/out --- PASS: TestKarpenter (1.03s) === RUN TestSharedSubnet I0808 12:49:11.005420 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:11.005597 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:11.005628 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:11.005662 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:11.005689 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:11.005725 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:11.005758 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:11.005778 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:11.005805 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:11.005825 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:11.024859 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:11.027398 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:11.027458 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:11.705654 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:11.850507 18255 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0808 12:49:11.851335 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:11.851368 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:11.851451 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:11.853138 18255 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0808 12:49:11.853384 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:11.857500 18255 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0808 12:49:11.857738 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:11.857979 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:11.858132 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:11.860319 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:11.860531 18255 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0808 12:49:11.861209 18255 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0808 12:49:11.862076 18255 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0808 12:49:11.869268 18255 target.go:111] Terraform output is in /tmp/test213551675/out --- PASS: TestSharedSubnet (0.87s) === RUN TestSharedVPC I0808 12:49:11.873566 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:11.873746 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:11.873780 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:11.873818 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:11.873847 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:11.873885 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:11.873915 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:11.873934 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:11.873962 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:11.873981 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:11.892576 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:11.895094 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:11.895156 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:12.570804 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:12.695843 18255 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0808 12:49:12.697025 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:12.697051 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:12.697120 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:12.702224 18255 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0808 12:49:12.702787 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:12.707511 18255 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0808 12:49:12.707687 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:12.708014 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:12.708234 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:12.708595 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:12.708692 18255 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0808 12:49:12.708941 18255 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0808 12:49:12.709183 18255 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0808 12:49:12.714636 18255 target.go:111] Terraform output is in /tmp/test4200648166/out --- PASS: TestSharedVPC (0.85s) === RUN TestSharedVPCIPv6 I0808 12:49:12.719269 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:12.719466 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:12.719505 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:12.719546 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:12.719578 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:12.719616 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:12.719651 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:12.719673 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:12.719703 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:12.719727 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:12.721444 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:49:12.721493 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:12.743303 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:49:12.743351 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:12.743432 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:49:12.746896 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:12.746967 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:13.435523 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:13.579667 18255 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0808 12:49:13.580119 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:13.580151 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:13.580264 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:13.582846 18255 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0808 12:49:13.583259 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:13.583378 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:13.585840 18255 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0808 12:49:13.586481 18255 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0808 12:49:13.586549 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:13.586613 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:13.586718 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:13.586772 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:13.590741 18255 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0808 12:49:13.590896 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:13.591127 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:13.591319 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:13.591793 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:13.591900 18255 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0808 12:49:13.592191 18255 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0808 12:49:13.592446 18255 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0808 12:49:13.598464 18255 target.go:111] Terraform output is in /tmp/test1971007015/out --- PASS: TestSharedVPCIPv6 (0.88s) === RUN TestExistingIAM I0808 12:49:13.602883 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:13.603082 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:13.603113 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:13.603156 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:13.603184 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:13.603220 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:13.603250 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:13.603270 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:13.603298 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:13.603320 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:13.631372 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:13.635561 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:13.635626 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:13.635665 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:13.635699 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.322380 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:14.452702 18255 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0808 12:49:14.453219 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:14.453250 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:14.453326 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:14.456927 18255 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0808 12:49:14.465033 18255 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0808 12:49:14.465223 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.465346 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.465507 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.465617 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.465769 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.465846 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.465891 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.466182 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.466290 18255 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0808 12:49:14.466600 18255 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0808 12:49:14.466886 18255 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0808 12:49:14.473963 18255 target.go:111] Terraform output is in /tmp/test2520126338/out --- PASS: TestExistingIAM (0.88s) === RUN TestPhaseNetwork I0808 12:49:14.479242 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:14.479437 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:14.479475 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:14.479516 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:14.479545 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:14.479582 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:14.479619 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:14.479640 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:14.479668 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:14.479692 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:14.500762 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:14.503409 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.503553 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:14.503598 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:15.181469 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:15.329643 18255 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0808 12:49:15.330335 18255 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0808 12:49:15.330728 18255 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0808 12:49:15.331087 18255 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0808 12:49:15.331233 18255 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0808 12:49:15.331392 18255 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0808 12:49:15.331457 18255 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0808 12:49:15.331527 18255 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0808 12:49:15.332506 18255 target.go:111] Terraform output is in /tmp/test3625525180/out --- PASS: TestPhaseNetwork (0.85s) === RUN TestExternalLoadBalancer I0808 12:49:15.333066 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:15.333256 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:15.333290 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:15.333326 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:15.333356 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:15.333391 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:15.333426 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:15.333446 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:15.333472 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:15.333490 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:15.356999 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:15.359486 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:15.359560 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.036022 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:16.174953 18255 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0808 12:49:16.175259 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:16.175280 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:16.175346 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:16.178977 18255 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0808 12:49:16.187548 18255 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0808 12:49:16.187851 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.188034 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.188294 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.188602 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.188689 18255 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0808 12:49:16.188881 18255 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0808 12:49:16.189091 18255 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0808 12:49:16.195138 18255 target.go:111] Terraform output is in /tmp/test78506643/out --- PASS: TestExternalLoadBalancer (0.87s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0808 12:49:16.199857 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:16.200054 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:16.200090 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:16.200131 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:16.200161 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:16.200198 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:16.200228 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:16.200248 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:16.200275 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:16.200297 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:16.225352 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:16.228264 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.228451 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.228500 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.228537 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.228570 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.228601 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.228638 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:16.906121 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:17.054609 18255 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0808 12:49:17.055432 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:17.055465 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:17.055554 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:17.057554 18255 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0808 12:49:17.062350 18255 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0808 12:49:17.062541 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.062742 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.062920 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.062992 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.063135 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.063334 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.063425 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.063702 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.063796 18255 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0808 12:49:17.064169 18255 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0808 12:49:17.064464 18255 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0808 12:49:17.072403 18255 target.go:111] Terraform output is in /tmp/test1951325857/out --- PASS: TestMixedInstancesASG (0.88s) === RUN TestMixedInstancesSpotASG I0808 12:49:17.077683 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:17.077860 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:17.077893 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:17.077930 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:17.077957 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:17.077995 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:17.078027 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:17.078048 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:17.078076 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:17.078095 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:17.106669 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:17.109697 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.109769 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.109807 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.109843 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.109879 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.109917 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.109970 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:17.855273 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:18.004868 18255 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0808 12:49:18.005766 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:18.005798 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:18.005887 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:18.008439 18255 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0808 12:49:18.018820 18255 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0808 12:49:18.019100 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.019351 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.019562 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.019735 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.019870 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.019950 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.020128 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.020177 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.020287 18255 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0808 12:49:18.020643 18255 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0808 12:49:18.020906 18255 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0808 12:49:18.028182 18255 target.go:111] Terraform output is in /tmp/test2813961202/out --- PASS: TestMixedInstancesSpotASG (0.96s) === RUN TestAdditionalObjects I0808 12:49:18.033645 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:18.033830 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:18.033863 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:18.033898 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:18.033927 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:18.033964 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:18.033996 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:18.034017 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:18.034044 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:18.034066 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:18.054683 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0808 12:49:18.057340 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.057416 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.736946 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:18.881685 18255 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0808 12:49:18.883343 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:18.883371 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:18.883448 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:18.885638 18255 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0808 12:49:18.893908 18255 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0808 12:49:18.894524 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.894712 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.895079 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.895532 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.895628 18255 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0808 12:49:18.895903 18255 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0808 12:49:18.896142 18255 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0808 12:49:18.901940 18255 target.go:111] Terraform output is in /tmp/test3898662801/out --- PASS: TestAdditionalObjects (0.87s) === RUN TestContainerd I0808 12:49:18.906817 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:18.907013 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:18.907051 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:18.907092 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:18.907126 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:18.907166 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:18.907200 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:18.907222 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:18.907251 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:18.907273 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:18.926332 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:18.928999 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:18.929065 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:19.601463 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:19.741786 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:49:19.742985 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:19.743014 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:19.743109 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:19.745777 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:49:19.750289 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:49:19.750690 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:19.750885 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:19.751258 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:19.751339 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:19.751397 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:49:19.751628 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:49:19.751936 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:49:19.757868 18255 target.go:111] Terraform output is in /tmp/test1326320140/out --- PASS: TestContainerd (0.86s) === RUN TestContainerdCustom I0808 12:49:19.762499 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:19.762692 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:19.762728 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:19.762771 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:19.762801 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:19.762842 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:19.762876 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:19.762897 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:19.762925 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:19.762946 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:19.783524 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:19.786204 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:19.786272 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:20.356872 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:20.494650 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:49:20.496762 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:20.496794 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:20.496910 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:20.502483 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:49:20.507213 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:49:20.507505 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:20.507696 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:20.507886 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:20.508369 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:20.508455 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:49:20.508719 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:49:20.508894 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:49:20.514010 18255 target.go:111] Terraform output is in /tmp/test1388878449/out --- PASS: TestContainerdCustom (0.76s) === RUN TestDockerCustom I0808 12:49:20.518778 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:20.518955 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:20.518986 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:20.519020 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:20.519047 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:20.519089 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:20.519120 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:20.519141 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:20.519167 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:20.519187 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:20.538844 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0808 12:49:20.541506 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:20.541566 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:21.108425 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:21.249677 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:49:21.250884 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:21.250951 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:21.251115 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:21.253028 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:49:21.257545 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:49:21.257711 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:21.257875 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:21.258217 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:21.258287 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:21.258370 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:49:21.258579 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:49:21.258861 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:49:21.264126 18255 target.go:111] Terraform output is in /tmp/test2243620216/out --- PASS: TestDockerCustom (0.75s) === RUN TestAPIServerNodes I0808 12:49:21.269025 18255 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0808 12:49:21.269046 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:21.269234 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:21.269272 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:21.269311 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:21.269341 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:21.269379 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:21.269410 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:21.269430 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:21.269459 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:21.269482 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:21.289498 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0808 12:49:21.292106 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:21.292171 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:21.292212 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:22.018641 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:22.167203 18255 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0808 12:49:22.168955 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:22.168999 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:22.169124 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:22.170805 18255 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0808 12:49:22.180525 18255 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0808 12:49:22.180782 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:22.181094 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:22.181228 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:22.181431 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:22.181552 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:22.181950 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:22.182391 18255 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0808 12:49:22.182644 18255 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0808 12:49:22.182873 18255 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0808 12:49:22.189234 18255 target.go:111] Terraform output is in /tmp/test2996947974/out I0808 12:49:22.194180 18255 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (0.93s) === RUN TestNTHIMDSProcessor I0808 12:49:22.194281 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:22.194475 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:22.194509 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:22.194551 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:22.194581 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:22.194619 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:22.194651 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:22.194672 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:22.194699 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:22.194722 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:22.214010 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:22.216701 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:22.216763 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:22.900470 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:23.033993 18255 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0808 12:49:23.034527 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:23.034571 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:23.034686 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:23.037100 18255 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0808 12:49:23.045564 18255 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0808 12:49:23.046110 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.046739 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.047101 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.047463 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.047549 18255 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0808 12:49:23.047759 18255 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0808 12:49:23.047952 18255 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0808 12:49:23.053236 18255 target.go:111] Terraform output is in /tmp/test1204925106/out --- PASS: TestNTHIMDSProcessor (0.86s) === RUN TestNTHIMDSProcessorIRSA I0808 12:49:23.057281 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:23.057466 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:23.057500 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:23.057540 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:23.057569 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:23.057608 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:23.057639 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:23.057660 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:23.057687 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:23.057710 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:23.077531 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:23.080156 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.080223 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.764122 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:23.928584 18255 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0808 12:49:23.929599 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:23.929621 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:23.929691 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:23.931843 18255 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0808 12:49:23.936311 18255 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0808 12:49:23.936727 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.936922 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.937086 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.937518 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.937617 18255 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0808 12:49:23.937865 18255 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0808 12:49:23.938041 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:49:23.943829 18255 target.go:111] Terraform output is in /tmp/test3105248651/out --- PASS: TestNTHIMDSProcessorIRSA (0.89s) === RUN TestCustomIRSA I0808 12:49:23.948755 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:23.948928 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:23.948960 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:23.948994 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:23.949026 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:23.949064 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:23.949098 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:23.949120 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:23.949147 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:23.949167 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:23.970808 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:23.976972 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:23.977035 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:24.656441 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:25.171191 18255 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0808 12:49:25.173021 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:25.173038 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:25.173083 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:25.175059 18255 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0808 12:49:25.179417 18255 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0808 12:49:25.179600 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:25.179846 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:25.179962 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:25.180422 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:25.180522 18255 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0808 12:49:25.180738 18255 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0808 12:49:25.180978 18255 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0808 12:49:25.187776 18255 target.go:111] Terraform output is in /tmp/test2798110097/out --- PASS: TestCustomIRSA (1.25s) === RUN TestClusterNameDigit I0808 12:49:25.196874 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:25.197008 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:25.197033 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:25.197060 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:25.197080 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:25.197105 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:25.197127 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:25.197139 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:25.197158 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:25.197171 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:25.210717 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:25.212428 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:25.212471 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:25.885515 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:25.994699 18255 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0808 12:49:25.995044 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:25.995087 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:25.995169 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:26.000275 18255 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0808 12:49:26.005977 18255 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0808 12:49:26.006329 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:26.006522 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:26.007132 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:26.007261 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:26.007411 18255 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0808 12:49:26.007775 18255 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0808 12:49:26.008008 18255 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0808 12:49:26.014253 18255 target.go:111] Terraform output is in /tmp/test1509085537/out --- PASS: TestClusterNameDigit (0.82s) === RUN TestCASPriorityExpander I0808 12:49:26.019797 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:26.019988 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:26.020024 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:26.020063 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:26.020093 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:26.020130 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:26.020164 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:26.020187 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:26.020218 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:26.020239 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:26.043653 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0808 12:49:26.046448 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:26.046512 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:26.046548 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:26.046581 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0808 12:49:27.647916 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:27.804092 18255 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0808 12:49:27.804400 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:27.804432 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:27.804521 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:27.806533 18255 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0808 12:49:27.810799 18255 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0808 12:49:27.810991 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.811145 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.811352 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.811484 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.811651 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.811730 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.811778 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.811826 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.811865 18255 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0808 12:49:27.812096 18255 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0808 12:49:27.812402 18255 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0808 12:49:27.818407 18255 target.go:111] Terraform output is in /tmp/test2219035022/out --- PASS: TestCASPriorityExpander (1.80s) === RUN TestCASPriorityExpanderCustom I0808 12:49:27.823328 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:27.823503 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:27.823535 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:27.823569 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:27.823596 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:27.823632 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:27.823661 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:27.823682 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:27.823709 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:27.823729 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:49:27.851825 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0808 12:49:27.854640 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.854707 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.854744 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:27.854776 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0808 12:49:28.536119 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:28.694941 18255 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0808 12:49:28.695263 18255 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0808 12:49:28.695300 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:28.695378 18255 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0808 12:49:28.697835 18255 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0808 12:49:28.702218 18255 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0808 12:49:28.702407 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:28.702527 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:28.702754 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:28.702951 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:28.703124 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:28.703195 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:28.703354 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:28.703470 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:28.703555 18255 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0808 12:49:28.703842 18255 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0808 12:49:28.704149 18255 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0808 12:49:28.710840 18255 target.go:111] Terraform output is in /tmp/test1655222910/out --- PASS: TestCASPriorityExpanderCustom (0.89s) === RUN TestLifecycleMinimalAWS I0808 12:49:28.716158 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:28.716354 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:28.716389 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:28.716428 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:28.716459 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:28.716500 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:28.716536 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:28.716557 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:28.716586 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:28.716608 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0808 12:49:28.735105 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0808 12:49:28.737592 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:28.737746 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0808 12:49:29.464178 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:29.606772 18255 iamrole.go:89] ListRoles: { } I0808 12:49:29.607889 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:49:29.608217 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:29.608436 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:29.608546 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0808 12:49:29.608625 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0808 12:49:29.608632 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:29.608751 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:29.608794 18255 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.608866 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:29.608906 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:29.609121 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.609825 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:29.609979 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:29.610179 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:29.610358 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:29.610430 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0808 12:49:29.610509 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0808 12:49:29.610733 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0808 12:49:29.610916 18255 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0808 12:49:29.610991 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0808 12:49:29.611037 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0808 12:49:29.611059 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:29.611092 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:29.611482 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:49:29.611613 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0808 12:49:29.611691 18255 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0808 12:49:29.611687 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:29.611808 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0808 12:49:29.611788 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0808 12:49:29.611850 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0808 12:49:29.611957 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:29.612032 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:29.612075 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:29.612110 18255 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0808 12:49:29.612171 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0808 12:49:29.612236 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0808 12:49:29.612321 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:29.612394 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:29.612428 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:29.612455 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:29.612587 18255 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.612643 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:29.612674 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:29.612807 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:29.612955 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0808 12:49:29.612967 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:29.613072 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0808 12:49:29.613147 18255 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0808 12:49:29.613162 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0808 12:49:29.613192 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:29.613238 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:29.613267 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:29.613295 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0808 12:49:29.613390 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0808 12:49:29.615990 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:49:29.616170 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.616344 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.616579 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.616697 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0808 12:49:29.616862 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.617078 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:29.617198 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:29.617349 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.617500 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:29.617562 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:29.617614 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:29.617662 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:29.617740 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0808 12:49:29.617803 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:29.617934 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.618059 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0808 12:49:29.618098 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0808 12:49:29.618191 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0808 12:49:29.618287 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0808 12:49:29.618402 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0808 12:49:29.618435 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0808 12:49:29.618462 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I0808 12:49:29.618550 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.618647 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" }] }] } I0808 12:49:29.618745 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:49:29.618936 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:49:29.619127 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:49:29.619396 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:49:29.619440 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:29.619471 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:29.619529 18255 dns.go:235] Pre-creating DNS records I0808 12:49:29.619556 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:29.627788 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0808 12:49:29.630658 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:29.630793 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0808 12:49:30.353481 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:30.478516 18255 iamrole.go:89] ListRoles: { } I0808 12:49:30.479188 18255 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0808 12:49:30.479730 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.479812 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:30.479966 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0808 12:49:30.480201 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:30.480984 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.481212 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.481307 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:30.481334 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:30.481370 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:30.482894 18255 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0808 12:49:30.482985 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:30.483057 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0808 12:49:30.483091 18255 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0808 12:49:30.483094 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0808 12:49:30.483241 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:30.483283 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0808 12:49:30.483382 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.483516 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:30.483569 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.483663 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:30.483731 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.483820 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:30.487300 18255 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0808 12:49:30.487422 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:30.487538 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:30.487710 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:30.487824 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:30.488001 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:30.488200 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:30.488336 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:30.488889 18255 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0808 12:49:30.489105 18255 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0808 12:49:30.489302 18255 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0808 12:49:30.491207 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:49:30.491259 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:30.491287 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:49:30.491307 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:49:30.491327 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:49:30.491347 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:49:30.491365 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:30.491385 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:49:30.491406 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:49:30.491428 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:49:30.491458 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:49:30.491477 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:49:30.491495 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:30.491515 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:49:30.491535 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:30.491555 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:30.491575 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:30.491596 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:49:30.491616 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:49:30.491651 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:49:30.491671 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:30.491695 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:30.491716 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:30.491737 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:49:30.492667 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:49:30.492746 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:49:30.492759 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:49:30.492787 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.492821 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0808 12:49:30.492859 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.492902 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.492935 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.492975 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.493005 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.493031 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0808 12:49:30.493064 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.493097 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:49:30.493124 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0808 12:49:30.493155 18255 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0808 12:49:30.493179 18255 api.go:53] PageSize not implemented I0808 12:49:30.493196 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:30.493216 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:30.493230 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:49:30.493253 18255 targetgroups.go:35] PageSize not implemented I0808 12:49:30.493268 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0808 12:49:30.493308 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:49:30.493341 18255 iamrole.go:89] ListRoles: { } I0808 12:49:30.493373 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:30.493395 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:30.493427 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:49:30.493459 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:30.493483 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0808 12:49:30.493847 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0808 12:49:30.493897 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0808 12:49:30.493891 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.minimal.example.com ok I0808 12:49:30.493962 18255 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0808 12:49:30.494015 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0808 12:49:30.494027 18255 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0808 12:49:30.494074 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0808 12:49:30.493923 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok I0808 12:49:30.494096 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:30.494190 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0808 12:49:30.494402 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:30.494424 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I0808 12:49:30.494477 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0808 12:49:30.494560 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:30.494576 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0808 12:49:30.494612 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0808 12:49:30.494657 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0808 12:49:30.494695 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0808 12:49:30.494781 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0808 12:49:30.494821 18255 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0808 12:49:30.494832 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0808 12:49:30.494862 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0808 12:49:30.494811 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I0808 12:49:30.494891 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } subnet:subnet-1 ok I0808 12:49:30.494920 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0808 12:49:30.494929 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0808 12:49:30.494949 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0808 12:49:30.495023 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0808 12:49:30.495089 18255 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0808 12:49:30.495144 18255 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (1.78s) === RUN TestLifecycleMinimalOpenstack I0808 12:49:30.495649 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0808 12:49:30.505634 18255 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:49:31.299367 18255 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0808 12:49:31.299400 18255 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0808 12:49:31.307708 18255 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/08/08 12:49:31 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:31 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0808 12:49:31.316137 18255 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0808 12:49:31.324561 18255 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0808 12:49:31.329097 18255 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/08/08 12:49:31 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:31 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:31 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0808 12:49:31.331410 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0808 12:49:31.331518 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0808 12:49:31.331566 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0808 12:49:32.335568 18255 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:49:33.163374 18255 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0808 12:49:33.163413 18255 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0808 12:49:33.178664 18255 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/08/08 12:49:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0808 12:49:33.187954 18255 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0808 12:49:33.193081 18255 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0808 12:49:33.194435 18255 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/08/08 12:49:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0808 12:49:33.196657 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0808 12:49:33.197063 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0808 12:49:33.197454 18255 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0808 12:49:33.198640 18255 delete_cluster.go:128] Looking for cloud resources to delete 2025/08/08 12:49:33 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SecurityGroup:988747ed-9bb0-4857-860e-1a6d7cdfde68 ok Port:0443c9e6-249d-4029-8b95-fdde231c4441 ok ServerGroup:150456a4-7841-4499-8fd5-1f528f66299a ok SecurityGroup:b90d7596-0524-4c36-b745-3775444a5dfa ok Port:db810f02-afa3-4b6d-aeb0-20eb28d45a30 ok Instance:614c0da0-bd2b-4ddd-af23-5dc6c7e46beb ok Port:a5f43c3f-6420-4f76-95a4-17b454afc621 ok Subnet:425b0404-293a-47ee-8de1-de26aa2d3cdc ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok ServerGroup:be570c34-18fb-4746-86de-7e2c945ffe78 ok Instance:e399a37e-4f05-41df-b525-9d6c2cad642b ok Network:90154a08-56e8-42e3-841b-3eb9fd0494a4 ok SecurityGroup:5221d67e-7be6-49d1-bb70-e5e02fa6b49a ok Instance:9ff53618-b5ff-43fd-a273-03eaf96f5c3d ok --- PASS: TestLifecycleMinimalOpenstack (3.81s) === RUN TestLifecycleMinimalGCE I0808 12:49:34.304801 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0808 12:49:34.306372 18255 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:49:35.398222 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:49:35.398318 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:49:35.398418 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0808 12:49:35.398441 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0808 12:49:35.398459 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0808 12:49:35.398516 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0808 12:49:35.399582 18255 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0808 12:49:35.402633 18255 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0808 12:49:35.406949 18255 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0808 12:49:35.407825 18255 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0808 12:49:35.408002 18255 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0808 12:49:35.408080 18255 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:49:36.496225 18255 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0808 12:49:36.496308 18255 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0808 12:49:36.496409 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0808 12:49:36.496430 18255 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0808 12:49:36.496450 18255 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0808 12:49:36.496503 18255 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0808 12:49:36.497492 18255 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0808 12:49:36.500575 18255 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0808 12:49:36.504926 18255 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0808 12:49:36.505695 18255 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0808 12:49:36.505833 18255 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0808 12:49:36.507098 18255 delete_cluster.go:128] Looking for cloud resources to delete I0808 12:49:36.507165 18255 gce.go:99] Scanning zones: [us-test1-a] I0808 12:49:36.507464 18255 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0808 12:49:36.507482 18255 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:node-to-master-minimal-gce-example-com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1754657375 ok InstanceTemplate:nodes-minimal-gce-example-com-1754657375 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (2.20s) === RUN TestLifecycleFloatingIPOpenstack I0808 12:49:36.508731 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0808 12:49:36.514662 18255 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:49:37.315188 18255 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0808 12:49:37.315217 18255 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0808 12:49:37.325597 18255 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/08/08 12:49:37 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:37 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0808 12:49:37.329223 18255 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0808 12:49:37.341267 18255 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0808 12:49:37.343847 18255 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/08/08 12:49:37 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:37 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:37 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0808 12:49:37.345693 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0808 12:49:37.345842 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0808 12:49:37.346043 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0808 12:49:38.349927 18255 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0808 12:49:39.145838 18255 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0808 12:49:39.145871 18255 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0808 12:49:39.163878 18255 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/08/08 12:49:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0808 12:49:39.168369 18255 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0808 12:49:39.176258 18255 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0808 12:49:39.179317 18255 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/08/08 12:49:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/08/08 12:49:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0808 12:49:39.181830 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0808 12:49:39.181920 18255 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0808 12:49:39.182386 18255 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0808 12:49:39.183597 18255 delete_cluster.go:128] Looking for cloud resources to delete 2025/08/08 12:49:39 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Port:e6b34e60-db97-49b9-820f-9f4f44b8084b ok Port:8c2126e7-4a0e-4197-9c00-1f1d710ad91b ok Instance:e18c15b9-dd2c-4141-b04e-73fd3f4db303 ok Instance:89cbffab-b05c-44b5-aea8-86abbf8ea664 ok SecurityGroup:da9dd9aa-9e57-4f30-9cd4-8a6e1de8c799 ok Router:9b33f613-1325-410b-84fe-d071c03a213e ok Port:dbac66c5-d146-49d3-802c-cf8e5178657e ok Subnet:8065573c-8dce-42be-bbfb-f2c3472a381a ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Router-IF:8065573c-8dce-42be-bbfb-f2c3472a381a ok ServerGroup:5f8ebb05-a992-4d95-957c-42c1b2553c85 ok ServerGroup:79fa282c-6b3f-4558-96ac-854f639402e6 ok Network:78cb9e61-2f66-4763-b173-69628c5211d3 ok SecurityGroup:9e92dd47-cfc3-4b47-80c8-0f8075897843 ok Port:ade3a587-0b05-47a1-8e9a-8bfd627fac63 ok SecurityGroup:0bafd08e-a98a-4f29-9466-7ff8b1391861 ok Instance:104c1785-b210-4646-85a0-71e47d2f285a ok --- PASS: TestLifecycleFloatingIPOpenstack (3.77s) === RUN TestLifecyclePrivateCalico I0808 12:49:40.279833 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:40.280059 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:40.280097 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:40.280141 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:40.280173 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:40.280211 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:40.280244 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:40.280264 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:40.280292 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:40.280313 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0808 12:49:40.302561 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:49:40.305535 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:40.305677 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:40.305718 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:40.981869 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:41.316472 18255 iamrole.go:89] ListRoles: { } I0808 12:49:41.317659 18255 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0808 12:49:41.317998 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0808 12:49:41.318077 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0808 12:49:41.318102 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:41.318279 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.318660 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:41.318839 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0808 12:49:41.318917 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] } I0808 12:49:41.318959 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:41.319018 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0808 12:49:41.319078 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0808 12:49:41.319122 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] }] } I0808 12:49:41.319226 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:41.319295 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:41.319322 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I0808 12:49:41.319399 18255 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.319437 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0808 12:49:41.319452 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0808 12:49:41.319477 18255 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0808 12:49:41.319596 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:41.319640 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:41.320889 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:41.320977 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:41.321016 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:41.321168 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:41.322834 18255 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0808 12:49:41.323191 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0808 12:49:41.323260 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0808 12:49:41.323410 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0808 12:49:41.323529 18255 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0808 12:49:41.323572 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0808 12:49:41.323997 18255 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0808 12:49:41.323476 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0808 12:49:41.324160 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0808 12:49:41.324728 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0808 12:49:41.324845 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:41.325013 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0808 12:49:41.325061 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0808 12:49:41.325105 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:41.325162 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0808 12:49:41.325207 18255 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0808 12:49:41.325218 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:41.325298 18255 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0808 12:49:41.325325 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:41.325402 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:41.325439 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:41.325466 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:41.325526 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:41.325562 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:41.325586 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0808 12:49:41.325641 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:49:41.325606 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0808 12:49:41.326212 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:41.326358 18255 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.326422 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:41.326494 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:41.326556 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:41.326611 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0808 12:49:41.326700 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:41.326560 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0808 12:49:41.326793 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:41.326838 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0808 12:49:41.326880 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:41.326859 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0808 12:49:41.326921 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:41.326954 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0808 12:49:41.326943 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0808 12:49:41.327043 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:41.327046 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0808 12:49:41.327083 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" } ] } I0808 12:49:41.327152 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:49:41.327186 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:41.327222 18255 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0808 12:49:41.327260 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:41.327322 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0808 12:49:41.327361 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:49:41.327397 18255 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0808 12:49:41.327453 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:49:41.327492 18255 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0808 12:49:41.327591 18255 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0808 12:49:41.327749 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.327871 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.327967 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } W0808 12:49:41.328119 18255 api.go:53] PageSize not implemented I0808 12:49:41.328073 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.328193 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0808 12:49:41.328207 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } W0808 12:49:41.328265 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:41.328234 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:41.328349 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:41.328374 18255 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0808 12:49:41.328378 18255 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }], Type: "network" } I0808 12:49:41.328442 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:41.328454 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:41.328471 18255 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0808 12:49:41.328493 18255 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I0808 12:49:41.328516 18255 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } W0808 12:49:41.328577 18255 api.go:53] PageSize not implemented I0808 12:49:41.328594 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:41.328556 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.328690 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0808 12:49:41.328810 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.328917 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0808 12:49:41.329010 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:41.329064 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:41.329115 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:41.329167 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:41.329286 18255 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.329290 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.329491 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.329604 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.329764 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0808 12:49:41.329903 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0808 12:49:41.329945 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.330051 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0808 12:49:41.330087 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0808 12:49:41.330118 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0808 12:49:41.330142 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0808 12:49:41.330172 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.330317 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.330473 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0808 12:49:41.330550 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0808 12:49:41.330632 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0808 12:49:41.330822 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.330988 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" }] }] } I0808 12:49:41.331133 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0808 12:49:41.331244 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:41.331315 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.331429 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.331520 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" }] }] } I0808 12:49:41.331608 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0808 12:49:41.331724 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0808 12:49:41.331791 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0808 12:49:41.331855 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0808 12:49:41.331941 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0808 12:49:41.332041 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:41.332147 18255 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0808 12:49:41.332200 18255 api.go:53] PageSize not implemented I0808 12:49:41.332232 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:41.332262 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:41.332248 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0808 12:49:41.332313 18255 api.go:53] PageSize not implemented I0808 12:49:41.332356 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:41.332360 18255 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:41.332376 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:41.332492 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:41.332471 18255 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0808 12:49:41.332568 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0808 12:49:41.332553 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:41.332605 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:41.332659 18255 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0808 12:49:41.336497 18255 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0808 12:49:41.336578 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:41.336685 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0808 12:49:41.336723 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:41.336796 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:41.336948 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:41.337056 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:41.337687 18255 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0808 12:49:41.337910 18255 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0808 12:49:41.338110 18255 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0808 12:49:41.338148 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:41.338176 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:41.338252 18255 dns.go:235] Pre-creating DNS records I0808 12:49:41.338272 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:41.343203 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:49:41.346021 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:41.346081 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:41.346120 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:42.021368 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:42.380924 18255 iamrole.go:89] ListRoles: { } I0808 12:49:42.384275 18255 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0808 12:49:42.384857 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:42.385216 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.385344 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.385526 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.385629 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:42.385686 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.385938 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:42.386023 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:42.386183 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:42.387673 18255 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0808 12:49:42.387779 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0808 12:49:42.387856 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0808 12:49:42.387887 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0808 12:49:42.387927 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0808 12:49:42.387816 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0808 12:49:42.387991 18255 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0808 12:49:42.388041 18255 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0808 12:49:42.388038 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] }] } I0808 12:49:42.388169 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:42.388273 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0808 12:49:42.388438 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:49:42.388505 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.388702 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:42.388760 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:42.388870 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.389025 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.389170 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:42.389237 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0808 12:49:42.389430 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:42.389480 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0808 12:49:42.389624 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.389788 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:42.389837 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:42.390163 18255 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0808 12:49:42.390331 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:42.390395 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:42.390419 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } W0808 12:49:42.390471 18255 api.go:53] PageSize not implemented I0808 12:49:42.390468 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:42.390504 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:42.390592 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:42.390465 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0808 12:49:42.390583 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:42.390670 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0808 12:49:42.390623 18255 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0808 12:49:42.390731 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0808 12:49:42.390763 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0808 12:49:42.390755 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0808 12:49:42.390841 18255 api.go:53] PageSize not implemented I0808 12:49:42.390858 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:42.390878 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:42.390952 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:42.391285 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:42.391403 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:42.391488 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0808 12:49:42.391530 18255 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0808 12:49:42.391710 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0808 12:49:42.391831 18255 executor.go:111] Tasks: 120 done / 142 total; 6 can run I0808 12:49:42.391911 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:42.391960 18255 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" W0808 12:49:42.391975 18255 api.go:53] PageSize not implemented I0808 12:49:42.391980 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:42.391931 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:42.392003 18255 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0808 12:49:42.392014 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:42.392029 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } W0808 12:49:42.392077 18255 api.go:53] PageSize not implemented I0808 12:49:42.392131 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:42.392198 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:42.392344 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:42.396948 18255 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0808 12:49:42.397056 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:42.397190 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:42.397311 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:42.397417 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:42.397522 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:42.398056 18255 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0808 12:49:42.398160 18255 api.go:53] PageSize not implemented I0808 12:49:42.398182 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:42.398355 18255 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0808 12:49:42.398529 18255 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0808 12:49:42.401184 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:49:42.401236 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:42.401262 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:49:42.401284 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0808 12:49:42.401305 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:49:42.401325 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:49:42.401343 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:49:42.401363 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:42.401392 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:49:42.401413 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:49:42.401438 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:49:42.401464 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0808 12:49:42.401489 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0808 12:49:42.401511 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:49:42.401532 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:49:42.401552 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:42.401575 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:49:42.401597 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:49:42.401620 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:42.401667 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:42.401692 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:49:42.401716 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0808 12:49:42.401736 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:42.401761 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:49:42.401780 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:49:42.401802 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:49:42.401823 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:49:42.401842 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:42.401866 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:42.401890 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:42.401911 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:49:42.403102 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:49:42.403156 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:49:42.403171 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:49:42.403201 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.403245 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0808 12:49:42.403292 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.403338 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.403372 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.403413 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.403445 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.403477 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0808 12:49:42.403519 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.403559 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:42.403583 18255 natgateway.go:117] DescribeNatGateways: { } I0808 12:49:42.403614 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0808 12:49:42.403645 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0808 12:49:42.403684 18255 api.go:53] PageSize not implemented I0808 12:49:42.403697 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0808 12:49:42.403727 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:42.403750 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:42.403764 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0808 12:49:42.403792 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:49:42.403812 18255 targetgroups.go:35] PageSize not implemented I0808 12:49:42.403825 18255 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0808 12:49:42.403870 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:49:42.403902 18255 iamrole.go:89] ListRoles: { } I0808 12:49:42.403939 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:42.403961 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:42.403997 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:49:42.404036 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:42.404070 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0808 12:49:42.404099 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0808 12:49:42.404126 18255 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } autoscaling-group:nodes.privatecalico.example.com ok I0808 12:49:42.404677 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:42.404714 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0808 12:49:42.404782 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } autoscaling-group:bastion.privatecalico.example.com ok I0808 12:49:42.404773 18255 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } iam-instance-profile:bastions.privatecalico.example.com ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I0808 12:49:42.404827 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0808 12:49:42.404864 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok I0808 12:49:42.404764 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0808 12:49:42.404878 18255 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I0808 12:49:42.404893 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } W0808 12:49:42.404935 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:42.404958 18255 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok I0808 12:49:42.404988 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I0808 12:49:42.404724 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.privatecalico.example.com ok I0808 12:49:42.405001 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0808 12:49:42.405072 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0808 12:49:42.405139 18255 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0808 12:49:42.405190 18255 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0808 12:49:42.405225 18255 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0808 12:49:42.405280 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0808 12:49:42.405321 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:42.405362 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 } ] } W0808 12:49:42.405515 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:42.405536 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0808 12:49:42.405570 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:42.405617 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0808 12:49:42.405794 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:42.405815 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-3 ok I0808 12:49:42.405877 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0808 12:49:42.406009 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0808 12:49:42.405999 18255 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0808 12:49:42.406057 18255 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0808 12:49:42.406071 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0808 12:49:42.406073 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:49:42.406096 18255 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0808 12:49:42.406120 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0808 12:49:42.406152 18255 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0808 12:49:42.406161 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0808 12:49:42.406181 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I0808 12:49:42.406111 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0808 12:49:42.406235 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:42.406205 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0808 12:49:42.406252 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } I0808 12:49:42.406266 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com security-group:sg-4 ok I0808 12:49:42.406281 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0808 12:49:42.406290 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0808 12:49:42.406314 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I0808 12:49:42.406347 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0808 12:49:42.406444 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0808 12:49:42.406499 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0808 12:49:42.406557 18255 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0808 12:49:42.406608 18255 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (2.13s) === RUN TestLifecyclePrivateKopeio I0808 12:49:42.407102 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:42.407304 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:42.407334 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:42.407365 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:42.407390 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:42.407424 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:42.407453 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:42.407473 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:42.407498 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:42.407524 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0808 12:49:42.429336 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:42.432148 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:42.432275 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:42.432314 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.105628 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:43.254905 18255 iamrole.go:89] ListRoles: { } I0808 12:49:43.256415 18255 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0808 12:49:43.256702 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0808 12:49:43.256819 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.privatekopeio.example.com" }] } I0808 12:49:43.256812 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.256964 18255 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.257040 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0808 12:49:43.257065 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0808 12:49:43.257093 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:43.257126 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:43.257397 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0808 12:49:43.257490 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0808 12:49:43.257622 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.257699 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:43.257825 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:43.257949 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0808 12:49:43.257993 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:43.258031 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0808 12:49:43.258054 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.258202 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:43.258348 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.258527 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:43.258643 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:43.258688 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.258819 18255 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.258898 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:43.259454 18255 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0808 12:49:43.259555 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.259624 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0808 12:49:43.259662 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0808 12:49:43.259727 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0808 12:49:43.259712 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0808 12:49:43.259689 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.259794 18255 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0808 12:49:43.259820 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.259889 18255 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0808 12:49:43.259833 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0808 12:49:43.259951 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0808 12:49:43.259981 18255 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0808 12:49:43.260018 18255 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0808 12:49:43.259972 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0808 12:49:43.260040 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:43.260143 18255 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0808 12:49:43.260178 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0808 12:49:43.260263 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0808 12:49:43.260321 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:43.260289 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0808 12:49:43.260353 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I0808 12:49:43.260411 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:43.260436 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0808 12:49:43.260536 18255 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0808 12:49:43.260564 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.260682 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0808 12:49:43.260715 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.260821 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0808 12:49:43.260902 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0808 12:49:43.260955 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0808 12:49:43.261023 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:49:43.261070 18255 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I0808 12:49:43.261158 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }], VpcId: "vpc-1" } I0808 12:49:43.261248 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:43.261317 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:43.261361 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0808 12:49:43.261475 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.261576 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.261705 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0808 12:49:43.261803 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0808 12:49:43.261906 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:43.262038 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0808 12:49:43.262092 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0808 12:49:43.262163 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0808 12:49:43.262186 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:43.262312 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:43.262355 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:43.262387 18255 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "privatekopeio.example.com" }] }] } I0808 12:49:43.262444 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:43.262247 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0808 12:49:43.262475 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:43.262532 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:49:43.262559 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:43.262583 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:43.262637 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0808 12:49:43.262666 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:49:43.262695 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:49:43.262727 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:43.262752 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0808 12:49:43.262783 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:43.262807 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:43.262834 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:43.262880 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0808 12:49:43.262939 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0808 12:49:43.262999 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0808 12:49:43.263046 18255 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I0808 12:49:43.263172 18255 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0808 12:49:43.263304 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:43.263369 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:43.263315 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } W0808 12:49:43.263476 18255 api.go:53] PageSize not implemented I0808 12:49:43.263447 18255 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-3" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0808 12:49:43.263499 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0808 12:49:43.263612 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:43.263587 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.263698 18255 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I0808 12:49:43.263755 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:43.263731 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:43.263782 18255 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0808 12:49:43.263840 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0808 12:49:43.263828 18255 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0808 12:49:43.263874 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0808 12:49:43.263962 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.264039 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.264113 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.264216 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0808 12:49:43.264356 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0808 12:49:43.264474 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0808 12:49:43.264587 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:43.264640 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0808 12:49:43.264688 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:43.264738 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0808 12:49:43.264822 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:43.264880 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" }] }] } I0808 12:49:43.265029 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.265131 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0808 12:49:43.265194 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:43.265219 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:43.265267 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0808 12:49:43.265363 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:43.265416 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" }] }] } I0808 12:49:43.265515 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0808 12:49:43.265605 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.265694 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.265787 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.265880 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0808 12:49:43.265919 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I0808 12:49:43.265987 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.266074 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0808 12:49:43.266106 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-4" } I0808 12:49:43.266131 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:49:43.266163 18255 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0808 12:49:43.266192 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0808 12:49:43.266220 18255 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0808 12:49:43.266244 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:43.266270 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.266360 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0808 12:49:43.266393 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0808 12:49:43.266478 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I0808 12:49:43.266570 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0808 12:49:43.266662 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0808 12:49:43.266690 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:49:43.266721 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.266725 18255 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } I0808 12:49:43.266807 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W0808 12:49:43.266852 18255 api.go:53] PageSize not implemented I0808 12:49:43.266871 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0808 12:49:43.266881 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:43.266896 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0808 12:49:43.266956 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0808 12:49:43.267044 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0808 12:49:43.267075 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0808 12:49:43.267106 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I0808 12:49:43.267132 18255 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0808 12:49:43.267164 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0808 12:49:43.267192 18255 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0808 12:49:43.267215 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0808 12:49:43.267250 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0808 12:49:43.267312 18255 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0808 12:49:43.267388 18255 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0808 12:49:43.267434 18255 api.go:53] PageSize not implemented I0808 12:49:43.267465 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:43.267464 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:43.267500 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:43.267490 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0808 12:49:43.267546 18255 api.go:53] PageSize not implemented I0808 12:49:43.267651 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-1" } I0808 12:49:43.267603 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:43.267662 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:43.267712 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:43.267721 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:43.268220 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-3" } I0808 12:49:43.272064 18255 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0808 12:49:43.272363 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.272481 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.272566 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.272662 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.273216 18255 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0808 12:49:43.273453 18255 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0808 12:49:43.273721 18255 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0808 12:49:43.273763 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:43.273792 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:43.273848 18255 dns.go:235] Pre-creating DNS records I0808 12:49:43.273869 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:43.278913 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:43.281862 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.281930 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.281972 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:43.965710 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:44.122593 18255 iamrole.go:89] ListRoles: { } I0808 12:49:44.124175 18255 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0808 12:49:44.124377 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.124547 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] }] } I0808 12:49:44.124745 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:44.124882 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.125372 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.125493 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:44.125519 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:44.125561 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:44.125569 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:44.127297 18255 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0808 12:49:44.127397 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.127508 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0808 12:49:44.127575 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0808 12:49:44.127591 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0808 12:49:44.127611 18255 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0808 12:49:44.127624 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0808 12:49:44.127637 18255 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0808 12:49:44.127512 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:44.127695 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0808 12:49:44.127855 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:44.127907 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:44.127962 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.128079 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:44.128146 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.128241 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:44.128265 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.128377 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:44.128406 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0808 12:49:44.128516 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:44.128553 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.128650 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0808 12:49:44.128677 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0808 12:49:44.128784 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:49:44.128823 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.128916 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.129010 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.129104 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0808 12:49:44.129220 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:44.129311 18255 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0808 12:49:44.129475 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:44.129522 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:44.129607 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:44.129574 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:44.129623 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } W0808 12:49:44.129621 18255 api.go:53] PageSize not implemented I0808 12:49:44.129661 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0808 12:49:44.129685 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0808 12:49:44.129673 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:44.129713 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0808 12:49:44.129663 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:44.129742 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0808 12:49:44.129746 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:44.129778 18255 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } W0808 12:49:44.129802 18255 api.go:53] PageSize not implemented I0808 12:49:44.129813 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:44.129795 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:44.129983 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:44.130195 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0808 12:49:44.130318 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0808 12:49:44.130440 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:44.130545 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:44.130608 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:44.130741 18255 executor.go:111] Tasks: 122 done / 144 total; 7 can run I0808 12:49:44.130806 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:44.130841 18255 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" W0808 12:49:44.130853 18255 api.go:53] PageSize not implemented I0808 12:49:44.130811 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:44.130888 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:44.130884 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:44.131000 18255 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" W0808 12:49:44.130973 18255 api.go:53] PageSize not implemented I0808 12:49:44.130960 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:44.131046 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:44.131121 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:44.131200 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:44.135226 18255 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0808 12:49:44.135414 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:44.135556 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:44.135605 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:44.135737 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:44.136391 18255 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0808 12:49:44.136560 18255 api.go:53] PageSize not implemented I0808 12:49:44.136586 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:44.136755 18255 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0808 12:49:44.136911 18255 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0808 12:49:44.139597 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:49:44.139650 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:44.139680 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:49:44.139705 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:49:44.139728 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:49:44.139748 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:49:44.139773 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:44.139797 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:49:44.139822 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:49:44.139847 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:49:44.139878 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0808 12:49:44.139903 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:49:44.139926 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:49:44.139949 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:44.139975 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:49:44.139996 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:49:44.140023 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0808 12:49:44.140047 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:44.140071 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:44.140094 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:49:44.140117 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0808 12:49:44.140143 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:44.140168 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:49:44.140193 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:49:44.140218 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0808 12:49:44.140242 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0808 12:49:44.140267 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:49:44.140289 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:49:44.140310 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:44.140335 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:44.140361 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:44.140387 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:49:44.141658 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:49:44.141715 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:49:44.141732 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:49:44.141765 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.141812 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0808 12:49:44.141860 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.141910 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.141947 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.141988 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.142022 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.142060 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0808 12:49:44.142112 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.142162 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:44.142187 18255 natgateway.go:117] DescribeNatGateways: { } I0808 12:49:44.142217 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0808 12:49:44.142248 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0808 12:49:44.142289 18255 api.go:53] PageSize not implemented I0808 12:49:44.142302 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0808 12:49:44.142332 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:44.142353 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:44.142365 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0808 12:49:44.142393 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:49:44.142410 18255 targetgroups.go:35] PageSize not implemented I0808 12:49:44.142423 18255 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I0808 12:49:44.142470 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:49:44.142501 18255 iamrole.go:89] ListRoles: { } I0808 12:49:44.142569 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:44.142592 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:44.142624 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:49:44.142663 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:44.142702 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-3","rtb-1"] } I0808 12:49:44.142737 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0808 12:49:44.142759 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I0808 12:49:44.143708 18255 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } autoscaling-group:nodes.privatekopeio.example.com ok load-balancer:api-privatekopeio-example-tl2bv8 ok autoscaling-config:lt-3 ok autoscaling-config:lt-1 ok I0808 12:49:44.143813 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } I0808 12:49:44.143838 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } autoscaling-group:bastion.privatekopeio.example.com ok I0808 12:49:44.143814 18255 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } volume:vol-1 ok I0808 12:49:44.143882 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I0808 12:49:44.143878 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:44.143907 18255 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok I0808 12:49:44.143999 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I0808 12:49:44.143938 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 } ] } I0808 12:49:44.144063 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok W0808 12:49:44.144082 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:44.143936 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.privatekopeio.example.com. ok I0808 12:49:44.144097 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } I0808 12:49:44.144093 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } security-group:sg-3 ok I0808 12:49:44.144144 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok I0808 12:49:44.144137 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:44.144183 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W0808 12:49:44.144274 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:44.144291 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0808 12:49:44.144318 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I0808 12:49:44.144413 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:44.144464 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0808 12:49:44.144628 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:44.144647 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0808 12:49:44.144671 18255 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0808 12:49:44.144713 18255 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0808 12:49:44.144736 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0808 12:49:44.144830 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:49:44.144840 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0808 12:49:44.144880 18255 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0808 12:49:44.144891 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0808 12:49:44.144913 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } I0808 12:49:44.144863 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } iam-role:masters.privatekopeio.example.com ok W0808 12:49:44.144937 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:44.144949 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } I0808 12:49:44.144937 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0808 12:49:44.144986 18255 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com security-group:sg-4 ok I0808 12:49:44.144996 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0808 12:49:44.145015 18255 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0808 12:49:44.145017 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0808 12:49:44.145039 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0808 12:49:44.145067 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0808 12:49:44.145059 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } I0808 12:49:44.145076 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } subnet:subnet-4 ok I0808 12:49:44.145093 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0808 12:49:44.145100 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0808 12:49:44.145139 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0808 12:49:44.145203 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0808 12:49:44.145244 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0808 12:49:44.145283 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0808 12:49:44.145338 18255 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0808 12:49:44.145390 18255 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (1.74s) === RUN TestLifecycleIPv6 I0808 12:49:44.145872 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:44.146086 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:44.146115 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:44.146150 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:44.146178 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:44.146214 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:44.146242 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:44.146265 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:44.146292 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:44.146313 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0808 12:49:44.173852 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:49:44.176881 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:44.176952 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:44.852878 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:44.998376 18255 iamrole.go:89] ListRoles: { } I0808 12:49:44.999570 18255 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0808 12:49:44.999766 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:44.999930 18255 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.000005 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0808 12:49:45.000033 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0808 12:49:45.000058 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:45.000094 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:45.000405 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:45.000544 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.000650 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.000821 18255 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.000896 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:45.000874 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0808 12:49:45.000972 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] } I0808 12:49:45.000993 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.001169 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:45.001283 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:45.001528 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:45.001645 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0808 12:49:45.001721 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] } I0808 12:49:45.002019 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] }] } I0808 12:49:45.002174 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:45.002286 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:45.003446 18255 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0808 12:49:45.003536 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.003631 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0808 12:49:45.003644 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:45.003688 18255 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0808 12:49:45.003673 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0808 12:49:45.003791 18255 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0808 12:49:45.003819 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0808 12:49:45.003826 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:45.003846 18255 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0808 12:49:45.003921 18255 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0808 12:49:45.003866 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0808 12:49:45.003942 18255 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0808 12:49:45.003957 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.004025 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0808 12:49:45.004043 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0808 12:49:45.004108 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0808 12:49:45.004105 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0808 12:49:45.004234 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0808 12:49:45.004293 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:45.004326 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:45.004349 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.004455 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:45.004507 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0808 12:49:45.004602 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I0808 12:49:45.004644 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0808 12:49:45.004702 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.004754 18255 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }] } I0808 12:49:45.004795 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.004849 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:45.004875 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0808 12:49:45.004915 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0808 12:49:45.005003 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:45.005119 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:49:45.005008 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0808 12:49:45.005178 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:49:45.005208 18255 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" } ] } I0808 12:49:45.005250 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:45.005276 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:45.005299 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:45.005320 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:45.005338 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0808 12:49:45.005405 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0808 12:49:45.005447 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0808 12:49:45.005468 18255 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I0808 12:49:45.005610 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0808 12:49:45.005923 18255 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0808 12:49:45.006038 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0808 12:49:45.006131 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.006244 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.006386 18255 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.006460 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I0808 12:49:45.007213 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.007386 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.007317 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0808 12:49:45.007494 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0808 12:49:45.007648 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0808 12:49:45.007946 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:45.008037 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:45.008092 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:45.008200 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.008366 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0808 12:49:45.008482 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" }] }] } I0808 12:49:45.008555 18255 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.008695 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.008964 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] }] } I0808 12:49:45.009218 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.009217 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0808 12:49:45.009570 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:49:45.009664 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I0808 12:49:45.009786 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:45.009945 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] }] } I0808 12:49:45.010160 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.010551 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:45.010737 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.011130 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I0808 12:49:45.011133 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0808 12:49:45.010541 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0808 12:49:45.011193 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.011371 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0808 12:49:45.011343 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.011509 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.011606 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0808 12:49:45.011727 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0808 12:49:45.011745 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0808 12:49:45.011874 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0808 12:49:45.012597 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" }] }] } I0808 12:49:45.012726 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.012847 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I0808 12:49:45.012971 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.013090 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.013235 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" }] }] } I0808 12:49:45.013352 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0808 12:49:45.013393 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.013534 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0808 12:49:45.013672 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0808 12:49:45.013719 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:45.013765 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0808 12:49:45.013799 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0808 12:49:45.013838 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0808 12:49:45.013873 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0808 12:49:45.013904 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0808 12:49:45.013949 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0808 12:49:45.014013 18255 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0808 12:49:45.014095 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.014178 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:45.014269 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:45.014189 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:45.014362 18255 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-4" },{ SubnetId: "subnet-3" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0808 12:49:45.014432 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0808 12:49:45.014488 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-4" } I0808 12:49:45.014522 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0808 12:49:45.014547 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-6" } I0808 12:49:45.014577 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0808 12:49:45.014606 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:45.014644 18255 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0808 12:49:45.014707 18255 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0808 12:49:45.014693 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.014789 18255 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } W0808 12:49:45.014759 18255 api.go:53] PageSize not implemented I0808 12:49:45.014893 18255 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }] }] } I0808 12:49:45.014926 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.015035 18255 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-3"] }] } I0808 12:49:45.015112 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.015140 18255 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-3", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }] }] } I0808 12:49:45.015207 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0808 12:49:45.015246 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0808 12:49:45.015280 18255 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0808 12:49:45.015316 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0808 12:49:45.015357 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0808 12:49:45.015386 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.015489 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0808 12:49:45.015527 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:45.015596 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0808 12:49:45.015634 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0808 12:49:45.015667 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I0808 12:49:45.015694 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0808 12:49:45.015730 18255 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0808 12:49:45.015759 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-5" } I0808 12:49:45.015781 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.015866 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0808 12:49:45.015890 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0808 12:49:45.015947 18255 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0808 12:49:45.016005 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:45.016006 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0808 12:49:45.016009 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0808 12:49:45.016053 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:45.016074 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.016077 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:45.016070 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0808 12:49:45.016175 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:45.016197 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0808 12:49:45.016233 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:45.016253 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.016321 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:45.016378 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:45.016381 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0808 12:49:45.016427 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0808 12:49:45.016392 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0808 12:49:45.016458 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.016542 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0808 12:49:45.021415 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:49:45.021588 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.021713 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.021800 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.021902 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.022444 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:49:45.022631 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:49:45.022829 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:49:45.022868 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:45.022895 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:45.022947 18255 dns.go:235] Pre-creating DNS records I0808 12:49:45.022966 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:45.028153 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0808 12:49:45.031147 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.031209 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.704831 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:45.844147 18255 iamrole.go:89] ListRoles: { } I0808 12:49:45.845342 18255 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0808 12:49:45.845668 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.845820 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.845946 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:45.845972 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:45.846015 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:45.848720 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:45.849249 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.849492 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.849716 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:45.851744 18255 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0808 12:49:45.852524 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0808 12:49:45.852515 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0808 12:49:45.852592 18255 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0808 12:49:45.852673 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] }] } I0808 12:49:45.852750 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0808 12:49:45.852829 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0808 12:49:45.852859 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0808 12:49:45.852827 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0808 12:49:45.852958 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:45.853035 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:45.853189 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:45.853306 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0808 12:49:45.853463 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:45.853518 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.853654 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:45.853747 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.853974 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.854122 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.854266 18255 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0808 12:49:45.854433 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.854625 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.854697 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0808 12:49:45.854727 18255 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0808 12:49:45.854755 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0808 12:49:45.854887 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.855067 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0808 12:49:45.855133 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.855376 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:45.855474 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.855580 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0808 12:49:45.855607 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.855698 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:45.855722 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.855811 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:45.855835 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:45.855891 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] }] } I0808 12:49:45.855983 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0808 12:49:45.856017 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.856068 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0808 12:49:45.856092 18255 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0808 12:49:45.856115 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0808 12:49:45.856147 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.856307 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:45.856397 18255 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0808 12:49:45.856459 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.856521 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.856570 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0808 12:49:45.856576 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0808 12:49:45.856612 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0808 12:49:45.856657 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:45.856675 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0808 12:49:45.856681 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.856714 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0808 12:49:45.856738 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0808 12:49:45.856745 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0808 12:49:45.856776 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0808 12:49:45.856805 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0808 12:49:45.856782 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W0808 12:49:45.856878 18255 api.go:53] PageSize not implemented I0808 12:49:45.856852 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:45.856909 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0808 12:49:45.856967 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.857044 18255 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0808 12:49:45.857090 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:45.857131 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:45.857111 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.857146 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0808 12:49:45.857190 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:45.857185 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:45.857236 18255 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0808 12:49:45.857256 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:45.857243 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:45.857278 18255 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0808 12:49:45.857256 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0808 12:49:45.857303 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0808 12:49:45.857332 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:45.857353 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0808 12:49:45.857428 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:45.857458 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0808 12:49:45.857533 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:45.857560 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0808 12:49:45.861484 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:49:45.861577 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.861714 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.861797 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.861946 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.862543 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:49:45.862721 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:49:45.862932 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:49:45.865487 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:49:45.865536 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:45.865563 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:49:45.865585 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0808 12:49:45.865607 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0808 12:49:45.865631 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:49:45.865652 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0808 12:49:45.865674 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:49:45.865694 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:49:45.865714 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:45.865737 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:49:45.865760 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:49:45.865787 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:49:45.865811 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0808 12:49:45.865833 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0808 12:49:45.865855 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:49:45.865875 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:49:45.865894 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:45.865916 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:49:45.865936 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:49:45.865959 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0808 12:49:45.865981 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:45.866007 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:45.866030 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:49:45.866052 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:45.866075 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:49:45.866096 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:49:45.866118 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0808 12:49:45.866141 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0808 12:49:45.866164 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0808 12:49:45.866187 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0808 12:49:45.866209 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:49:45.866229 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:49:45.866249 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:45.866272 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:45.866297 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:45.866319 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:49:45.867831 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:49:45.867879 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:49:45.867896 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:49:45.867928 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.867966 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0808 12:49:45.868009 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.868052 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.868088 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.868128 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.868164 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.868199 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0808 12:49:45.868244 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.868317 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:45.868343 18255 natgateway.go:117] DescribeNatGateways: { } I0808 12:49:45.868380 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0808 12:49:45.868410 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0808 12:49:45.868449 18255 api.go:53] PageSize not implemented I0808 12:49:45.868463 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:45.868484 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:45.868496 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0808 12:49:45.868523 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:49:45.868539 18255 targetgroups.go:35] PageSize not implemented I0808 12:49:45.868551 18255 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" ] } I0808 12:49:45.868593 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:49:45.868623 18255 iamrole.go:89] ListRoles: { } I0808 12:49:45.868661 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:45.868683 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:45.868713 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:49:45.868747 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:45.868783 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3","rtb-1","rtb-2"] } I0808 12:49:45.868814 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0808 12:49:45.868841 18255 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0808 12:49:45.868864 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0808 12:49:45.868885 18255 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0808 12:49:45.869393 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0808 12:49:45.869457 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0808 12:49:45.869451 18255 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0808 12:49:45.869509 18255 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I0808 12:49:45.869508 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } autoscaling-group:nodes.minimal-ipv6.example.com ok I0808 12:49:45.869576 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0808 12:49:45.869559 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I0808 12:49:45.869633 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0808 12:49:45.869668 18255 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0808 12:49:45.869750 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:masters.minimal-ipv6.example.com ok I0808 12:49:45.869811 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok I0808 12:49:45.869768 18255 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0808 12:49:45.869704 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.internal.minimal-ipv6.example.com. ok I0808 12:49:45.869866 18255 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0808 12:49:45.869902 18255 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I0808 12:49:45.869926 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:45.869973 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0808 12:49:45.870206 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:45.870225 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0808 12:49:45.870257 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok I0808 12:49:45.870311 18255 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0808 12:49:45.870354 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok autoscaling-config:lt-1 ok I0808 12:49:45.870408 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0808 12:49:45.870447 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:45.870488 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0808 12:49:45.870591 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:45.870603 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0808 12:49:45.870631 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0808 12:49:45.870714 18255 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0808 12:49:45.870759 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } I0808 12:49:45.870752 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } subnet:subnet-5 ok I0808 12:49:45.870807 18255 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0808 12:49:45.870809 18255 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I0808 12:49:45.870822 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0808 12:49:45.870847 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0808 12:49:45.870851 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0808 12:49:45.870893 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0808 12:49:45.870894 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0808 12:49:45.870937 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0808 12:49:45.870968 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0808 12:49:45.870991 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0808 12:49:45.871039 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I0808 12:49:45.871146 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0808 12:49:45.871222 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0808 12:49:45.871320 18255 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0808 12:49:45.871406 18255 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (1.73s) === RUN TestLifecycleSharedVPC I0808 12:49:45.871985 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:45.872219 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:45.872259 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:45.872316 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:45.872365 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:45.872425 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:45.872471 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:45.872509 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:45.872562 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:45.872596 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0808 12:49:45.891785 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:45.894849 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:45.895038 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:46.569857 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:46.714483 18255 iamrole.go:89] ListRoles: { } I0808 12:49:46.715452 18255 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0808 12:49:46.715806 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:46.715834 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:46.715984 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0808 12:49:46.715999 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:46.716108 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:46.716090 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0808 12:49:46.716173 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:49:46.716290 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0808 12:49:46.716331 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0808 12:49:46.716337 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0808 12:49:46.716429 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0808 12:49:46.716666 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:46.716866 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:46.717036 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:46.717146 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:46.717189 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0808 12:49:46.718335 18255 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0808 12:49:46.718471 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0808 12:49:46.718524 18255 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0808 12:49:46.718574 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0808 12:49:46.718663 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0808 12:49:46.718724 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:46.718843 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:46.718888 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0808 12:49:46.718983 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I0808 12:49:46.719006 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0808 12:49:46.719215 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I0808 12:49:46.719305 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:46.719239 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0808 12:49:46.719346 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:46.719375 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I0808 12:49:46.719433 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:46.719463 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:46.719490 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:46.719563 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0808 12:49:46.719644 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I0808 12:49:46.719685 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:46.719770 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:46.719823 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:46.719882 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] } I0808 12:49:46.720131 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0808 12:49:46.723021 18255 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0808 12:49:46.723146 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:46.723270 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:46.723459 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0808 12:49:46.723523 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0808 12:49:46.723724 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0808 12:49:46.723838 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:46.723936 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0808 12:49:46.724049 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0808 12:49:46.724252 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0808 12:49:46.724356 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0808 12:49:46.724470 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0808 12:49:46.724506 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" }] }] } I0808 12:49:46.724610 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" }] }] } I0808 12:49:46.724709 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" }] }] } I0808 12:49:46.724803 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0808 12:49:46.724838 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:46.724916 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:46.724997 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0808 12:49:46.725143 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0808 12:49:46.725260 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0808 12:49:46.725368 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0808 12:49:46.725478 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:46.725557 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:46.725635 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" }] }] } I0808 12:49:46.725771 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I0808 12:49:46.725960 18255 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0808 12:49:46.726224 18255 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0808 12:49:46.726428 18255 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0808 12:49:46.726462 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:46.726491 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:46.726543 18255 dns.go:235] Pre-creating DNS records I0808 12:49:46.726568 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:46.731042 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:46.733582 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:46.733645 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:47.405186 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:47.546683 18255 iamrole.go:89] ListRoles: { } I0808 12:49:47.547688 18255 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0808 12:49:47.548250 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.548858 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.548946 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:47.550001 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:49:47.550090 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0808 12:49:47.550126 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0808 12:49:47.550219 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:47.551526 18255 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0808 12:49:47.551687 18255 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0808 12:49:47.551677 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.551802 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0808 12:49:47.551944 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0808 12:49:47.551963 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:47.552000 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.552127 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:47.552156 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:47.552230 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0808 12:49:47.552349 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:47.555960 18255 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0808 12:49:47.556206 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:47.556361 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:47.556553 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:47.556698 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:47.556801 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:47.556877 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:47.556983 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:47.557333 18255 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0808 12:49:47.557508 18255 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0808 12:49:47.557692 18255 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0808 12:49:47.559833 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:49:47.559886 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:49:47.559911 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:49:47.559934 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:49:47.559954 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:49:47.559974 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:49:47.559997 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:49:47.560031 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:49:47.560057 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:49:47.560077 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:49:47.560095 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:47.560121 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:49:47.560142 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:47.560163 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:47.560185 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:47.560207 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:49:47.560227 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:49:47.560246 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:49:47.560268 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:47.560290 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:47.560317 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:49:47.561338 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:49:47.561390 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:49:47.561404 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:49:47.561435 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.561475 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0808 12:49:47.561515 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.561557 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.561586 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.561616 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.561683 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.561731 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0808 12:49:47.561784 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.561826 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0808 12:49:47.561850 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0808 12:49:47.561887 18255 api.go:53] PageSize not implemented I0808 12:49:47.561906 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:47.561928 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:47.561943 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:49:47.561961 18255 targetgroups.go:35] PageSize not implemented I0808 12:49:47.561976 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0808 12:49:47.562015 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:49:47.562045 18255 iamrole.go:89] ListRoles: { } I0808 12:49:47.562078 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:47.562098 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:47.562131 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:49:47.562162 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:47.562183 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:47.562502 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0808 12:49:47.562563 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } autoscaling-config:lt-1 ok autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I0808 12:49:47.562554 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } volume:vol-1 ok I0808 12:49:47.562643 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } autoscaling-group:nodes.sharedvpc.example.com ok I0808 12:49:47.562618 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } iam-instance-profile:masters.sharedvpc.example.com ok I0808 12:49:47.562688 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0808 12:49:47.562757 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I0808 12:49:47.562708 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0808 12:49:47.562666 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedvpc.example.com. ok W0808 12:49:47.562870 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:47.562894 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0808 12:49:47.562935 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:47.562983 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0808 12:49:47.563155 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:47.563176 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0808 12:49:47.563220 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0808 12:49:47.563335 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0808 12:49:47.563388 18255 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0808 12:49:47.563369 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0808 12:49:47.563401 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0808 12:49:47.563438 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0808 12:49:47.563464 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0808 12:49:47.563494 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0808 12:49:47.563505 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0808 12:49:47.563524 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0808 12:49:47.563567 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (1.69s) === RUN TestLifecycleComplex I0808 12:49:47.564045 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:47.564253 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:47.564285 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:47.564317 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:47.564344 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:47.564381 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:47.564412 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:47.564433 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:47.564459 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:47.564481 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0808 12:49:47.591611 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:47.596589 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:47.596732 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:48.290504 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:48.445826 18255 iamrole.go:89] ListRoles: { } I0808 12:49:48.449328 18255 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0808 12:49:48.449546 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0808 12:49:48.449904 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:48.450032 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0808 12:49:48.450239 18255 api.go:53] PageSize not implemented I0808 12:49:48.450209 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:48.450181 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:48.450325 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:48.450410 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:48.450483 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0808 12:49:48.450580 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] } I0808 12:49:48.450603 18255 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0808 12:49:48.450659 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0808 12:49:48.450713 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:48.450738 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" } ] } I0808 12:49:48.450840 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:48.450960 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:48.450996 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0808 12:49:48.451079 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0808 12:49:48.451106 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0808 12:49:48.451126 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:48.451153 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:48.451182 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:48.451302 18255 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0808 12:49:48.451392 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:48.451425 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:48.452133 18255 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0808 12:49:48.452275 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:48.452373 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0808 12:49:48.452266 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:48.452345 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:48.452418 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:48.452471 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" } ] }], VpcId: "vpc-1" } I0808 12:49:48.452543 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:48.452541 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0808 12:49:48.452648 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0808 12:49:48.452686 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:48.452582 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:48.452600 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:48.452787 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0808 12:49:48.452889 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:48.452939 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:48.452922 18255 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0808 12:49:48.452974 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:48.453029 18255 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:48.453063 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0808 12:49:48.453107 18255 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0808 12:49:48.453079 18255 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0808 12:49:48.453139 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:48.453177 18255 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:48.453215 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0808 12:49:48.453294 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0808 12:49:48.453291 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I0808 12:49:48.453388 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:48.453518 18255 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" } ] }] } I0808 12:49:48.453592 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:48.453675 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:48.453744 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:48.453802 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:48.453808 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" } ] }], VpcId: "vpc-1" } I0808 12:49:48.453880 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:48.453885 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0808 12:49:48.453934 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:48.453992 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" } ] }], VpcId: "vpc-1" } I0808 12:49:48.454102 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:48.454147 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:48.454182 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:49:48.454244 18255 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] } I0808 12:49:48.454317 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:48.454354 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0808 12:49:48.454431 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:49:48.454464 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:48.454504 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:48.454536 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:48.454573 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:49:48.454602 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:48.454397 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0808 12:49:48.454626 18255 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0808 12:49:48.454653 18255 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0808 12:49:48.454681 18255 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0808 12:49:48.454762 18255 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0808 12:49:48.454913 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0808 12:49:48.455091 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0808 12:49:48.455214 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0808 12:49:48.455383 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0808 12:49:48.455502 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0808 12:49:48.455579 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0808 12:49:48.455649 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0808 12:49:48.455774 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0808 12:49:48.455885 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:48.456018 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0808 12:49:48.456109 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0808 12:49:48.456156 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:48.456236 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:48.456293 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:48.456338 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:48.456398 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0808 12:49:48.456643 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" } ] }] } I0808 12:49:48.456788 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:48.456881 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:48.456970 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0808 12:49:48.457046 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0808 12:49:48.457179 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:48.457226 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0808 12:49:48.457316 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0808 12:49:48.457400 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0808 12:49:48.457515 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I0808 12:49:48.457562 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" } ] }] } I0808 12:49:48.457682 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0808 12:49:48.457803 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0808 12:49:48.457885 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0808 12:49:48.457995 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0808 12:49:48.458073 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0808 12:49:48.458190 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0808 12:49:48.458233 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0808 12:49:48.458267 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0808 12:49:48.458380 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" } ] }] } I0808 12:49:48.458496 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0808 12:49:48.458611 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0808 12:49:48.458692 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0808 12:49:48.458732 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0808 12:49:48.458763 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-1", TransitGatewayId: "tgw-0123456" } I0808 12:49:48.458874 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0808 12:49:48.458992 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0808 12:49:48.459077 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-1", TransitGatewayId: "tgw-123456" } I0808 12:49:48.459194 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0808 12:49:48.459333 18255 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0808 12:49:48.459415 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:48.459419 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0808 12:49:48.459559 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } W0808 12:49:48.459597 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:48.459606 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I0808 12:49:48.459703 18255 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-2" }], Tags: [ { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], Type: "network" } I0808 12:49:48.459784 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:48.459821 18255 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0808 12:49:48.459883 18255 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0808 12:49:48.459929 18255 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0808 12:49:48.459980 18255 api.go:53] PageSize not implemented I0808 12:49:48.460030 18255 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0808 12:49:48.460113 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:48.460186 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:48.460096 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:48.460281 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:48.460308 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:48.460291 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:48.460406 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:48.460449 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:48.460414 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:48.460462 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:48.464735 18255 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0808 12:49:48.464877 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:48.465014 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:48.465099 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:48.465242 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:48.465930 18255 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0808 12:49:48.466203 18255 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0808 12:49:48.466453 18255 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0808 12:49:48.466493 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:48.466523 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:48.466574 18255 dns.go:235] Pre-creating DNS records I0808 12:49:48.466593 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:48.472855 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:48.476183 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:48.476257 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:49.154552 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:49.310320 18255 iamrole.go:89] ListRoles: { } I0808 12:49:49.311863 18255 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0808 12:49:49.312059 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:49.312176 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:49.312208 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:49.312264 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0808 12:49:49.312401 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:49.312454 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0808 12:49:49.312597 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I0808 12:49:49.312724 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:49.312877 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0808 12:49:49.312989 18255 api.go:53] PageSize not implemented I0808 12:49:49.312999 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:49.313067 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:49.313122 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:49.314283 18255 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0808 12:49:49.314392 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:49.314456 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:49.314483 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:49.314447 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:49.314509 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:49.314562 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:49.314607 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:49.314628 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:49.314548 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:49.314723 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:49.314694 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:49.314797 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:49.314827 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:49.314922 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:49.315007 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:49.315069 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:49.315172 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:49.315206 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:49.315299 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:49.315390 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:49.315414 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:49.315511 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:49.315547 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:49.315607 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:49.315708 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:49.315941 18255 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0808 12:49:49.316100 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:49.316266 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:49.316447 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:49.316544 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:49.316616 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:49.316732 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:49.316796 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:49.316917 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:49.317201 18255 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0808 12:49:49.317260 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:49.317272 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:49.317339 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:49.317353 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:49.317385 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:49.317410 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:49.317436 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:49.317458 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:49.317478 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0808 12:49:49.317542 18255 api.go:53] PageSize not implemented I0808 12:49:49.317593 18255 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0808 12:49:49.317632 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:49.317667 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:49.317666 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:49.317704 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:49.317684 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:49.317727 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:49.317775 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:49.317772 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:49.317825 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:49.317839 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:49.317929 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:49.317981 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:49.318099 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:49.318128 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:49.322114 18255 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0808 12:49:49.322210 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:49.322329 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:49.322374 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:49.322496 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:49.323066 18255 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0808 12:49:49.323234 18255 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0808 12:49:49.323462 18255 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0808 12:49:49.328015 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:49.330935 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:49.340558 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:49.343930 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:49.343993 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:50.023636 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:50.176364 18255 iamrole.go:89] ListRoles: { } I0808 12:49:50.179764 18255 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0808 12:49:50.180187 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0808 12:49:50.180339 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I0808 12:49:50.180513 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:50.180897 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:50.180946 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:50.181004 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0808 12:49:50.181099 18255 api.go:53] PageSize not implemented I0808 12:49:50.181080 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:50.181252 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:50.181329 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:50.181353 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:50.181394 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:50.181523 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:50.182892 18255 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0808 12:49:50.182993 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:50.183072 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:50.183164 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:50.183178 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:50.183248 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:50.183280 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:50.183302 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:50.183337 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:50.183304 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:50.183465 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:50.183386 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:50.183533 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:50.183523 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:50.183604 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:50.183636 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:50.183793 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:50.183837 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:50.183970 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:50.184001 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:50.184069 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0808 12:49:50.184167 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:50.184192 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:50.184255 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:50.184314 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:50.184407 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:50.184694 18255 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0808 12:49:50.184866 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:50.184930 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:50.185257 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:50.185382 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:50.185467 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:50.185613 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:50.185727 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:50.185831 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:50.185961 18255 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0808 12:49:50.186025 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:50.186029 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:50.186137 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:50.186153 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:50.186184 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:50.186213 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:50.186241 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:50.186261 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:50.186282 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:50.186465 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0808 12:49:50.186514 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:50.186559 18255 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0808 12:49:50.186592 18255 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0808 12:49:50.186632 18255 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0808 12:49:50.186715 18255 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0808 12:49:50.186764 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:50.186787 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0808 12:49:50.186813 18255 api.go:53] PageSize not implemented I0808 12:49:50.186862 18255 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0808 12:49:50.186920 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:50.186952 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:50.186921 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:50.186983 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:50.187009 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:50.186997 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:50.187054 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:50.187072 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:50.187095 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:50.187176 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:50.187202 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:50.187288 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:50.187325 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:50.187337 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:50.191676 18255 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0808 12:49:50.191775 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:50.191905 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:50.191951 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:50.192085 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:50.192682 18255 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0808 12:49:50.192858 18255 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0808 12:49:50.193038 18255 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0808 12:49:50.193085 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:50.193116 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:50.193171 18255 dns.go:235] Pre-creating DNS records I0808 12:49:50.199342 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:50.202829 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:50.202902 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:50.878012 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:51.029594 18255 iamrole.go:89] ListRoles: { } I0808 12:49:51.030718 18255 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0808 12:49:51.032874 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:51.033110 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0808 12:49:51.033484 18255 api.go:53] PageSize not implemented I0808 12:49:51.034077 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0808 12:49:51.034441 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0808 12:49:51.034651 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.035011 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.034934 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:51.036249 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:51.036483 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.036579 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:51.036604 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:51.036648 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.038006 18255 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0808 12:49:51.038124 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:51.038142 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.038223 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:51.038268 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:51.038278 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:51.038269 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:51.038429 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:51.038519 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:51.038527 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:51.038552 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:51.038408 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.038645 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.038760 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:51.038793 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:51.038848 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:51.038971 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:51.039006 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.039083 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.039142 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.039241 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:51.039362 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:51.039416 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:51.039488 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.039579 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.039692 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.039801 18255 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0808 12:49:51.040057 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:51.040196 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:51.040286 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:51.040350 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:51.040460 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:51.040543 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:51.040689 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.040796 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:51.040929 18255 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0808 12:49:51.040978 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:51.041005 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:51.041086 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:51.041101 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.041134 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.041162 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:51.041190 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:51.041214 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:51.041236 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0808 12:49:51.041302 18255 api.go:53] PageSize not implemented I0808 12:49:51.041341 18255 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0808 12:49:51.041397 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:51.041433 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:51.041403 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:51.041455 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:51.041452 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:51.041477 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:51.041471 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.041571 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:51.041617 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:51.041639 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.041737 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:51.041778 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.041888 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:51.041909 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.045846 18255 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0808 12:49:51.045944 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.046073 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.046128 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.046258 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.046853 18255 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0808 12:49:51.047052 18255 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0808 12:49:51.047262 18255 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0808 12:49:51.049962 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:51.052905 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.062594 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:51.065998 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.066068 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.750522 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:51.906460 18255 iamrole.go:89] ListRoles: { } I0808 12:49:51.907895 18255 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0808 12:49:51.908197 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.908357 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:51.908411 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } W0808 12:49:51.908466 18255 api.go:53] PageSize not implemented I0808 12:49:51.908459 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:51.908593 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.908714 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:51.908860 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:51.908917 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0808 12:49:51.909027 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.909065 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0808 12:49:51.909133 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.909239 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0808 12:49:51.909308 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.910437 18255 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0808 12:49:51.910607 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.910666 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:51.910690 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.910745 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:51.910774 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:51.910862 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:51.910807 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:51.910909 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:51.910921 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:51.911012 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:51.911037 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:51.910976 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:51.911119 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:51.911244 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:51.911299 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.911393 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.911502 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.911608 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:51.911672 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0808 12:49:51.911801 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.911907 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:51.911938 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:51.912052 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:51.912085 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.912151 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:51.912252 18255 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0808 12:49:51.912390 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:51.912459 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:51.912619 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:51.912691 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:51.912926 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:51.913042 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:51.913171 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:51.913275 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:51.913411 18255 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0808 12:49:51.913464 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:51.913476 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:51.913547 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:51.913564 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.913609 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.913634 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:51.913661 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:51.913692 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:51.913714 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0808 12:49:51.913783 18255 api.go:53] PageSize not implemented I0808 12:49:51.913830 18255 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0808 12:49:51.913869 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:51.913904 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:51.913903 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:51.913944 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:51.913917 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.913968 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:51.913990 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:51.914000 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:51.914054 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:51.914071 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.914139 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:51.914189 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.914261 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:51.914280 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:51.918277 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:49:51.918415 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.918555 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.918616 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.918756 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.919382 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.919437 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.919555 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:49:51.919784 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:49:51.919965 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:49:51.920002 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:51.920023 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:51.920060 18255 dns.go:235] Pre-creating DNS records I0808 12:49:51.926131 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:51.929515 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:51.929580 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:52.604727 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:52.760608 18255 iamrole.go:89] ListRoles: { } I0808 12:49:52.761862 18255 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0808 12:49:52.762174 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0808 12:49:52.762351 18255 api.go:53] PageSize not implemented I0808 12:49:52.762373 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:52.762459 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0808 12:49:52.762574 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:52.762720 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0808 12:49:52.762766 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:52.762802 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0808 12:49:52.762873 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:52.762974 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:52.763047 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:52.763072 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:52.763119 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:52.763148 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:52.767210 18255 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0808 12:49:52.767390 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:52.767676 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:52.767922 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:52.768815 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:52.768864 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:52.768958 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:52.768991 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:52.768913 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:52.769043 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:52.769092 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:52.769114 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:52.769146 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:52.769348 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:52.769345 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:52.769417 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:52.769477 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:52.769594 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:52.769657 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:52.770221 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:52.770377 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:52.770441 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I0808 12:49:52.770599 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:52.770630 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:52.770735 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:52.770763 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:52.770869 18255 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0808 12:49:52.771016 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:52.771170 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:52.771259 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:52.771358 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:52.771459 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:52.771560 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:52.771704 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:52.771898 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:52.772093 18255 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0808 12:49:52.772142 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:52.772172 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:52.772235 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:52.772249 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:52.772275 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:52.772300 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:52.772327 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:52.772349 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:52.772369 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0808 12:49:52.772434 18255 api.go:53] PageSize not implemented I0808 12:49:52.772472 18255 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0808 12:49:52.772510 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:52.772545 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:52.772534 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:52.772578 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:52.772599 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:52.772568 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0808 12:49:52.772620 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0808 12:49:52.772632 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:52.772648 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:52.772723 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:52.772861 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:52.772892 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:52.772964 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:52.772981 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:52.777282 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:49:52.777370 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:52.777486 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:52.777562 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:52.777692 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:52.778131 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:49:52.778334 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:49:52.778527 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0808 12:49:52.782122 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:52.784819 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:52.784885 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:52.792417 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:52.795599 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:52.795664 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:52.795699 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:53.466416 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:53.616699 18255 iamrole.go:89] ListRoles: { } I0808 12:49:53.618512 18255 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0808 12:49:53.618682 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:53.618718 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:53.618848 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:53.618982 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0808 12:49:53.619080 18255 api.go:53] PageSize not implemented I0808 12:49:53.619077 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:53.619148 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0808 12:49:53.619203 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0808 12:49:53.619310 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0808 12:49:53.619385 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:53.619605 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:53.619708 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:53.619732 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:53.619775 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:53.621335 18255 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0808 12:49:53.621457 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:53.621534 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:53.621471 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:53.621595 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:53.621568 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:53.621623 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:53.621653 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:53.621697 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:53.621756 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:53.621774 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:53.621800 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:53.621817 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:53.621888 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:53.621993 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:53.622085 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:53.622204 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:53.622254 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:53.622409 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:53.622549 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:53.622582 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:53.622656 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:53.622758 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:53.622789 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:53.622853 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:53.622946 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:53.623073 18255 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0808 12:49:53.623282 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:53.623361 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:53.623467 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:53.623515 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:53.623667 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:53.623889 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:53.623997 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:53.624053 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:53.624149 18255 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0808 12:49:53.624200 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:53.624218 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:53.624291 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:53.624306 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:53.624345 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:53.624370 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:53.624399 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:53.624422 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:53.624444 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0808 12:49:53.624512 18255 api.go:53] PageSize not implemented I0808 12:49:53.624553 18255 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0808 12:49:53.624593 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:53.624633 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:53.624621 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:53.624671 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:53.624694 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:53.624715 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:53.624660 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:53.624811 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:53.624833 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:53.624909 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:53.624946 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:53.624979 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:53.625058 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:53.625079 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:53.629003 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:49:53.629094 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:53.629206 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:53.629249 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:53.629338 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:53.629835 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:49:53.630082 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:49:53.630270 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:49:53.630310 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:53.630340 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:53.630394 18255 dns.go:235] Pre-creating DNS records I0808 12:49:53.636594 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:53.639922 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:53.639988 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:53.640027 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.317402 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:54.471650 18255 iamrole.go:89] ListRoles: { } I0808 12:49:54.473249 18255 executor.go:111] Tasks: 0 done / 136 total; 52 can run W0808 12:49:54.473597 18255 api.go:53] PageSize not implemented I0808 12:49:54.473612 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:54.473778 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:54.473923 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:54.473946 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0808 12:49:54.474049 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:54.474140 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:54.474167 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:54.474213 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:54.474242 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:54.474315 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:54.474381 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0808 12:49:54.474442 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:54.474540 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0808 12:49:54.475829 18255 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0808 12:49:54.476005 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:54.476099 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:54.476181 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:54.475936 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:54.476222 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:54.476215 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:54.476295 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:54.476300 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:54.476361 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:54.476390 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:54.476363 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:54.476459 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0808 12:49:54.476578 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:54.476701 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:54.476730 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:54.476795 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:54.476853 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:54.476913 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:54.477007 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:54.477033 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:54.477191 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:54.477230 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:54.477332 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:54.477428 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:54.477543 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:54.477692 18255 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0808 12:49:54.477833 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:54.477989 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:54.478063 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:54.478226 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:54.478371 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:54.478534 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:54.478681 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:54.478808 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:54.478976 18255 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0808 12:49:54.479029 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:54.479093 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:54.479193 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:54.479214 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:54.479265 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:54.479289 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:54.479313 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:54.479334 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:54.479354 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0808 12:49:54.479418 18255 api.go:53] PageSize not implemented I0808 12:49:54.479452 18255 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0808 12:49:54.479486 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:54.479517 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:54.479527 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:54.479542 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:54.479598 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:54.479593 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:54.479657 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:54.479631 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:54.479703 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:54.479674 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:54.479745 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:54.479776 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:54.479887 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:54.479907 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:54.484032 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:49:54.484136 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.484266 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.484419 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.484549 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.485213 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:49:54.485458 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:49:54.485670 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0808 12:49:54.487991 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:54.490859 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.490930 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.490966 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.498713 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:54.502094 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.502162 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.502200 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:54.502235 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:55.177747 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:55.342970 18255 iamrole.go:89] ListRoles: { } I0808 12:49:55.344530 18255 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0808 12:49:55.345227 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:55.345241 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0808 12:49:55.345696 18255 api.go:53] PageSize not implemented I0808 12:49:55.345765 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0808 12:49:55.345856 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:55.346033 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:55.346290 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:55.346407 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:55.347706 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:55.347946 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0808 12:49:55.348080 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:55.348106 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:55.348152 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:55.348187 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0808 12:49:55.349420 18255 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0808 12:49:55.349547 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:55.349524 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:55.349676 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:55.349641 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:55.349753 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:55.349743 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:55.349843 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:55.349893 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:55.349809 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:55.349944 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:55.350034 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:55.350066 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:55.350056 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:55.350226 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:55.350343 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:55.350449 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:55.350479 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:55.350545 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:55.350639 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:55.350665 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:55.350771 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:55.350802 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:55.350890 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:55.350950 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:55.351004 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:55.351093 18255 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0808 12:49:55.351185 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:55.351297 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:55.351435 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:55.351646 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:55.351756 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:55.351872 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:55.351987 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:55.352040 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:55.352433 18255 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0808 12:49:55.352489 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:55.352508 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:55.352573 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:55.352589 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:55.352621 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:55.352646 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:55.352673 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:55.352695 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:55.352719 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0808 12:49:55.352787 18255 api.go:53] PageSize not implemented I0808 12:49:55.352832 18255 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0808 12:49:55.352869 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:55.352904 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:55.352897 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:55.352935 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:55.352921 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:55.353002 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:55.353059 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0808 12:49:55.353086 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:55.353119 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:55.353243 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:55.353312 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:55.353338 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:55.353487 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:55.353517 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:55.358438 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:49:55.358610 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:55.358771 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:55.358897 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:55.359030 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:55.359476 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:49:55.359753 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:49:55.359981 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:49:55.360023 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:55.360054 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:55.360111 18255 dns.go:235] Pre-creating DNS records I0808 12:49:55.366432 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0808 12:49:55.369960 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:55.370030 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:55.370071 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:55.370105 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:56.044246 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:56.187819 18255 iamrole.go:89] ListRoles: { } I0808 12:49:56.189356 18255 executor.go:111] Tasks: 0 done / 136 total; 52 can run W0808 12:49:56.189612 18255 api.go:53] PageSize not implemented I0808 12:49:56.189762 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0808 12:49:56.189846 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:56.189892 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0808 12:49:56.190036 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0808 12:49:56.190124 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.190256 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.190337 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.190457 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:56.190490 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:56.190519 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0808 12:49:56.190599 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0808 12:49:56.190663 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.190753 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:56.192685 18255 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0808 12:49:56.192817 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0808 12:49:56.192883 18255 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:56.192923 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0808 12:49:56.192931 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0808 12:49:56.193031 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:56.193146 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:56.193168 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } I0808 12:49:56.193057 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:56.193195 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0808 12:49:56.193247 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0808 12:49:56.193309 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:56.193299 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:56.193340 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } I0808 12:49:56.193368 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.193462 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0808 12:49:56.193560 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:56.193590 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:56.193620 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0808 12:49:56.193714 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:49:56.193769 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I0808 12:49:56.193879 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:56.193948 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:56.194006 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.194102 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:49:56.194128 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:56.194294 18255 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0808 12:49:56.194417 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.194563 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:56.194727 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:56.194994 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:56.195092 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:56.195227 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:56.195289 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0808 12:49:56.195341 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:49:56.195530 18255 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0808 12:49:56.195594 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:56.195647 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:56.195600 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:56.195661 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:56.195697 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:56.195723 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0808 12:49:56.195753 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4"] } I0808 12:49:56.195775 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5"] } I0808 12:49:56.195796 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0808 12:49:56.195861 18255 api.go:53] PageSize not implemented I0808 12:49:56.195896 18255 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0808 12:49:56.195951 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:56.195947 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0808 12:49:56.195985 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0808 12:49:56.195992 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:56.196005 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:56.196020 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0808 12:49:56.196030 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:49:56.196075 18255 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0808 12:49:56.196055 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:56.196107 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:56.196201 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:56.196293 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:56.196410 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0808 12:49:56.196433 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:56.200578 18255 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0808 12:49:56.200676 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:56.200802 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:56.200857 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:56.200994 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:56.201648 18255 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0808 12:49:56.201825 18255 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0808 12:49:56.202028 18255 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0808 12:49:56.202154 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:49:56.202196 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:56.202223 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:49:56.202243 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:49:56.202266 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:49:56.202286 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:49:56.202307 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:56.202330 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:49:56.202357 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:49:56.202386 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:49:56.202408 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:49:56.202427 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:56.202449 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:49:56.202470 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:49:56.202495 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:56.202519 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:56.202542 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:49:56.202569 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:56.202596 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:49:56.202616 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:49:56.202640 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0808 12:49:56.202666 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:49:56.202687 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:49:56.202710 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:56.202733 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:56.202757 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:56.202780 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:49:56.204845 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:49:56.204898 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:49:56.204914 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:49:56.204939 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.205009 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0808 12:49:56.205057 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.205097 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.205128 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.205170 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.205202 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.205232 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0808 12:49:56.205272 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.205318 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0808 12:49:56.205346 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0808 12:49:56.205388 18255 api.go:53] PageSize not implemented I0808 12:49:56.205403 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:56.205421 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:56.205432 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0808 12:49:56.205461 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:49:56.205478 18255 targetgroups.go:35] PageSize not implemented I0808 12:49:56.205491 18255 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" ] } I0808 12:49:56.205542 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:49:56.205569 18255 iamrole.go:89] ListRoles: { } I0808 12:49:56.205603 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:56.205624 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:56.205653 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:49:56.205686 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:56.205718 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } autoscaling-group:master-us-test-1a.masters.complex.example.com ok I0808 12:49:56.206137 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } autoscaling-group:nodes.complex.example.com ok I0808 12:49:56.206222 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0808 12:49:56.206287 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0808 12:49:56.206185 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 } ] } W0808 12:49:56.206356 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-instance-profile:masters.complex.example.com ok I0808 12:49:56.206205 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:56.206371 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.complex.example.com. ok I0808 12:49:56.206343 18255 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } security-group:sg-3 ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I0808 12:49:56.206396 18255 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0808 12:49:56.206397 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0808 12:49:56.206440 18255 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0808 12:49:56.206447 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I0808 12:49:56.206439 18255 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/5 ok I0808 12:49:56.206465 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:56.206507 18255 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/4 ok I0808 12:49:56.206500 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 } ] } W0808 12:49:56.206734 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:56.206750 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0808 12:49:56.206780 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0808 12:49:56.206865 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0808 12:49:56.206911 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0808 12:49:56.206951 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0808 12:49:56.206989 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:56.207034 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0808 12:49:56.207103 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0808 12:49:56.207136 18255 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0808 12:49:56.207113 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0808 12:49:56.207149 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0808 12:49:56.207172 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0808 12:49:56.207173 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0808 12:49:56.207200 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0808 12:49:56.207228 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0808 12:49:56.207237 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0808 12:49:56.207253 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0808 12:49:56.207298 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0808 12:49:56.207356 18255 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0808 12:49:56.207410 18255 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (8.64s) === RUN TestLifecycleExternalLB I0808 12:49:56.207876 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:56.208066 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:56.208095 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:56.208127 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:56.208154 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:56.208187 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:56.208215 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:56.208236 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:56.208260 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:56.208280 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0808 12:49:56.226984 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:56.229459 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:56.229593 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:56.909697 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:57.050837 18255 iamrole.go:89] ListRoles: { } I0808 12:49:57.051937 18255 executor.go:111] Tasks: 0 done / 107 total; 51 can run W0808 12:49:57.052174 18255 api.go:53] PageSize not implemented I0808 12:49:57.052283 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I0808 12:49:57.052331 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0808 12:49:57.052377 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0808 12:49:57.052488 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0808 12:49:57.052421 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] }] } I0808 12:49:57.052523 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0808 12:49:57.052457 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0808 12:49:57.052589 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:57.052644 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:57.052814 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:57.052846 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0808 12:49:57.052864 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.052943 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0808 12:49:57.052972 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } W0808 12:49:57.052988 18255 api.go:53] PageSize not implemented I0808 12:49:57.053041 18255 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.053029 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.053075 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0808 12:49:57.053103 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } W0808 12:49:57.053180 18255 api.go:53] PageSize not implemented I0808 12:49:57.053195 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0808 12:49:57.053153 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0808 12:49:57.053266 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0808 12:49:57.053233 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:57.053389 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:57.053461 18255 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0808 12:49:57.053593 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:57.053645 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0808 12:49:57.053672 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0808 12:49:57.053693 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:57.053723 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:57.053759 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:57.053888 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.054715 18255 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0808 12:49:57.054828 18255 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0808 12:49:57.054853 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.054926 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0808 12:49:57.054940 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0808 12:49:57.055009 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0808 12:49:57.055009 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0808 12:49:57.055072 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0808 12:49:57.055126 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:57.055220 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0808 12:49:57.055274 18255 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0808 12:49:57.055318 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.055376 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0808 12:49:57.055469 18255 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.055534 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:57.055572 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:57.055677 18255 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0808 12:49:57.055726 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.055885 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], VpcId: "vpc-1" } I0808 12:49:57.055898 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0808 12:49:57.056088 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:57.056171 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:57.056218 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:57.056248 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:57.056296 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:49:57.056386 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:57.056451 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:57.056490 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:57.056522 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:57.056549 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] } I0808 12:49:57.056651 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0808 12:49:57.059111 18255 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0808 12:49:57.059223 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:57.059293 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:57.059431 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0808 12:49:57.059482 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.059617 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:57.059726 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0808 12:49:57.059758 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0808 12:49:57.059848 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" }] }] } I0808 12:49:57.060012 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.060180 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.060267 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.060399 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.060550 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0808 12:49:57.060616 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.060753 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" }] }] } I0808 12:49:57.060907 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.061017 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0808 12:49:57.061112 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.061206 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0808 12:49:57.061297 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" }] }] } I0808 12:49:57.061389 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0808 12:49:57.061477 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0808 12:49:57.061578 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.061681 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.061757 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0808 12:49:57.062239 18255 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0808 12:49:57.062436 18255 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0808 12:49:57.062631 18255 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0808 12:49:57.062670 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:57.062698 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:57.062752 18255 dns.go:235] Pre-creating DNS records I0808 12:49:57.062776 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:57.068736 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:57.074204 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.074278 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.748490 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:57.890615 18255 iamrole.go:89] ListRoles: { } I0808 12:49:57.891811 18255 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0808 12:49:57.892125 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0808 12:49:57.892203 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0808 12:49:57.892229 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } W0808 12:49:57.892321 18255 api.go:53] PageSize not implemented I0808 12:49:57.892402 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:57.892453 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:57.892400 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0808 12:49:57.892534 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0808 12:49:57.892558 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0808 12:49:57.892543 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.892600 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0808 12:49:57.892634 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0808 12:49:57.892645 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } W0808 12:49:57.892608 18255 api.go:53] PageSize not implemented W0808 12:49:57.892703 18255 api.go:53] PageSize not implemented I0808 12:49:57.892669 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.892770 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.892862 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.892932 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:49:57.892955 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:49:57.892990 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:57.894548 18255 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0808 12:49:57.894654 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.894778 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.894878 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0808 12:49:57.894942 18255 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0808 12:49:57.894893 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0808 12:49:57.895065 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:57.895114 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:49:57.895164 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.895261 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:57.895325 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0808 12:49:57.895436 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:57.895478 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:49:57.899166 18255 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0808 12:49:57.899290 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:57.899421 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.899508 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:57.899650 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:57.899801 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.899909 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.900098 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.900727 18255 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0808 12:49:57.900918 18255 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0808 12:49:57.901123 18255 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0808 12:49:57.903420 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:49:57.903478 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:49:57.903506 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:49:57.903526 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:49:57.903545 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:49:57.903564 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:49:57.903584 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:49:57.903610 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:49:57.903631 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:49:57.903660 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:49:57.903684 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:49:57.903703 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:49:57.903724 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:49:57.903744 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:49:57.903764 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:57.903784 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:57.903807 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:49:57.903832 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:49:57.903851 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:49:57.903869 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:49:57.903886 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:57.903907 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:57.903932 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:49:57.903953 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:49:57.904945 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:49:57.905016 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:49:57.905032 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:49:57.905068 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.905106 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0808 12:49:57.905144 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.905187 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.905223 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.905267 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.905300 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.905327 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0808 12:49:57.905360 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.905396 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0808 12:49:57.905424 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0808 12:49:57.905463 18255 api.go:53] PageSize not implemented I0808 12:49:57.905480 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:57.905499 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:57.905513 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:49:57.905529 18255 targetgroups.go:35] PageSize not implemented I0808 12:49:57.905542 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0808 12:49:57.905579 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:49:57.905606 18255 iamrole.go:89] ListRoles: { } I0808 12:49:57.905641 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:57.905665 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:57.905694 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:49:57.905724 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:57.905749 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:49:57.906094 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:57.906148 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0808 12:49:57.906234 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok autoscaling-group:nodes.externallb.example.com ok I0808 12:49:57.906140 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } I0808 12:49:57.906266 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } W0808 12:49:57.906300 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:57.906301 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I0808 12:49:57.906320 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:57.906251 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.externallb.example.com. ok I0808 12:49:57.906386 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0808 12:49:57.906483 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:57.906502 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0808 12:49:57.906529 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0808 12:49:57.906563 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0808 12:49:57.906609 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0808 12:49:57.906644 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0808 12:49:57.906686 18255 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0808 12:49:57.906732 18255 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I0808 12:49:57.906803 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0808 12:49:57.906837 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0808 12:49:57.906815 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0808 12:49:57.906847 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0808 12:49:57.906871 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0808 12:49:57.906896 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0808 12:49:57.906926 18255 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0808 12:49:57.906934 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0808 12:49:57.906953 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0808 12:49:57.906992 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0808 12:49:57.907046 18255 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0808 12:49:57.907095 18255 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (1.70s) === RUN TestLifecycleSharedSubnet I0808 12:49:57.907549 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:57.907746 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:57.907777 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:57.907810 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:57.907836 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:57.907870 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:57.907899 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:57.907919 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:57.907946 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:57.907969 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0808 12:49:57.926252 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:57.928773 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:57.928899 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:58.639216 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:58.778652 18255 iamrole.go:89] ListRoles: { } I0808 12:49:58.779548 18255 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0808 12:49:58.780198 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0808 12:49:58.780291 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0808 12:49:58.780447 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:58.780575 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:58.780673 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:58.780818 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:58.780926 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:58.780952 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:58.780963 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:49:58.781047 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:58.781081 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0808 12:49:58.781193 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:49:58.781255 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0808 12:49:58.781277 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0808 12:49:58.781266 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0808 12:49:58.781327 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0808 12:49:58.782422 18255 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0808 12:49:58.782582 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0808 12:49:58.782661 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0808 12:49:58.782722 18255 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0808 12:49:58.782680 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0808 12:49:58.782820 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0808 12:49:58.782863 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0808 12:49:58.782934 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:58.782968 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:58.782970 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0808 12:49:58.783003 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0808 12:49:58.783128 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0808 12:49:58.783181 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:58.783209 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:58.783233 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:58.783312 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0808 12:49:58.783443 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:49:58.783474 18255 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] } I0808 12:49:58.784483 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0808 12:49:58.785739 18255 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0808 12:49:58.785872 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0808 12:49:58.786010 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0808 12:49:58.786106 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:58.786246 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:58.786375 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0808 12:49:58.786578 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" }] }] } I0808 12:49:58.786749 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:58.786836 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:58.787002 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0808 12:49:58.787177 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0808 12:49:58.787304 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" }] }] } I0808 12:49:58.787440 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0808 12:49:58.787541 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0808 12:49:58.787640 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" }] }] } I0808 12:49:58.787735 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0808 12:49:58.787830 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0808 12:49:58.787923 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" }] }] } I0808 12:49:58.788016 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0808 12:49:58.788118 18255 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0808 12:49:58.788370 18255 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0808 12:49:58.788619 18255 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0808 12:49:58.788656 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:58.788684 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:58.788737 18255 dns.go:235] Pre-creating DNS records I0808 12:49:58.788763 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:58.793339 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:58.795927 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:58.795993 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:59.474188 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:59.625120 18255 iamrole.go:89] ListRoles: { } I0808 12:49:59.626072 18255 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0808 12:49:59.626415 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.627147 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:49:59.627165 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:49:59.627255 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0808 12:49:59.627281 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0808 12:49:59.627644 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:49:59.627769 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.628713 18255 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0808 12:49:59.628833 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0808 12:49:59.628868 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:49:59.628945 18255 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0808 12:49:59.628947 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0808 12:49:59.629076 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:49:59.629123 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0808 12:49:59.629243 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0808 12:49:59.629359 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:59.633121 18255 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0808 12:49:59.633315 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:59.633435 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:59.633545 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:59.633670 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:59.634042 18255 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0808 12:49:59.634213 18255 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0808 12:49:59.634345 18255 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0808 12:49:59.636362 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:49:59.636413 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:49:59.636435 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:49:59.636455 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:49:59.636474 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:49:59.636493 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:49:59.636516 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:49:59.636550 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:49:59.636577 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:49:59.636597 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:49:59.636617 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:49:59.636635 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:49:59.636655 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:49:59.636676 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:49:59.636697 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:49:59.636716 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:49:59.636734 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:49:59.636754 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:49:59.636774 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:49:59.637781 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:49:59.637830 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:49:59.637843 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:49:59.637871 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.637907 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0808 12:49:59.637945 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.637986 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.638015 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.638043 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.638073 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.638096 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0808 12:49:59.638121 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.638150 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0808 12:49:59.638172 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0808 12:49:59.638207 18255 api.go:53] PageSize not implemented I0808 12:49:59.638223 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:49:59.638244 18255 loadbalancers.go:35] PageSize not implemented I0808 12:49:59.638258 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:49:59.638275 18255 targetgroups.go:35] PageSize not implemented I0808 12:49:59.638306 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0808 12:49:59.638348 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:49:59.638377 18255 iamrole.go:89] ListRoles: { } I0808 12:49:59.638412 18255 zones.go:93] ListHostedZonesPages { } I0808 12:49:59.638434 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:49:59.638466 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:49:59.638496 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:49:59.638774 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I0808 12:49:59.638821 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0808 12:49:59.638924 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:59.638901 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0808 12:49:59.638938 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0808 12:49:59.638955 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok I0808 12:49:59.638968 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0808 12:49:59.639026 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:49:59.638929 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedsubnet.example.com. ok I0808 12:49:59.639083 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0808 12:49:59.639120 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok autoscaling-group:nodes.sharedsubnet.example.com ok I0808 12:49:59.639091 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0808 12:49:59.639242 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:49:59.639261 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0808 12:49:59.639302 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok I0808 12:49:59.639384 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok I0808 12:49:59.639472 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0808 12:49:59.639513 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0808 12:49:59.639526 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0808 12:49:59.639557 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok I0808 12:49:59.639588 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0808 12:49:59.639620 18255 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0808 12:49:59.639629 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0808 12:49:59.639647 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (1.73s) === RUN TestLifecyclePrivateSharedSubnet I0808 12:49:59.640148 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:49:59.640377 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:49:59.640412 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:49:59.640448 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:49:59.640479 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:49:59.640517 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:49:59.640551 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:49:59.640574 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:49:59.640601 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:49:59.640623 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0808 12:49:59.662926 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:49:59.665736 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:59.665874 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:49:59.665919 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:00.345959 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:00.485466 18255 iamrole.go:89] ListRoles: { } I0808 12:50:00.486812 18255 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0808 12:50:00.487075 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:50:00.487080 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0808 12:50:00.487180 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0808 12:50:00.487213 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.487327 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:00.487474 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] }] } I0808 12:50:00.487582 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0808 12:50:00.487648 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] } I0808 12:50:00.487657 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:50:00.487789 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:50:00.487818 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:50:00.487843 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:50:00.487911 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0808 12:50:00.487932 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0808 12:50:00.487966 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:50:00.488054 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:50:00.488309 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0808 12:50:00.488401 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0808 12:50:00.489061 18255 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0808 12:50:00.489195 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0808 12:50:00.489298 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0808 12:50:00.489362 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0808 12:50:00.489447 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0808 12:50:00.489427 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0808 12:50:00.489474 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0808 12:50:00.489430 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0808 12:50:00.489548 18255 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0808 12:50:00.489564 18255 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0808 12:50:00.489597 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0808 12:50:00.489655 18255 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0808 12:50:00.489675 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:50:00.489668 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0808 12:50:00.489718 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:50:00.489749 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0808 12:50:00.489801 18255 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0808 12:50:00.489832 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0808 12:50:00.489780 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0808 12:50:00.489949 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0808 12:50:00.490030 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:50:00.490068 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:50:00.490097 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:50:00.490127 18255 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I0808 12:50:00.490179 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0808 12:50:00.490300 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I0808 12:50:00.490388 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:50:00.490430 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:50:00.490460 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0808 12:50:00.490619 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0808 12:50:00.490689 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:50:00.490763 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:50:00.490793 18255 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I0808 12:50:00.490841 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0808 12:50:00.490886 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:50:00.491306 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0808 12:50:00.491694 18255 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0808 12:50:00.491936 18255 api.go:53] PageSize not implemented I0808 12:50:00.491902 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:50:00.491967 18255 loadbalancers.go:35] PageSize not implemented I0808 12:50:00.491832 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0808 12:50:00.492044 18255 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I0808 12:50:00.492058 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:00.492136 18255 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] } I0808 12:50:00.492188 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:00.492094 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.492212 18255 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0808 12:50:00.492271 18255 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0808 12:50:00.492242 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" }] }] } I0808 12:50:00.492433 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.492551 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.492646 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0808 12:50:00.492803 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0808 12:50:00.492969 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" }] }] } I0808 12:50:00.493122 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0808 12:50:00.493176 18255 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } I0808 12:50:00.493167 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0808 12:50:00.493245 18255 api.go:53] PageSize not implemented I0808 12:50:00.493262 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:00.493265 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I0808 12:50:00.493412 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0808 12:50:00.493494 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.493597 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.493694 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0808 12:50:00.493797 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0808 12:50:00.493898 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0808 12:50:00.493969 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.494069 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.494163 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.494256 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.494360 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" }] }] } I0808 12:50:00.494457 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0808 12:50:00.494548 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I0808 12:50:00.494640 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:00.494717 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:00.494791 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I0808 12:50:00.494953 18255 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0808 12:50:00.495052 18255 api.go:53] PageSize not implemented I0808 12:50:00.495083 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:00.495097 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0808 12:50:00.495209 18255 api.go:53] PageSize not implemented I0808 12:50:00.495172 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:00.495254 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:00.495277 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:00.495345 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:00.499494 18255 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0808 12:50:00.499731 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:00.499820 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:00.499857 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:00.499948 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:00.500455 18255 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0808 12:50:00.500640 18255 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0808 12:50:00.500814 18255 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0808 12:50:00.500845 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:00.500874 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:50:00.500926 18255 dns.go:235] Pre-creating DNS records I0808 12:50:00.500946 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:50:00.505677 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:50:00.508342 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:00.508402 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:00.508441 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:01.183250 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:01.329959 18255 iamrole.go:89] ListRoles: { } I0808 12:50:01.331441 18255 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0808 12:50:01.331738 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:50:01.331877 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:50:01.331944 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0808 12:50:01.331972 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0808 12:50:01.332742 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] }] } I0808 12:50:01.333607 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:01.333955 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:50:01.335195 18255 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0808 12:50:01.335363 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0808 12:50:01.335332 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0808 12:50:01.335410 18255 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0808 12:50:01.335421 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0808 12:50:01.335500 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0808 12:50:01.335455 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0808 12:50:01.335535 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0808 12:50:01.335546 18255 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0808 12:50:01.335590 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:50:01.335631 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0808 12:50:01.335774 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:50:01.335827 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0808 12:50:01.335972 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0808 12:50:01.336118 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:50:01.336165 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:50:01.336298 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0808 12:50:01.336470 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:50:01.336822 18255 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0808 12:50:01.336979 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:50:01.337068 18255 loadbalancers.go:35] PageSize not implemented I0808 12:50:01.337085 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0808 12:50:01.337121 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0808 12:50:01.337146 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0808 12:50:01.337179 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0808 12:50:01.337207 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } W0808 12:50:01.337232 18255 api.go:53] PageSize not implemented W0808 12:50:01.337267 18255 api.go:53] PageSize not implemented I0808 12:50:01.337177 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:01.337284 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:01.337308 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:01.337315 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:01.337388 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:01.337416 18255 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0808 12:50:01.337541 18255 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0808 12:50:01.337607 18255 api.go:53] PageSize not implemented I0808 12:50:01.337666 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } W0808 12:50:01.337722 18255 api.go:53] PageSize not implemented I0808 12:50:01.337646 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:01.337773 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:01.337828 18255 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0808 12:50:01.337856 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:01.337909 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:01.337967 18255 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0808 12:50:01.337994 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:01.342955 18255 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0808 12:50:01.343140 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:01.343277 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:01.343344 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:01.343488 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:01.344053 18255 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0808 12:50:01.344161 18255 api.go:53] PageSize not implemented I0808 12:50:01.344186 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:01.344357 18255 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0808 12:50:01.344504 18255 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0808 12:50:01.347027 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:50:01.347077 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:50:01.347102 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:50:01.347125 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:50:01.347146 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:50:01.347169 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:50:01.347193 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:50:01.347220 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:50:01.347249 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0808 12:50:01.347273 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:50:01.347293 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:50:01.347315 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:50:01.347334 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:50:01.347356 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:50:01.347379 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:50:01.347400 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0808 12:50:01.347424 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:50:01.347446 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:50:01.347469 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:50:01.347488 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:50:01.347513 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:50:01.347557 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:50:01.348804 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:50:01.348862 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:50:01.348877 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:50:01.348907 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:01.348953 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0808 12:50:01.349004 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:01.349051 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:01.349081 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:01.349112 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:01.349145 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:01.349169 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0808 12:50:01.349197 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:01.349226 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0808 12:50:01.349249 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0808 12:50:01.349281 18255 api.go:53] PageSize not implemented I0808 12:50:01.349292 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0808 12:50:01.349322 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:50:01.349342 18255 loadbalancers.go:35] PageSize not implemented I0808 12:50:01.349354 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0808 12:50:01.349381 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:50:01.349398 18255 targetgroups.go:35] PageSize not implemented I0808 12:50:01.349412 18255 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I0808 12:50:01.349455 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:50:01.349489 18255 iamrole.go:89] ListRoles: { } I0808 12:50:01.349527 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:01.349549 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:50:01.349579 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:50:01.349611 18255 routetable.go:53] DescribeRouteTables: { } autoscaling-config:lt-1 ok I0808 12:50:01.350054 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok autoscaling-group:bastion.private-shared-subnet.example.com ok I0808 12:50:01.350082 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } autoscaling-group:nodes.private-shared-subnet.example.com ok I0808 12:50:01.350148 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok I0808 12:50:01.350110 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:50:01.350162 18255 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I0808 12:50:01.350192 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0808 12:50:01.350235 18255 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } load-balancer:api-private-shared-subnet-n2f8ak ok I0808 12:50:01.350254 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0808 12:50:01.350201 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } iam-instance-profile:nodes.private-shared-subnet.example.com ok W0808 12:50:01.350302 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:50:01.350287 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0808 12:50:01.350317 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } I0808 12:50:01.350310 18255 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok I0808 12:50:01.350331 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0808 12:50:01.350337 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } security-group:sg-4 ok I0808 12:50:01.350214 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.private-shared-subnet.example.com. ok I0808 12:50:01.350372 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0808 12:50:01.350525 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:50:01.350543 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0808 12:50:01.350573 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0808 12:50:01.350638 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:50:01.350683 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0808 12:50:01.350801 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:50:01.350820 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0808 12:50:01.350852 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-3 ok I0808 12:50:01.350949 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0808 12:50:01.350983 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:50:01.350998 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0808 12:50:01.351035 18255 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0808 12:50:01.351049 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0808 12:50:01.351074 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } I0808 12:50:01.351024 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } iam-role:masters.private-shared-subnet.example.com ok I0808 12:50:01.351099 18255 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com W0808 12:50:01.351099 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:50:01.351111 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0808 12:50:01.351123 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0808 12:50:01.351134 18255 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I0808 12:50:01.351157 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0808 12:50:01.351187 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0808 12:50:01.351197 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0808 12:50:01.351216 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (1.71s) === RUN TestLifecyclePrivateSharedIP I0808 12:50:01.351725 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:50:01.351935 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:50:01.351967 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:50:01.352009 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:50:01.352035 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:50:01.352070 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:50:01.352110 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:50:01.352123 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:50:01.352141 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:50:01.352155 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0808 12:50:01.364526 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:50:01.366120 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:01.366202 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:01.366225 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.039692 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:02.182867 18255 iamrole.go:89] ListRoles: { } I0808 12:50:02.184346 18255 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0808 12:50:02.184818 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:02.184903 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0808 12:50:02.184944 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:50:02.184994 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:50:02.185037 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0808 12:50:02.185098 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:50:02.185553 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:50:02.185702 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.185818 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:50:02.185884 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0808 12:50:02.185907 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0808 12:50:02.185943 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:02.185977 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0808 12:50:02.186054 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0808 12:50:02.186078 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:50:02.186182 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:50:02.186205 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0808 12:50:02.186308 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0808 12:50:02.187381 18255 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0808 12:50:02.187532 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0808 12:50:02.187585 18255 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0808 12:50:02.187663 18255 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0808 12:50:02.187549 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0808 12:50:02.187697 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0808 12:50:02.187700 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0808 12:50:02.187760 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0808 12:50:02.187739 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:02.187817 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0808 12:50:02.187850 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0808 12:50:02.187832 18255 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0808 12:50:02.187921 18255 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.timeout_seconds", Value: "30" },{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0808 12:50:02.187925 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:50:02.187971 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0808 12:50:02.187963 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0808 12:50:02.188019 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0808 12:50:02.188016 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:02.188145 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I0808 12:50:02.188156 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] }] } I0808 12:50:02.188286 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-12345678" } I0808 12:50:02.188318 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0808 12:50:02.188469 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0808 12:50:02.188536 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:50:02.188568 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:50:02.188594 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0808 12:50:02.188652 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:50:02.188679 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:50:02.188701 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0808 12:50:02.188823 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0808 12:50:02.188883 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] }] } I0808 12:50:02.188949 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0808 12:50:02.189031 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:50:02.189063 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] } I0808 12:50:02.189115 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0808 12:50:02.189168 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0808 12:50:02.189200 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:50:02.189234 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:50:02.189263 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:50:02.189285 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:50:02.189317 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:50:02.189341 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0808 12:50:02.189427 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I0808 12:50:02.189458 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:50:02.189501 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:50:02.189528 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:50:02.189358 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0808 12:50:02.189556 18255 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] } I0808 12:50:02.189652 18255 executor.go:111] Tasks: 74 done / 132 total; 36 can run W0808 12:50:02.189739 18255 api.go:53] PageSize not implemented I0808 12:50:02.189748 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:02.189856 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0808 12:50:02.189905 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0808 12:50:02.189834 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:02.189896 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:50:02.189983 18255 loadbalancers.go:35] PageSize not implemented I0808 12:50:02.189976 18255 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-ip.example.com" }] } I0808 12:50:02.189948 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.190050 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:02.190114 18255 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0808 12:50:02.190178 18255 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0808 12:50:02.190092 18255 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0808 12:50:02.190084 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.190370 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0808 12:50:02.190483 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:02.190609 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0808 12:50:02.190664 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.190805 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.190990 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" }] }] } I0808 12:50:02.191126 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:50:02.191192 18255 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0808 12:50:02.191277 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:02.191349 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.191486 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0808 12:50:02.191596 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:50:02.191670 18255 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } I0808 12:50:02.191653 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } W0808 12:50:02.191753 18255 api.go:53] PageSize not implemented I0808 12:50:02.191768 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:02.191806 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.191930 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" }] }] } I0808 12:50:02.192051 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.192173 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0808 12:50:02.192213 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0808 12:50:02.192248 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:50:02.192355 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.192482 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0808 12:50:02.192559 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.192664 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0808 12:50:02.192757 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0808 12:50:02.192799 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0808 12:50:02.192892 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.192979 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.193073 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I0808 12:50:02.193141 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.193236 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" }] }] } I0808 12:50:02.193329 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" }] }] } I0808 12:50:02.193428 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0808 12:50:02.193520 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.193601 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.193666 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:50:02.193697 18255 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0808 12:50:02.193757 18255 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0808 12:50:02.193833 18255 api.go:53] PageSize not implemented I0808 12:50:02.193841 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:02.193884 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:02.193884 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:02.193855 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0808 12:50:02.193927 18255 api.go:53] PageSize not implemented I0808 12:50:02.193942 18255 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:50:02.193963 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:02.193969 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:02.194045 18255 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0808 12:50:02.194125 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0808 12:50:02.194086 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:02.194157 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:50:02.194188 18255 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0808 12:50:02.198132 18255 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0808 12:50:02.198278 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.198384 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.198485 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.198580 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.198654 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:50:02.198798 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0808 12:50:02.199136 18255 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0808 12:50:02.199343 18255 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0808 12:50:02.199520 18255 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0808 12:50:02.199568 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:02.199603 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:50:02.199669 18255 dns.go:235] Pre-creating DNS records I0808 12:50:02.199696 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:50:02.204529 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:50:02.207327 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.207406 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.207454 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:02.884152 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:03.026070 18255 iamrole.go:89] ListRoles: { } I0808 12:50:03.027487 18255 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0808 12:50:03.027794 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.027964 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.028791 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:50:03.028820 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:50:03.028945 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0808 12:50:03.029021 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0808 12:50:03.029060 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0808 12:50:03.030494 18255 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0808 12:50:03.030588 18255 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0808 12:50:03.030661 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0808 12:50:03.030666 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0808 12:50:03.030698 18255 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0808 12:50:03.030707 18255 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0808 12:50:03.030702 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.030828 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0808 12:50:03.030971 18255 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0808 12:50:03.030979 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:50:03.031020 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0808 12:50:03.031123 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:50:03.031158 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] }] } I0808 12:50:03.031262 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0808 12:50:03.031292 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0808 12:50:03.031401 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:50:03.031433 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0808 12:50:03.031525 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:50:03.031563 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0808 12:50:03.031659 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.031752 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:50:03.031781 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.032155 18255 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0808 12:50:03.032237 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:50:03.032301 18255 loadbalancers.go:35] PageSize not implemented I0808 12:50:03.032324 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0808 12:50:03.032354 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0808 12:50:03.032305 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:03.032378 18255 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0808 12:50:03.032403 18255 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0808 12:50:03.032402 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0808 12:50:03.032423 18255 api.go:53] PageSize not implemented I0808 12:50:03.032429 18255 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0808 12:50:03.032440 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:03.032446 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:03.032523 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:03.032554 18255 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0808 12:50:03.032533 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0808 12:50:03.032614 18255 api.go:53] PageSize not implemented I0808 12:50:03.032645 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:03.032852 18255 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0808 12:50:03.032921 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:50:03.032988 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:03.033169 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:03.033259 18255 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0808 12:50:03.033317 18255 api.go:53] PageSize not implemented I0808 12:50:03.033364 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W0808 12:50:03.033440 18255 api.go:53] PageSize not implemented I0808 12:50:03.033419 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:50:03.033486 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:03.033505 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0808 12:50:03.033318 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:03.033578 18255 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0808 12:50:03.033596 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:03.033653 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0808 12:50:03.033695 18255 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0808 12:50:03.033715 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:03.037843 18255 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0808 12:50:03.037931 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0808 12:50:03.038031 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:03.038147 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:03.038265 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:03.038396 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:03.038752 18255 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0808 12:50:03.038832 18255 api.go:53] PageSize not implemented I0808 12:50:03.038845 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:03.038981 18255 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0808 12:50:03.039190 18255 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0808 12:50:03.041619 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:50:03.041700 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:50:03.041725 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:50:03.041749 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:50:03.041769 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:50:03.041789 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:50:03.041813 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:50:03.041841 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:50:03.041869 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0808 12:50:03.041894 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0808 12:50:03.041921 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:50:03.041942 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:50:03.041965 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:50:03.041987 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:50:03.042008 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0808 12:50:03.042030 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:50:03.042053 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:50:03.042074 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0808 12:50:03.042097 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0808 12:50:03.042119 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:50:03.042144 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:50:03.042164 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0808 12:50:03.042186 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:50:03.042207 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:50:03.042225 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:50:03.042248 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:50:03.042272 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:50:03.043399 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:50:03.043456 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:50:03.043471 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:50:03.043502 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.043553 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0808 12:50:03.043601 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.043648 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.043678 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.043711 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.043742 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.043773 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0808 12:50:03.043811 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.043850 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:50:03.043871 18255 natgateway.go:117] DescribeNatGateways: { } I0808 12:50:03.043901 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0808 12:50:03.043926 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0808 12:50:03.043962 18255 api.go:53] PageSize not implemented I0808 12:50:03.043976 18255 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0808 12:50:03.044005 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:50:03.044025 18255 loadbalancers.go:35] PageSize not implemented I0808 12:50:03.044038 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0808 12:50:03.044065 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:50:03.044083 18255 targetgroups.go:35] PageSize not implemented I0808 12:50:03.044096 18255 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" ] } I0808 12:50:03.044140 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:50:03.044171 18255 iamrole.go:89] ListRoles: { } I0808 12:50:03.044208 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:03.044229 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:50:03.044259 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:50:03.044299 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:50:03.044325 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0808 12:50:03.044352 18255 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0808 12:50:03.044378 18255 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I0808 12:50:03.044879 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0808 12:50:03.044898 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } autoscaling-group:nodes.private-shared-ip.example.com ok I0808 12:50:03.044952 18255 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0808 12:50:03.044932 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I0808 12:50:03.044985 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } volume:vol-1 ok I0808 12:50:03.045036 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0808 12:50:03.045081 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0808 12:50:03.045068 18255 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } iam-instance-profile:bastions.private-shared-ip.example.com ok load-balancer:api-private-shared-ip-exa-ohatqj ok I0808 12:50:03.045117 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0808 12:50:03.045053 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } I0808 12:50:03.045156 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } autoscaling-group:bastion.private-shared-ip.example.com ok iam-instance-profile:nodes.private-shared-ip.example.com ok W0808 12:50:03.045179 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions iam-instance-profile:masters.private-shared-ip.example.com ok I0808 12:50:03.045133 18255 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I0808 12:50:03.045007 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.private-shared-ip.example.com. ok I0808 12:50:03.045199 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0808 12:50:03.045267 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0808 12:50:03.045356 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0808 12:50:03.045404 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W0808 12:50:03.045591 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:50:03.045610 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-3 ok I0808 12:50:03.045668 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0808 12:50:03.045720 18255 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0808 12:50:03.045762 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0808 12:50:03.045797 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0808 12:50:03.045879 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:50:03.045890 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0808 12:50:03.045960 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I0808 12:50:03.046002 18255 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0808 12:50:03.045988 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0808 12:50:03.046015 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0808 12:50:03.046070 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0808 12:50:03.046101 18255 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0808 12:50:03.046107 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:50:03.046132 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I0808 12:50:03.046167 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0808 12:50:03.046179 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0808 12:50:03.046203 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I0808 12:50:03.046147 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W0808 12:50:03.046241 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:50:03.046258 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0808 12:50:03.046227 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0808 12:50:03.046291 18255 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0808 12:50:03.046303 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0808 12:50:03.046329 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0808 12:50:03.046402 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0808 12:50:03.046451 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (1.70s) === RUN TestLifecycleManyAddons I0808 12:50:03.046928 18255 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:50:03.047132 18255 internetgateways.go:66] CreateInternetGateway: { } I0808 12:50:03.047162 18255 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:50:03.047194 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:50:03.047222 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:50:03.047255 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:50:03.047284 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:50:03.047304 18255 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:50:03.047330 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:50:03.047349 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0808 12:50:03.069439 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:50:03.073946 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:03.074089 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:03.752887 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:04.381231 18255 iamrole.go:89] ListRoles: { } I0808 12:50:04.381915 18255 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0808 12:50:04.382053 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:04.382195 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:50:04.382297 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:50:04.382344 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:50:04.382370 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0808 12:50:04.382391 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:04.382467 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0808 12:50:04.382559 18255 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.382603 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:04.382719 18255 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.382784 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:50:04.382820 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0808 12:50:04.382842 18255 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0808 12:50:04.382863 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:50:04.382888 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:50:04.383799 18255 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0808 12:50:04.383998 18255 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" }] } I0808 12:50:04.384328 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:04.384572 18255 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0808 12:50:04.384898 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:50:04.385355 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:50:04.385643 18255 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.391934 18255 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0808 12:50:04.392055 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0808 12:50:04.392208 18255 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0808 12:50:04.392213 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:04.392362 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0808 12:50:04.392380 18255 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.392441 18255 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0808 12:50:04.392458 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:50:04.392566 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0808 12:50:04.392516 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0808 12:50:04.392630 18255 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0808 12:50:04.392701 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:50:04.392788 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:50:04.392772 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0808 12:50:04.392834 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:50:04.392915 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0808 12:50:04.393108 18255 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0808 12:50:04.393185 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:50:04.393225 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:50:04.393252 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:50:04.393751 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:50:04.393886 18255 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0808 12:50:04.393940 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I0808 12:50:04.394018 18255 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0808 12:50:04.394062 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:50:04.394100 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:50:04.394131 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0808 12:50:04.394250 18255 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0808 12:50:04.394314 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:50:04.394347 18255 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] } I0808 12:50:04.394708 18255 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0808 12:50:04.396819 18255 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0808 12:50:04.396900 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:04.396970 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.397152 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.397277 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.397425 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.397525 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0808 12:50:04.397557 18255 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0808 12:50:04.397627 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0808 12:50:04.397723 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:04.397817 18255 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0808 12:50:04.397898 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.398065 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.398170 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:04.398229 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.398341 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0808 12:50:04.398443 18255 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.398530 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" }] }] } I0808 12:50:04.398626 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:04.398701 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:04.398794 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.398966 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0808 12:50:04.399083 18255 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0808 12:50:04.399133 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:04.399219 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:04.399292 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" }] }] } I0808 12:50:04.399427 18255 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0808 12:50:04.400029 18255 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0808 12:50:04.400225 18255 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0808 12:50:04.400459 18255 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0808 12:50:04.400504 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:04.400535 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:50:04.400592 18255 dns.go:235] Pre-creating DNS records I0808 12:50:04.400616 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:50:04.405296 18255 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0808 12:50:04.407993 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:04.408057 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:05.084450 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:05.750216 18255 iamrole.go:89] ListRoles: { } I0808 12:50:05.750880 18255 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0808 12:50:05.751323 18255 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0808 12:50:05.751692 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.751907 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.752122 18255 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0808 12:50:05.752219 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.754791 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.754937 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:50:05.755005 18255 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:50:05.755059 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:50:05.758699 18255 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0808 12:50:05.758841 18255 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0808 12:50:05.758801 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:50:05.758988 18255 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0808 12:50:05.758939 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.759102 18255 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:50:05.759144 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0808 12:50:05.759295 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.759421 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:50:05.759467 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0808 12:50:05.759578 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:50:05.759619 18255 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:50:05.759689 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.763535 18255 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0808 12:50:05.763761 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:05.763867 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:05.763985 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:05.764084 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:05.764213 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:05.764341 18255 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0808 12:50:05.764513 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0808 12:50:05.764658 18255 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0808 12:50:05.764821 18255 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0808 12:50:05.764940 18255 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0808 12:50:05.767257 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0808 12:50:05.767311 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0808 12:50:05.767337 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0808 12:50:05.767360 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0808 12:50:05.767380 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0808 12:50:05.767400 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0808 12:50:05.767424 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0808 12:50:05.767445 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0808 12:50:05.767465 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0808 12:50:05.767493 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0808 12:50:05.767519 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0808 12:50:05.767543 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0808 12:50:05.767563 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0808 12:50:05.767583 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0808 12:50:05.767603 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:50:05.767622 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0808 12:50:05.767643 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:50:05.767663 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0808 12:50:05.767682 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0808 12:50:05.767700 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0808 12:50:05.767718 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0808 12:50:05.767739 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0808 12:50:05.767761 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:50:05.767781 18255 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0808 12:50:05.769489 18255 delete_cluster.go:128] Looking for cloud resources to delete W0808 12:50:05.769543 18255 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0808 12:50:05.769559 18255 keypairs.go:95] DescribeKeyPairs: { } I0808 12:50:05.769589 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.769625 18255 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0808 12:50:05.769661 18255 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.769700 18255 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.769731 18255 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.769768 18255 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.769797 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.769822 18255 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0808 12:50:05.769853 18255 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.769886 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0808 12:50:05.769912 18255 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0808 12:50:05.769941 18255 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0808 12:50:05.769964 18255 api.go:53] PageSize not implemented I0808 12:50:05.769978 18255 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0808 12:50:05.769999 18255 loadbalancers.go:35] PageSize not implemented I0808 12:50:05.770013 18255 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0808 12:50:05.770030 18255 targetgroups.go:35] PageSize not implemented I0808 12:50:05.770043 18255 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0808 12:50:05.770080 18255 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0808 12:50:05.770110 18255 iamrole.go:89] ListRoles: { } I0808 12:50:05.770143 18255 zones.go:93] ListHostedZonesPages { } I0808 12:50:05.770164 18255 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0808 12:50:05.770193 18255 internetgateways.go:101] DescribeInternetGateways: { } I0808 12:50:05.770223 18255 routetable.go:53] DescribeRouteTables: { } I0808 12:50:05.770248 18255 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-group:nodes.minimal.example.com ok I0808 12:50:05.770589 18255 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I0808 12:50:05.770658 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0808 12:50:05.770697 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } volume:vol-2 ok I0808 12:50:05.770738 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0808 12:50:05.770725 18255 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } iam-instance-profile:nodes.minimal.example.com ok volume:vol-1 ok autoscaling-config:lt-1 ok I0808 12:50:05.770636 18255 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok I0808 12:50:05.770764 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0808 12:50:05.770761 18255 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0808 12:50:05.770813 18255 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0808 12:50:05.770804 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0808 12:50:05.770975 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:50:05.770993 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0808 12:50:05.771017 18255 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0808 12:50:05.771058 18255 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0808 12:50:05.771080 18255 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0808 12:50:05.771112 18255 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0808 12:50:05.771189 18255 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0808 12:50:05.771199 18255 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0808 12:50:05.771263 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0808 12:50:05.771296 18255 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0808 12:50:05.771279 18255 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0808 12:50:05.771307 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0808 12:50:05.771329 18255 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0808 12:50:05.771351 18255 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0808 12:50:05.771378 18255 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0808 12:50:05.771387 18255 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0808 12:50:05.771406 18255 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0808 12:50:05.771446 18255 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0808 12:50:05.771502 18255 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0808 12:50:05.771551 18255 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (2.73s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 133.773s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.005s ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0808 12:47:52.021604 18258 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.003s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I0808 12:47:52.037599 18263 pod.go:59] starting pod controller I0808 12:47:52.037733 18263 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS I0808 12:47:52.037805 18263 pod.go:107] Got stop signal ok k8s.io/kops/dns-controller/pkg/watchers 0.021s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.003s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035630} route53_test.go:93: Got zone list: [0xc000035660] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000baa48} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035760} route53_test.go:93: Got zone list: [0xc000035790] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000baa58} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000035860} route53_test.go:170: Successfully added managed DNS zone: &{0xc000359e00 0xc0000baa70} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000359e0} route53_test.go:93: Got zone list: [0xc000035a10] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000baa88} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035b40} route53_test.go:93: Got zone list: [0xc000035b70] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000baaa8} route53_test.go:187: Successfully added resource record set: {0xc00035dd40 0xc0000baac8} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035e20} route53_test.go:93: Got zone list: [0xc000035e50] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000bab50} route53_test.go:199: Successfully added resource record set: {0xc00035def0 0xc0000bab70} route53_test.go:118: Got 1 recordsets: [0xc000406070] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0004061d0} route53_test.go:93: Got zone list: [0xc000406200] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000bac08} route53_test.go:221: Successfully added resource record set: {0xc000404120 0xc0000bac28} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000404120 0xc0000bac28}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000406590} route53_test.go:93: Got zone list: [0xc0004065c0] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000bace0} route53_test.go:246: Successfully removed resource set {0xc000404360 0xc0000bad00} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000406870} route53_test.go:93: Got zone list: [0xc0004068a0] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000bad88} route53_test.go:264: Successfully removed resource set {0xc000404510 0xc0000bada8} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000406b80} route53_test.go:93: Got zone list: [0xc000406bb0] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000bae38} commontests.go:192: Successfully added resource record set: {0xc0004046c0 0xc0000bae58} commontests.go:45: Correctly replaced resource record {0xc0004046c0 0xc0000bae58} -> {0xc0004047e0 0xc0000baea8} commontests.go:142: Got 1 recordsets: [0xc000406ec0] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0004070c0} route53_test.go:93: Got zone list: [0xc0004070f0] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000baf58} commontests.go:192: Successfully added resource record set: {0xc000404ab0 0xc0000baf78} commontests.go:70: Correctly replaced resource record {0xc000404ab0 0xc0000baf78} -> {0xc000404bd0 0xc0000bafc8} commontests.go:142: Got 1 recordsets: [0xc000407400] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000407650} route53_test.go:93: Got zone list: [0xc000407680] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000bb088} commontests.go:192: Successfully added resource record set: {0xc000404ea0 0xc0000bb0a8} commontests.go:142: Got 2 recordsets: [0xc0004078f0 0xc000407910] commontests.go:142: Got 2 recordsets: [0xc000407980 0xc0004079a0] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000407b70} route53_test.go:93: Got zone list: [0xc000407ba0] route53_test.go:98: Got at least 1 zone in list:&{0xc000359bc0 0xc0000bb1a8} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.012s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.005s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5120} clouddns_test.go:71: Got zone list: [0xc00041af60] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041af30} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5220} clouddns_test.go:71: Got zone list: [0xc00041b020] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041aff0} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5320} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc00038b500 0xc00041b0e0} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f53e0} clouddns_test.go:71: Got zone list: [0xc00041b1a0] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041b170} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5500} clouddns_test.go:71: Got zone list: [0xc00041b2d8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041b2a8} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5640} clouddns_test.go:71: Got zone list: [0xc00041b440] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041b410} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f57a0} clouddns_test.go:71: Got zone list: [0xc00041b650] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041b620} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5900} clouddns_test.go:71: Got zone list: [0xc00041b7e8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041b7b8} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5a40} clouddns_test.go:71: Got zone list: [0xc00041b950] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041b920} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5ba0} clouddns_test.go:71: Got zone list: [0xc00041bb18] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041bae8} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5d00} clouddns_test.go:71: Got zone list: [0xc00041bde8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc00041bdb8} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc0000f5e80} clouddns_test.go:71: Got zone list: [0xc000132a08] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc0001329a8} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0003bc0b8 0xc00013ab80} clouddns_test.go:71: Got zone list: [0xc0001331e8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc00038b180 0xc000133188} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.044s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.019s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.004s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.048s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0808 12:47:55.186616 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.186837 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.186877 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.186920 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.186953 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.186997 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.187030 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.187044 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.187085 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.187108 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.194413 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I0808 12:47:55.197856 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.197994 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.198015 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.198037 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.198055 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.198078 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.198098 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.198112 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.198131 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.198144 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.198951 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I0808 12:47:55.202084 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.202183 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.202214 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.202235 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.202253 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.202280 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.202298 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.202312 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.202329 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.202341 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.203152 18943 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.204481 18943 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0808 12:47:55.204495 18943 assetstore.go:111] bin/containerd I0808 12:47:55.204504 18943 assetstore.go:111] bin/containerd-shim I0808 12:47:55.204509 18943 assetstore.go:111] bin/containerd-shim-runc-v1 I0808 12:47:55.204515 18943 assetstore.go:111] bin/containerd-shim-runc-v2 I0808 12:47:55.204520 18943 assetstore.go:111] bin/containerd-stress I0808 12:47:55.204525 18943 assetstore.go:111] bin/ctr I0808 12:47:55.204556 18943 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0808 12:47:55.204566 18943 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I0808 12:47:55.208718 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.208803 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.208819 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.208835 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.208848 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.208862 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.208875 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.208883 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.208894 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.208902 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.209550 18943 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.210457 18943 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0808 12:47:55.211093 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.211189 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.211204 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.211217 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.211229 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.211243 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.211254 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.211262 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.211279 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.211288 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.211852 18943 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.212904 18943 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0808 12:47:55.213284 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.213362 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.213390 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.213403 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.213416 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.213429 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.213440 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.213448 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.213458 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.213465 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.213985 18943 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.214885 18943 assetstore.go:108] Matching assets for "^docker/": I0808 12:47:55.214895 18943 assetstore.go:111] docker/containerd I0808 12:47:55.214899 18943 assetstore.go:111] docker/containerd-shim I0808 12:47:55.214902 18943 assetstore.go:111] docker/ctr I0808 12:47:55.214904 18943 assetstore.go:111] docker/docker I0808 12:47:55.214907 18943 assetstore.go:111] docker/docker-init I0808 12:47:55.214909 18943 assetstore.go:111] docker/docker-proxy I0808 12:47:55.214912 18943 assetstore.go:111] docker/dockerd I0808 12:47:55.214914 18943 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.00s) === RUN TestDockerBuilder_LogFlags I0808 12:47:55.216491 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.216564 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.216577 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.216589 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.216599 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.216612 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.216623 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.216631 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.216650 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.216659 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.217151 18943 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.218020 18943 assetstore.go:108] Matching assets for "^docker/": I0808 12:47:55.218039 18943 assetstore.go:111] docker/containerd I0808 12:47:55.218043 18943 assetstore.go:111] docker/containerd-shim I0808 12:47:55.218046 18943 assetstore.go:111] docker/ctr I0808 12:47:55.218049 18943 assetstore.go:111] docker/docker I0808 12:47:55.218051 18943 assetstore.go:111] docker/docker-init I0808 12:47:55.218054 18943 assetstore.go:111] docker/docker-proxy I0808 12:47:55.218056 18943 assetstore.go:111] docker/dockerd I0808 12:47:55.218058 18943 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.00s) === RUN TestDockerBuilder_SkipInstall I0808 12:47:55.219568 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.219652 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.219664 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.219676 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.219686 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.219698 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.219710 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.219719 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.219729 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.219739 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.220206 18943 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.221029 18943 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0808 12:47:55.221125 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.221202 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.221214 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.221228 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.221240 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.221253 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.221264 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.221272 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.221284 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.221295 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.221907 18943 zones.go:93] ListHostedZonesPages { } I0808 12:47:55.223111 18943 assetstore.go:108] Matching assets for "^docker/": I0808 12:47:55.223124 18943 assetstore.go:111] docker/docker I0808 12:47:55.223130 18943 assetstore.go:111] docker/docker-containerd I0808 12:47:55.223134 18943 assetstore.go:111] docker/docker-containerd-ctr I0808 12:47:55.223139 18943 assetstore.go:111] docker/docker-containerd-shim I0808 12:47:55.223143 18943 assetstore.go:111] docker/docker-init I0808 12:47:55.223147 18943 assetstore.go:111] docker/docker-proxy I0808 12:47:55.223151 18943 assetstore.go:111] docker/docker-runc I0808 12:47:55.223154 18943 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.00s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0808 12:47:55.225663 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.225748 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.225761 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.225774 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.225786 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.225799 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.225810 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.225819 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.225839 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.225847 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.227080 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.00s) === RUN TestDockerHooksBuilder I0808 12:47:55.228413 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.228491 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.228503 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.228515 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.228525 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.228552 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.228564 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.228572 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.228583 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.228589 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.229591 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.00s) === RUN TestKopsControllerBuilder I0808 12:47:55.230951 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.231028 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.231041 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.231052 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.231061 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.231074 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.231085 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.231094 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.231105 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.231112 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.234613 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.01s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0808 12:47:55.237843 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.237955 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.237970 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.237985 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.237996 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.238009 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.238021 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.238029 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.238039 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.238048 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.238936 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I0808 12:47:55.243892 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.243970 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.243983 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.243996 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.244007 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.244023 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.244035 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.244050 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.244062 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.244070 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.245200 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0808 12:47:55.249172 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.249250 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.249263 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.249275 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.249286 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.249300 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.249312 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.249321 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.249331 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.249339 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.250343 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I0808 12:47:55.256473 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.256642 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.256673 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.256706 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.256726 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.256756 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.256781 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.256795 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.256816 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.256834 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.258422 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0808 12:47:55.263781 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.263904 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.263924 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.263948 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.263963 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.263983 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.264001 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.264011 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.264024 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.264036 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.265267 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I0808 12:47:55.268999 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.269101 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.269116 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.269131 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.269145 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.269162 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.269175 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.269185 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.269199 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.269209 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.270184 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0808 12:47:55.277096 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:55.277256 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:55.277283 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:55.277314 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:55.277337 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:55.277364 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:55.277392 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:55.277407 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:55.277430 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:55.277445 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:55.279307 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.90s) === RUN TestKubeAPIServerBuilderARM64 I0808 12:47:57.181488 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:57.181659 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:57.181689 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:57.181717 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:57.181737 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:57.181765 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:57.181787 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:57.181801 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:57.181821 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:57.181836 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:57.183376 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.36s) === RUN TestKubeControllerManagerBuilder I0808 12:47:58.539441 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:58.539645 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:58.539682 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:58.539729 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:58.539757 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:58.539790 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:58.539820 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:58.539841 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:58.539869 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:58.539889 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:58.542041 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0808 12:47:58.550131 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:58.550330 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:58.550366 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:58.550399 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:58.550427 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:58.550462 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:58.550492 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:58.550513 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:58.550540 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:58.550560 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:58.552691 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.36s) === RUN TestKubeControllerManagerBuilderARM64 I0808 12:47:59.908183 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:47:59.908422 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:47:59.908461 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:47:59.908501 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:47:59.908528 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:47:59.908567 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:47:59.908600 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:47:59.908620 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:47:59.908646 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:47:59.908673 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:47:59.910865 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.35s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0808 12:48:01.260592 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:01.260720 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:01.260743 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:01.260768 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:01.260784 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:01.260804 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:01.260824 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:01.260835 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:01.260850 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:01.260863 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:01.262053 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.00s) === RUN TestKubeProxyBuilderAMD64 I0808 12:48:01.265582 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:01.265718 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:01.265743 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:01.265767 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:01.265786 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:01.265810 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:01.265830 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:01.265843 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:01.265862 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:01.265877 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:01.267267 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.34s) === RUN TestKubeProxyBuilderARM64 I0808 12:48:02.609481 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:02.609682 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:02.609718 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:02.609755 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:02.609784 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:02.609817 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:02.609851 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:02.609870 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:02.609896 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:02.609917 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:02.612019 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.36s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0808 12:48:03.972910 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:03.973121 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:03.973157 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:03.973195 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:03.973224 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:03.973260 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:03.973291 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:03.973310 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:03.973338 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:03.973359 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:03.975446 18943 zones.go:93] ListHostedZonesPages { } W0808 12:48:03.978776 18943 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0808 12:48:03.980910 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:03.981076 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:03.981104 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:03.981131 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:03.981155 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:03.981183 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:03.981208 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:03.981227 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:03.981251 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:03.981269 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:03.983218 18943 zones.go:93] ListHostedZonesPages { } W0808 12:48:05.341159 18943 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.36s) === RUN TestKubeSchedulerBuilderARM64 I0808 12:48:05.343534 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:05.343751 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:05.343787 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:05.343826 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:05.343855 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:05.343891 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:05.343925 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:05.343944 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:05.343971 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:05.343992 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:05.346155 18943 zones.go:93] ListHostedZonesPages { } W0808 12:48:06.698253 18943 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.36s) === RUN TestKubectlBuilder I0808 12:48:06.700793 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:06.700986 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:06.701020 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:06.701052 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:06.701079 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:06.701114 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:06.701145 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:06.701166 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:06.701192 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:06.701211 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:06.703249 18943 zones.go:93] ListHostedZonesPages { } I0808 12:48:06.705519 18943 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0808 12:48:06.707959 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:06.708125 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:06.708153 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:06.708180 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:06.708205 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:06.708233 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:06.708256 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:06.708274 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:06.708298 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:06.708339 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:06.709887 18943 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I0808 12:48:06.716441 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:06.716613 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:06.716643 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:06.716674 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:06.716699 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:06.716736 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:06.716761 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:06.716779 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:06.716802 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:06.716819 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:06.718281 18943 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0808 12:48:06.722673 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:06.722843 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:06.722872 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:06.722898 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:06.722922 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:06.722950 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:06.722982 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:06.723001 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:06.723026 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:06.723043 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:06.724906 18943 zones.go:93] ListHostedZonesPages { } I0808 12:48:06.727149 18943 assetstore.go:108] Matching assets for "protokube$": I0808 12:48:06.727172 18943 assetstore.go:111] /opt/kops/bin/protokube I0808 12:48:06.727185 18943 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0808 12:48:06.727209 18943 assetstore.go:108] Matching assets for "channels$": I0808 12:48:06.727219 18943 assetstore.go:111] /opt/kops/bin/channels I0808 12:48:06.727236 18943 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I0808 12:48:06.728899 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:06.729061 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:06.729089 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:06.729114 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:06.729139 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:06.729170 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:06.729201 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:06.729219 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:06.729242 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:06.729259 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:06.731148 18943 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0808 12:48:06.734179 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:06.734336 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:06.734364 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:06.734390 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:06.734417 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:06.734447 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:06.734471 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:06.734496 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:06.734519 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:06.734537 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:06.736441 18943 zones.go:93] ListHostedZonesPages { } I0808 12:48:06.738658 18943 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.00s) === RUN TestUpdateServiceBuilderExternal I0808 12:48:06.739145 18943 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:06.739302 18943 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:06.739334 18943 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:06.739362 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:06.739387 18943 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:06.739416 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:06.739448 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:06.739467 18943 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:06.739490 18943 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:06.739507 18943 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:06.741376 18943 zones.go:93] ListHostedZonesPages { } I0808 12:48:06.743580 18943 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 11.619s ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.024s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.026s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.021s ? k8s.io/kops/pkg/apis/kops/registry [no test files] === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0808 12:47:55.138568 18947 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0808 12:47:55.138652 18947 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.006s ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0808 12:47:56.666847 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.666933 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.666953 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.666975 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.666991 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0808 12:47:56.667094 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667112 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667121 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667132 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667145 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667168 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667181 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667190 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667202 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667214 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667224 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667235 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667244 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667251 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667259 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667272 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667280 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667289 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0808 12:47:56.667298 19212 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0808 12:47:56.667378 19212 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0808 12:47:56.667413 19212 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.068s ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.014s ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0808 12:47:56.646579 19215 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0808 12:47:56.647565 19215 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0808 12:47:56.648765 19215 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0808 12:47:56.649439 19215 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0808 12:47:56.650067 19215 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0808 12:47:56.650693 19215 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host W0808 12:47:56.651270 19215 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0808 12:47:56.651873 19215 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0808 12:47:56.651883 19215 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0808 12:47:56.651890 19215 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0808 12:47:56.651897 19215 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.045s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.005s ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.061s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.024s ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.111s ? k8s.io/kops/pkg/commands/commandutils [no test files] === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.087s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.031s ? k8s.io/kops/pkg/configserver [no test files] === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.004s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.003s ? k8s.io/kops/pkg/dump [no test files] === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.035s === RUN TestFlagToFalse I0808 12:47:56.632007 19433 featureflag_test.go:32] Created flag Unittest1 I0808 12:47:56.632044 19433 featureflag.go:164] FeatureFlag "UnitTest1"=false I0808 12:47:56.632050 19433 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0808 12:47:56.632089 19433 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.003s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.023s === RUN TestRenderInstanceGroupZones W0808 12:47:56.727836 19706 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.021s === RUN TestWarmPoolOnlyRoll I0808 12:48:09.283998 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.284096 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.284113 21027 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0808 12:48:09.284478 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.284505 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.285625 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.285648 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.290860 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.290917 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.290936 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.290949 21027 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0808 12:48:09.292495 21027 instancegroups.go:431] Draining the node: "master-1a.local". I0808 12:48:09.293014 21027 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0808 12:48:09.293101 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:09.293126 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.294430 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.294446 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.299633 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.299689 21027 instancegroups.go:431] Draining the node: "master-1b.local". I0808 12:48:09.300258 21027 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0808 12:48:09.300310 21027 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0808 12:48:09.300331 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.301432 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.301451 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.306632 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.306660 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.306679 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.306687 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.307395 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.307854 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.307879 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.309007 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.309028 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.314755 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.314805 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.315400 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.315422 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.316557 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.316591 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.321790 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.321844 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:09.322423 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:09.322447 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.323577 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.323614 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.328815 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.328840 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.328849 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.328856 21027 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0808 12:48:09.329245 21027 instancegroups.go:431] Draining the node: "node-2a.local". I0808 12:48:09.329521 21027 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0808 12:48:09.329537 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.330727 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.330742 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.335987 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.336033 21027 instancegroups.go:431] Draining the node: "node-2b.local". I0808 12:48:09.336482 21027 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0808 12:48:09.336501 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.337624 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.337662 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.344616 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.344680 21027 instancegroups.go:431] Draining the node: "node-2c.local". I0808 12:48:09.345253 21027 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0808 12:48:09.345271 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.346367 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.346381 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.351566 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.351605 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0808 12:48:09.351988 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.352009 21027 instancegroups.go:469] waiting for 1ms after terminating instance W0808 12:48:09.353123 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.353148 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.353165 21027 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0808 12:48:09.353174 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:09.353188 21027 instancegroups.go:469] waiting for 1ms after terminating instance W0808 12:48:09.354287 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.354309 21027 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0808 12:48:09.354317 21027 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0808 12:48:09.354331 21027 instancegroups.go:469] waiting for 1ms after terminating instance W0808 12:48:09.355417 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.355433 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.355455 21027 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0808 12:48:09.355467 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.355480 21027 instancegroups.go:469] waiting for 1ms after terminating instance W0808 12:48:09.356584 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.356603 21027 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0808 12:48:09.356608 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.356618 21027 instancegroups.go:469] waiting for 1ms after terminating instance W0808 12:48:09.357713 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.357736 21027 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0808 12:48:09.357746 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:09.357770 21027 instancegroups.go:469] waiting for 1ms after terminating instance W0808 12:48:09.358866 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.358882 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.358907 21027 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0808 12:48:09.358916 21027 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0808 12:48:09.358929 21027 instancegroups.go:469] waiting for 1ms after terminating instance W0808 12:48:09.360016 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.360040 21027 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0808 12:48:09.360048 21027 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0808 12:48:09.360060 21027 instancegroups.go:469] waiting for 1ms after terminating instance W0808 12:48:09.361156 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0808 12:48:09.361183 21027 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0808 12:48:09.361192 21027 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0808 12:48:09.361206 21027 instancegroups.go:469] waiting for 1ms after terminating instance W0808 12:48:09.362296 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0808 12:48:09.362315 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0808 12:48:09.362545 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.362559 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.363692 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.363710 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.363721 21027 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.363742 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.363749 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.363755 21027 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.363760 21027 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0808 12:48:09.364098 21027 instancegroups.go:431] Draining the node: "master-1a.local". I0808 12:48:09.364352 21027 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0808 12:48:09.364385 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:09.364395 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.365486 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.365501 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.365508 21027 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.365526 21027 instancegroups.go:431] Draining the node: "master-1b.local". I0808 12:48:09.365883 21027 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0808 12:48:09.365913 21027 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0808 12:48:09.365922 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.367010 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.367025 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.367033 21027 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.367041 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.367047 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.367052 21027 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.367057 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.367404 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.367648 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.367661 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.368742 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.368754 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.368765 21027 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.368780 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.369089 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.369100 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.370210 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.370227 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.370236 21027 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.370255 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:09.370638 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:09.370659 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.371766 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.371786 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.371799 21027 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.371809 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.371819 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.371828 21027 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.371835 21027 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0808 12:48:09.372386 21027 instancegroups.go:431] Draining the node: "node-2a.local". I0808 12:48:09.372823 21027 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0808 12:48:09.372844 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.373891 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.373907 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.373915 21027 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.373931 21027 instancegroups.go:431] Draining the node: "node-2b.local". I0808 12:48:09.374232 21027 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0808 12:48:09.374245 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.375320 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.375334 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.375342 21027 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.375355 21027 instancegroups.go:431] Draining the node: "node-2c.local". I0808 12:48:09.375599 21027 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0808 12:48:09.375613 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.376697 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.376709 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0808 12:48:09.376717 21027 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0808 12:48:09.376726 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.01s) === RUN TestRollingUpdateNoneNeedUpdate I0808 12:48:09.376865 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0808 12:48:09.376995 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.377006 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.378471 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.378488 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.383645 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.383698 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.383708 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.383718 21027 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0808 12:48:09.384082 21027 instancegroups.go:431] Draining the node: "master-1a.local". I0808 12:48:09.384318 21027 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0808 12:48:09.384356 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:09.384371 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.385435 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.385447 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.390609 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.390651 21027 instancegroups.go:431] Draining the node: "master-1b.local". I0808 12:48:09.391041 21027 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0808 12:48:09.391078 21027 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0808 12:48:09.391092 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.392199 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.392219 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.397418 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.397470 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.397486 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.397496 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.398116 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.398579 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.398601 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.399897 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.399932 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.405123 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.405203 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.405648 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.405670 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.406785 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.406806 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.412026 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.412079 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:09.412656 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:09.412676 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.413776 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.413796 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.418989 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.419062 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.419094 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.419105 21027 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0808 12:48:09.419711 21027 instancegroups.go:431] Draining the node: "node-2a.local". I0808 12:48:09.420130 21027 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0808 12:48:09.420154 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.421672 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.421694 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.426887 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.426946 21027 instancegroups.go:431] Draining the node: "node-2b.local". I0808 12:48:09.427515 21027 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0808 12:48:09.427538 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.428644 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.428661 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.433861 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.433924 21027 instancegroups.go:431] Draining the node: "node-2c.local". I0808 12:48:09.434516 21027 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0808 12:48:09.434543 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.435664 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.435688 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.440871 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.440907 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.06s) === RUN TestRollingUpdateEmptyGroup I0808 12:48:09.441044 21027 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0808 12:48:09.441311 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.441330 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.442478 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.442517 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0808 12:48:09.442535 21027 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0808 12:48:09.442830 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.442850 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.443973 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.443997 21027 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0808 12:48:09.444014 21027 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0808 12:48:09.444200 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.444215 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0808 12:48:09.444225 21027 instancegroups.go:509] Cluster did not validate within 0s E0808 12:48:09.444235 21027 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0808 12:48:09.444324 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.444335 21027 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0808 12:48:09.444344 21027 instancegroups.go:509] Cluster did not validate within 0s E0808 12:48:09.444353 21027 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0808 12:48:09.444484 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.444503 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.445615 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.445628 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.450815 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.450863 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.450874 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.450881 21027 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0808 12:48:09.451233 21027 instancegroups.go:431] Draining the node: "master-1a.local". I0808 12:48:09.451496 21027 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0808 12:48:09.451529 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:09.451542 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.452650 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.452675 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0808 12:48:09.452688 21027 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0808 12:48:09.454701 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.454738 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.456821 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.456878 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.462138 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.462214 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.462235 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.462245 21027 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0808 12:48:09.462832 21027 instancegroups.go:431] Draining the node: "master-1a.local". I0808 12:48:09.463253 21027 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0808 12:48:09.463308 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:09.463327 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.464436 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.464451 21027 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0808 12:48:09.464460 21027 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0808 12:48:09.464610 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.464619 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.464623 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.464946 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.465206 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.465219 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.466310 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.466324 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.471493 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.471531 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.471937 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.471954 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.473056 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.473078 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.478283 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.478324 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:09.478725 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:09.478740 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.479834 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.479850 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.485055 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.485081 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0808 12:48:09.485254 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.485265 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0808 12:48:09.485273 21027 instancegroups.go:509] Cluster did not validate within 0s E0808 12:48:09.485280 21027 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0808 12:48:09.485374 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.485382 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0808 12:48:09.485389 21027 instancegroups.go:509] Cluster did not validate within 0s E0808 12:48:09.485395 21027 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0808 12:48:09.485485 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.485493 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0808 12:48:09.485498 21027 instancegroups.go:509] Cluster did not validate within 0s E0808 12:48:09.485504 21027 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0808 12:48:09.485613 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.485621 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.485626 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.486011 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.486287 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.486302 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.487575 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.487599 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.492773 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.492824 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.493452 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.493475 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.494589 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.494609 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.499776 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.499819 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:09.500409 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:09.500431 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.501552 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.501568 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.506726 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.506745 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.506761 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0808 12:48:09.506775 21027 instancegroups.go:509] Cluster did not validate within 0s E0808 12:48:09.506789 21027 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0808 12:48:09.507009 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.507024 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.507034 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.507688 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.508119 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.508139 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.509226 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.509252 21027 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0808 12:48:09.509260 21027 instancegroups.go:509] Cluster did not validate within 0s E0808 12:48:09.509267 21027 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0808 12:48:09.509358 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.509367 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.509372 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.509695 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.509953 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.509967 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.511067 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.511085 21027 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0808 12:48:09.511099 21027 instancegroups.go:509] Cluster did not validate within 0s E0808 12:48:09.511111 21027 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0808 12:48:09.511302 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.511319 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.512412 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.512438 21027 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0808 12:48:09.513525 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.518686 21027 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0808 12:48:09.519780 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.524979 21027 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0808 12:48:09.526074 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.531239 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.531293 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.531311 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.531322 21027 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0808 12:48:09.531866 21027 instancegroups.go:431] Draining the node: "master-1a.local". I0808 12:48:09.532300 21027 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0808 12:48:09.532346 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:09.532366 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.533482 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.533505 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.538692 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.538742 21027 instancegroups.go:431] Draining the node: "master-1b.local". I0808 12:48:09.539264 21027 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0808 12:48:09.539311 21027 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0808 12:48:09.539329 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.540429 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.540464 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.545673 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.545696 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.545706 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.545713 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.546095 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.546376 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.546390 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.547487 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.547510 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.552709 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.552767 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.553259 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.553275 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.554370 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.554390 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.559589 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.559629 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:09.560042 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:09.560057 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.561151 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.561175 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.566314 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.566339 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.566350 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.566357 21027 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0808 12:48:09.566739 21027 instancegroups.go:431] Draining the node: "node-2a.local". I0808 12:48:09.567018 21027 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0808 12:48:09.567032 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.568117 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.568132 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.573270 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.573298 21027 instancegroups.go:431] Draining the node: "node-2b.local". I0808 12:48:09.573668 21027 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0808 12:48:09.573683 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.574796 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.574822 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.580043 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.580085 21027 instancegroups.go:431] Draining the node: "node-2c.local". I0808 12:48:09.580494 21027 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0808 12:48:09.580511 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.581662 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.581682 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.586906 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.586948 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I0808 12:48:09.587255 21027 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0808 12:48:09.587272 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.589683 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.589719 21027 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0808 12:48:09.590819 21027 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0808 12:48:09.591926 21027 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0808 12:48:09.593027 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.598219 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.598267 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.598277 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.598284 21027 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0808 12:48:09.598639 21027 instancegroups.go:431] Draining the node: "master-1a.local". I0808 12:48:09.598881 21027 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0808 12:48:09.598916 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:09.598929 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.600022 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.600036 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.605201 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.605252 21027 instancegroups.go:431] Draining the node: "master-1b.local". I0808 12:48:09.605798 21027 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0808 12:48:09.605847 21027 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0808 12:48:09.605868 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.606952 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.606969 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.612135 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.612172 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.612183 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.612191 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.612748 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.613155 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.613175 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.614287 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.614301 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.619442 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.619476 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.619806 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.619820 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.620920 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.620936 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.626074 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.626113 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:09.626505 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:09.626527 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.627623 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.627638 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.632796 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.632819 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.632830 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.632838 21027 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0808 12:48:09.633430 21027 instancegroups.go:431] Draining the node: "node-2a.local". I0808 12:48:09.633829 21027 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0808 12:48:09.633850 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.634964 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.634985 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.640154 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.640194 21027 instancegroups.go:431] Draining the node: "node-2b.local". I0808 12:48:09.640969 21027 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0808 12:48:09.640990 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.642110 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.642131 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.647331 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.647383 21027 instancegroups.go:431] Draining the node: "node-2c.local". I0808 12:48:09.647983 21027 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0808 12:48:09.648005 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.649121 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.649139 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.654293 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.654317 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0808 12:48:09.654707 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.654720 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.654727 21027 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0808 12:48:09.655126 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.655430 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.655444 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.656575 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.656587 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.661750 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.661777 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.662128 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.662145 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.663282 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.663294 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.668423 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.668442 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0808 12:48:09.668598 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.668608 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.668612 21027 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0808 12:48:09.668901 21027 instancegroups.go:431] Draining the node: "master-1a.local". I0808 12:48:09.669152 21027 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0808 12:48:09.669182 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:09.669194 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.670336 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.670349 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.675542 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.675568 21027 instancegroups.go:431] Draining the node: "master-1b.local". I0808 12:48:09.675933 21027 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0808 12:48:09.675970 21027 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0808 12:48:09.675984 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.677101 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.677113 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.682274 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.682291 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0808 12:48:09.682460 21027 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0808 12:48:09.682477 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0808 12:48:09.682485 21027 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0808 12:48:09.682490 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0808 12:48:09.682496 21027 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0808 12:48:09.682499 21027 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0808 12:48:09.682505 21027 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0808 12:48:09.682510 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0808 12:48:09.682599 21027 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0808 12:48:09.682619 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:09.683751 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.683763 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.688950 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.688965 21027 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0808 12:48:09.688988 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.688996 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.689001 21027 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0808 12:48:09.689342 21027 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0808 12:48:09.689359 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.689366 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.689371 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:09.689661 21027 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0808 12:48:09.689685 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:09.690816 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.690827 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.695954 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.695980 21027 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0808 12:48:09.695990 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.695999 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.696009 21027 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0808 12:48:09.696547 21027 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0808 12:48:09.696582 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:09.697719 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.697732 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:09.702909 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.702927 21027 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0808 12:48:09.702939 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0808 12:48:09.703094 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.703108 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.703113 21027 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0808 12:48:09.703872 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.704146 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.704164 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.705258 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.705279 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.705298 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:09.705366 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.705786 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.705907 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:09.705923 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.707024 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.707041 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.807431 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.807472 21027 instancegroups.go:431] Draining the node: "node-1e.local". I0808 12:48:09.807523 21027 instancegroups.go:431] Draining the node: "node-1d.local". I0808 12:48:09.808094 21027 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0808 12:48:09.808188 21027 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0808 12:48:09.808205 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.809298 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.809322 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.809341 21027 instancegroups.go:431] Draining the node: "node-1f.local". I0808 12:48:09.809772 21027 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0808 12:48:09.809800 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.810909 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.810931 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.911275 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.911326 21027 instancegroups.go:431] Draining the node: "node-1g.local". I0808 12:48:09.911900 21027 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0808 12:48:09.911929 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.913025 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.913045 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.913058 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0808 12:48:09.913204 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.913219 21027 instancegroups.go:540] Cluster validated. I0808 12:48:09.913227 21027 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0808 12:48:09.914132 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:09.914186 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:09.914720 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:09.914844 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:09.914863 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:09.915955 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:09.915979 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.016339 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.016403 21027 instancegroups.go:431] Draining the node: "node-1d.local". I0808 12:48:10.016409 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:10.016983 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:10.017256 21027 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0808 12:48:10.017282 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.018387 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.018410 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.018430 21027 instancegroups.go:431] Draining the node: "node-1e.local". I0808 12:48:10.018840 21027 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0808 12:48:10.018861 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.019972 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.020007 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.120340 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.120390 21027 instancegroups.go:431] Draining the node: "node-1f.local". I0808 12:48:10.120938 21027 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0808 12:48:10.120967 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.122072 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.122097 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.122111 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0808 12:48:10.122270 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.122287 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.122296 21027 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0808 12:48:10.123427 21027 instancegroups.go:431] Draining the node: "master-1a.local". I0808 12:48:10.123832 21027 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0808 12:48:10.123866 21027 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0808 12:48:10.123886 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.124986 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.125003 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.125022 21027 instancegroups.go:431] Draining the node: "master-1c.local". I0808 12:48:10.125034 21027 instancegroups.go:431] Draining the node: "master-1b.local". I0808 12:48:10.125572 21027 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0808 12:48:10.125599 21027 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0808 12:48:10.125715 21027 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0808 12:48:10.125739 21027 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0808 12:48:10.125754 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.126852 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.126880 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.227202 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.227251 21027 instancegroups.go:431] Draining the node: "master-1e.local". I0808 12:48:10.227319 21027 instancegroups.go:431] Draining the node: "master-1d.local". I0808 12:48:10.228077 21027 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0808 12:48:10.228240 21027 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0808 12:48:10.228294 21027 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0808 12:48:10.228332 21027 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0808 12:48:10.228355 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.229455 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.229477 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.229496 21027 instancegroups.go:431] Draining the node: "master-1f.local". I0808 12:48:10.229864 21027 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0808 12:48:10.229891 21027 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0808 12:48:10.229907 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.230991 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.231016 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.331362 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.331398 21027 instancegroups.go:431] Draining the node: "master-1g.local". I0808 12:48:10.331778 21027 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0808 12:48:10.331814 21027 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0808 12:48:10.331834 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.332940 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.332964 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.332980 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0808 12:48:10.333164 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.333185 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.333196 21027 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0808 12:48:10.334214 21027 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0808 12:48:10.334254 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:10.335385 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.335402 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.335407 21027 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0808 12:48:10.335426 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:10.336506 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.336522 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.336546 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:10.336581 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:10.336893 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:10.338496 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:10.339690 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.340841 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.340886 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.441276 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.441368 21027 instancegroups.go:431] Draining the node: "node-1d.local". I0808 12:48:10.441382 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:10.441852 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:10.442065 21027 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0808 12:48:10.442082 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.443245 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.443287 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.443307 21027 instancegroups.go:431] Draining the node: "node-1e.local". I0808 12:48:10.443669 21027 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0808 12:48:10.443701 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.444844 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.444878 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.545287 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.545376 21027 instancegroups.go:431] Draining the node: "node-1f.local". I0808 12:48:10.546419 21027 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0808 12:48:10.546486 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.547610 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.547641 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.547659 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0808 12:48:10.547856 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.547876 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.547885 21027 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0808 12:48:10.548835 21027 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0808 12:48:10.548864 21027 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0808 12:48:10.548890 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:10.550008 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.550033 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.550067 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:10.550076 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:10.550845 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:10.550955 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:10.550979 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.552079 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.552115 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.652495 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.652563 21027 instancegroups.go:431] Draining the node: "node-1d.local". I0808 12:48:10.652664 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:10.653590 21027 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0808 12:48:10.653791 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:10.653832 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.655056 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.655093 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.655123 21027 instancegroups.go:431] Draining the node: "node-1e.local". I0808 12:48:10.655729 21027 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0808 12:48:10.655769 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.656947 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.657002 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.757681 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.757743 21027 instancegroups.go:431] Draining the node: "node-1f.local". I0808 12:48:10.758483 21027 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0808 12:48:10.758530 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.759680 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.759720 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.759741 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0808 12:48:10.759921 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.759935 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.759943 21027 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0808 12:48:10.760389 21027 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0808 12:48:10.760415 21027 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0808 12:48:10.760438 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:10.761610 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.761633 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:10.766848 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.766882 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:10.766923 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:10.767745 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:10.767779 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.767962 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:10.767995 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.768920 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.768942 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:10.774317 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.774339 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0808 12:48:10.774459 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.774469 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.774474 21027 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0808 12:48:10.775003 21027 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0808 12:48:10.775047 21027 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0808 12:48:10.775053 21027 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0808 12:48:10.775064 21027 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0808 12:48:10.775074 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:10.776217 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.776242 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:10.781474 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.781512 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:10.781550 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:10.782426 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:10.782455 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.782610 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:10.782636 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.783624 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.783649 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:10.788856 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.788871 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0808 12:48:10.788975 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.788989 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.788994 21027 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0808 12:48:10.789684 21027 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0808 12:48:10.789738 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:10.790906 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.790937 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.790947 21027 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0808 12:48:10.790988 21027 instancegroups.go:203] waiting for 1ms after detaching instance I0808 12:48:10.792108 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.792123 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.792138 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:10.792200 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:10.792253 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:10.792410 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:10.792427 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.793086 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:10.793118 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.793279 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:10.793307 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.793564 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.894230 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.894288 21027 instancegroups.go:431] Draining the node: "node-1d.local". I0808 12:48:10.895050 21027 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0808 12:48:10.895092 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.896251 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.896271 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.896282 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0808 12:48:10.896399 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.896412 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.896418 21027 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0808 12:48:10.897481 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:10.897905 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:10.897940 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.899079 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.899095 21027 instancegroups.go:540] Cluster validated. I0808 12:48:10.899108 21027 instancegroups.go:431] Draining the node: "node-1e.local". I0808 12:48:10.899130 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:10.899461 21027 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0808 12:48:10.899894 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:10.899925 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:10.901033 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:10.901067 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:11.001722 21027 instancegroups.go:540] Cluster validated. I0808 12:48:11.001781 21027 instancegroups.go:431] Draining the node: "node-1g.local". I0808 12:48:11.001820 21027 instancegroups.go:431] Draining the node: "node-1f.local". I0808 12:48:11.002525 21027 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0808 12:48:11.002640 21027 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0808 12:48:11.002659 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:11.003809 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:11.003838 21027 instancegroups.go:540] Cluster validated. I0808 12:48:11.003859 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:11.004298 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:11.004344 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:11.005504 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:11.005535 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:11.106306 21027 instancegroups.go:540] Cluster validated. I0808 12:48:11.106354 21027 instancegroups.go:431] Draining the node: "node-1d.local". I0808 12:48:11.106816 21027 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0808 12:48:11.106841 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:11.108058 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:11.108106 21027 instancegroups.go:540] Cluster validated. I0808 12:48:11.108127 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0808 12:48:11.108375 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:11.108396 21027 instancegroups.go:540] Cluster validated. I0808 12:48:11.108410 21027 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0808 12:48:11.108424 21027 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0808 12:48:11.108433 21027 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0808 12:48:11.108454 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0808 12:48:11.108571 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:11.108591 21027 instancegroups.go:540] Cluster validated. I0808 12:48:11.108600 21027 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0808 12:48:11.109330 21027 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0808 12:48:11.109349 21027 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0808 12:48:11.109359 21027 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0808 12:48:11.109391 21027 instancegroups.go:431] Draining the node: "node-1a.local". I0808 12:48:11.109928 21027 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0808 12:48:11.109954 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:11.111121 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:11.111141 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:11.116328 21027 instancegroups.go:540] Cluster validated. I0808 12:48:11.116357 21027 instancegroups.go:431] Draining the node: "node-1b.local". I0808 12:48:11.116791 21027 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0808 12:48:11.116810 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:11.117999 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:11.118013 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:11.123188 21027 instancegroups.go:540] Cluster validated. I0808 12:48:11.123219 21027 instancegroups.go:431] Draining the node: "node-1c.local". I0808 12:48:11.123553 21027 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0808 12:48:11.123581 21027 instancegroups.go:469] waiting for 1ms after terminating instance I0808 12:48:11.124777 21027 instancegroups.go:504] Validating the cluster. I0808 12:48:11.124811 21027 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0808 12:48:11.130146 21027 instancegroups.go:540] Cluster validated. I0808 12:48:11.130175 21027 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.927s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.006s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.013s === RUN TestParse E0808 12:48:09.219051 21030 versions.go:96] unable to parse Kubernetes version "" E0808 12:48:09.219107 21030 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.008s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.034s ? k8s.io/kops/pkg/kopscontrollerclient [no test files] === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.13s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.185s ? k8s.io/kops/pkg/kubemanifest [no test files] === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.080s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.073s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.068s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0808 12:48:09.269955 21036 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.063s ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] === RUN Test_RunEtcdManagerBuilder I0808 12:48:09.279154 21038 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0808 12:48:09.313949 21038 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0808 12:48:09.315629 21038 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.04s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.02s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.110s ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] === RUN Test_RunKubeApiserverBuilder I0808 12:48:09.268200 21043 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.069s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.080s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.025s ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.071s === RUN TestServerGroupBuilder I0808 12:48:09.278620 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.288199 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.299810 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.315923 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.322050 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.336205 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.348474 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.357593 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.366319 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.375390 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.382146 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.390521 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.395886 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.401359 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.406593 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.416286 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.420917 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:09.424981 21050 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.15s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.224s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.028s ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.028s ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.033s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.00s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.63s) --- PASS: TestIssueCert/ca (0.26s) --- PASS: TestIssueCert/client (0.13s) --- PASS: TestIssueCert/clientOneYear (0.25s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 0.640s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.003s ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] === RUN TestAddUntaggedRouteTables I0808 12:48:14.001786 22769 routetable.go:53] DescribeRouteTables: { } W0808 12:48:14.001900 22769 tags.go:67] cluster tag not found on route-table:rtb-1234 I0808 12:48:14.001914 22769 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0808 12:48:14.002039 22769 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0808 12:48:14.002114 22769 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0808 12:48:14.002195 22769 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0808 12:48:14.002298 22769 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0808 12:48:14.002365 22769 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0808 12:48:14.002453 22769 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0808 12:48:14.002552 22769 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0808 12:48:14.002583 22769 volumes.go:128] DescribeVolumes: { } W0808 12:48:14.002616 22769 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0808 12:48:14.002740 22769 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:14.002927 22769 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:14.002976 22769 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:14.003051 22769 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:14.003084 22769 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:14.003641 22769 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:14.003709 22769 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:14.003723 22769 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:14.003742 22769 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:14.003764 22769 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:14.003781 22769 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0808 12:48:14.003810 22769 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0808 12:48:14.003825 22769 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0808 12:48:14.003847 22769 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0808 12:48:14.003864 22769 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0808 12:48:14.003882 22769 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0808 12:48:14.003908 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0808 12:48:14.003931 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0808 12:48:14.003947 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0808 12:48:14.003959 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0808 12:48:14.004829 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0808 12:48:14.004860 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0808 12:48:14.004878 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0808 12:48:14.004888 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0808 12:48:14.004900 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0808 12:48:14.004910 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0808 12:48:14.004921 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0808 12:48:14.004929 22769 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.054s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.029s ? k8s.io/kops/pkg/resources/digitalocean [no test files] === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.054s ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.005s ? k8s.io/kops/pkg/try [no test files] === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.005s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.005s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.005s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.00s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.033s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.075s ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.006s ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] === RUN TestRemovesDuplicateGuardedBlocks W0808 12:48:14.033570 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.033628 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.033635 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.033641 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.033646 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.033651 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.033656 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.033661 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.033666 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.033671 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.033676 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.033682 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.033687 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.033692 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.033697 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.033703 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054248 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054283 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054347 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054357 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054406 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054415 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054466 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054475 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054525 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054533 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054588 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054599 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054654 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054664 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054734 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054742 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054794 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054804 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054853 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054861 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054910 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.054919 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.054995 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055005 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055073 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055083 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055135 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055143 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055194 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055204 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055260 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055269 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055323 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055338 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055392 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055401 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055465 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055475 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055581 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055591 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055646 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055656 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055712 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055721 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055775 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055784 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055836 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055844 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055894 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055903 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.055954 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.055971 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056028 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056037 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056088 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056097 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056149 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056157 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056208 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056217 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056270 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056279 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056343 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056353 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056409 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056418 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056471 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056479 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056531 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056540 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056592 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056601 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056663 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056673 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056727 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056737 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056791 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056800 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056853 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056864 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.056936 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.056946 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.057014 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.057024 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.057086 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.057096 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.057149 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.057157 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.057209 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.057218 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.057283 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.057293 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.057347 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.057357 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.057411 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.057421 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.057473 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.057481 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.057533 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.057543 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058237 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058261 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058346 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058358 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058414 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058424 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058480 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058489 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058541 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058551 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058612 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058621 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058671 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058681 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058731 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058741 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058795 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058804 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058857 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058866 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058918 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058927 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.058978 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.058987 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059078 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059089 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059149 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059159 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059211 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059221 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059272 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059281 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059336 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059348 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059410 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059419 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059475 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059489 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059541 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059550 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059608 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059618 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059684 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059706 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059767 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059777 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059828 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059838 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059892 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059902 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.059971 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.059981 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060039 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060050 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060101 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060110 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060196 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060206 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060264 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060273 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060324 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060332 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060385 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060393 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060445 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060454 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060525 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060533 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060589 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060597 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060651 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060659 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060713 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060721 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060778 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060788 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060843 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060858 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060917 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.060934 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.060993 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.061006 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.061061 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.061071 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.061125 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.061134 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.061190 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.061199 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.061253 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.061263 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.061320 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.061329 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.061384 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.061399 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.061452 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.061461 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.061516 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.061524 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.03s) === RUN TestRecoversFromBadNesting W0808 12:48:14.062146 23008 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0808 12:48:14.062156 23008 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0808 12:48:14.062163 23008 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0808 12:48:14.062168 23008 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0808 12:48:14.062174 23008 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0808 12:48:14.062179 23008 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0808 12:48:14.062184 23008 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0808 12:48:14.062204 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062214 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062224 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.062229 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062235 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.062241 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062246 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.062251 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062256 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.062261 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062267 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062272 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062278 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062283 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.062289 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.062294 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.076895 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.076924 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.076989 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.076998 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077050 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077060 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077116 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077126 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077216 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077227 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077281 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077294 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077348 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077355 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077407 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077414 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077468 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077476 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077530 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077544 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077595 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077603 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077655 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077663 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077716 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077724 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077778 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077788 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077840 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077854 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077904 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077912 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.077966 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.077974 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078025 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078032 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078082 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078089 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078144 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078151 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078202 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078211 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078261 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078268 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078336 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078345 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078397 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078405 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078473 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078482 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078541 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078549 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078611 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078620 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078676 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078684 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078755 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078763 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078815 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078823 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078874 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078882 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078931 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078938 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.078987 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.078994 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079044 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079051 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079100 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079107 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079158 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079165 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079213 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079220 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079280 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079288 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079340 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079350 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079402 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079410 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079459 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079467 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079516 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079523 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079580 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079589 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079642 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079650 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079703 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079710 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079763 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079773 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079853 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079863 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079917 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079925 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.079976 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.079984 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080033 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080040 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080089 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080096 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080182 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080198 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080251 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080259 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080323 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080334 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080385 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080394 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080446 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080455 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080506 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080516 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080563 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080571 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080623 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080632 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080689 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080697 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080750 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080765 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080817 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080831 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080883 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080891 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.080944 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.080951 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081002 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081009 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081058 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081066 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081126 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081134 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081194 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081202 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081262 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081275 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081365 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081377 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081440 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081451 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081513 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081523 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081577 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081586 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081649 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081659 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081709 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081718 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081772 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081781 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081836 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081850 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.081954 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.081975 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082051 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082061 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082112 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082121 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082173 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082181 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082231 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082239 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082290 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082302 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082351 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082361 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082408 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082425 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082488 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082500 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082563 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082575 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082639 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082649 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082711 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082721 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082782 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082791 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082855 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082864 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082925 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082935 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.082987 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.082996 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.083044 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.083052 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.083101 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.083109 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.083155 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.083163 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.083210 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.083218 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.083267 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.083275 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0808 12:48:14.083323 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0808 12:48:14.083331 23008 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.02s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.054s ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.033s ? k8s.io/kops/tests/fuzz [no test files] === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.00s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.00s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.055s ? k8s.io/kops/tests/integration/channel/simple [no test files] === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.035s ? k8s.io/kops/upup/models [no test files] === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0808 12:48:16.522751 25039 files.go:57] Writing file "/tmp/TestWriteFile3142375293/001/SubDir/test1.tmp" I0808 12:48:16.522866 25039 files.go:113] Changing file mode for "/tmp/TestWriteFile3142375293/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.026s === RUN TestBootstrapChannelBuilder_BuildTasks I0808 12:48:20.528980 25371 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:20.529131 25371 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:20.529156 25371 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:20.529182 25371 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:20.529203 25371 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:20.529236 25371 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:20.529260 25371 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:20.529269 25371 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:20.529292 25371 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:20.529307 25371 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:20.533868 25371 zones.go:93] ListHostedZonesPages { } I0808 12:48:20.598529 25371 zones.go:93] ListHostedZonesPages { } I0808 12:48:20.719253 25371 zones.go:93] ListHostedZonesPages { } I0808 12:48:20.842413 25371 zones.go:93] ListHostedZonesPages { } I0808 12:48:20.978380 25371 zones.go:93] ListHostedZonesPages { } I0808 12:48:21.084999 25371 zones.go:93] ListHostedZonesPages { } I0808 12:48:21.211010 25371 zones.go:93] ListHostedZonesPages { } I0808 12:48:21.375824 25371 zones.go:93] ListHostedZonesPages { } I0808 12:48:21.952177 25371 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.55s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0808 12:48:22.078784 25371 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:22.078998 25371 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:22.079081 25371 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:22.079126 25371 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:22.079164 25371 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:22.079205 25371 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:22.079241 25371 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:22.079262 25371 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:22.079293 25371 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:22.079315 25371 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:22.079340 25371 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0808 12:48:22.080818 25371 zones.go:93] ListHostedZonesPages { } I0808 12:48:22.235168 25371 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.16s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0808 12:48:22.235424 25371 featureflag.go:164] FeatureFlag "ImageDigest"=false I0808 12:48:22.235624 25371 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:22.235684 25371 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0808 12:48:22.235724 25371 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0808 12:48:22.235775 25371 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0808 12:48:22.235815 25371 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0808 12:48:22.235849 25371 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0808 12:48:22.235871 25371 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0808 12:48:22.235900 25371 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0808 12:48:22.235922 25371 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0808 12:48:22.237341 25371 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.13s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.06s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0808 12:48:22.444953 25371 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.01s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0808 12:48:22.491371 25371 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0808 12:48:22.491447 25371 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0808 12:48:22.491462 25371 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0808 12:48:22.491526 25371 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0808 12:48:22.491538 25371 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0808 12:48:22.491604 25371 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0808 12:48:22.491711 25371 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0808 12:48:22.491790 25371 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0808 12:48:22.491808 25371 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0808 12:48:22.491882 25371 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0808 12:48:22.491900 25371 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0808 12:48:22.492009 25371 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0808 12:48:22.492115 25371 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0808 12:48:22.492180 25371 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0808 12:48:22.492193 25371 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0808 12:48:22.492200 25371 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0808 12:48:22.492216 25371 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0808 12:48:22.492224 25371 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0808 12:48:22.492231 25371 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0808 12:48:22.492236 25371 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0808 12:48:22.492246 25371 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0808 12:48:22.493477 25371 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0808 12:48:22.493676 25371 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.045s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0808 12:48:20.519163 25372 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2360597365/001 I0808 12:48:20.519423 25372 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2360597365/001 I0808 12:48:20.519642 25372 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender2360597365/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0808 12:48:20.523555 25372 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0808 12:48:20.523634 25372 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0808 12:48:20.523685 25372 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0808 12:48:20.523778 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.523874 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.523914 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.523925 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.524031 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:48:20.524062 25372 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0808 12:48:20.524092 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.524142 25372 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0808 12:48:20.524183 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0808 12:48:20.524217 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.524242 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.524263 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.524270 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.524285 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.524303 25372 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0808 12:48:20.524330 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0808 12:48:20.524413 25372 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0808 12:48:20.524441 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.524487 25372 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0808 12:48:20.524505 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:48:20.524523 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.524535 25372 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0808 12:48:20.524574 25372 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0808 12:48:20.524672 25372 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0808 12:48:20.524701 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:48:20.524712 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.524732 25372 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0808 12:48:20.524766 25372 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:48:20.524838 25372 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0808 12:48:20.524870 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:48:20.524882 25372 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I0808 12:48:20.524900 25372 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0808 12:48:20.524944 25372 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0808 12:48:20.524965 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.525000 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.525008 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.525020 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.525032 25372 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0808 12:48:20.525052 25372 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0808 12:48:20.525079 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.525091 25372 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0808 12:48:20.525113 25372 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:48:20.525153 25372 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0808 12:48:20.525173 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0808 12:48:20.525201 25372 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0808 12:48:20.525251 25372 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0808 12:48:20.525278 25372 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0808 12:48:20.525294 25372 internetgateways.go:66] CreateInternetGateway: { } I0808 12:48:20.525309 25372 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0808 12:48:20.525352 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.525381 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.525412 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.525424 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.525473 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:48:20.525492 25372 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0808 12:48:20.525515 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.525559 25372 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0808 12:48:20.525617 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0808 12:48:20.525659 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.525691 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.525722 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.525735 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.525759 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.525787 25372 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0808 12:48:20.525831 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0808 12:48:20.526244 25372 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender1233573594/001 I0808 12:48:20.526452 25372 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender1233573594/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0808 12:48:20.526751 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.526776 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.526824 25372 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0808 12:48:20.526845 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:48:20.526858 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.526870 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.526904 25372 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0808 12:48:20.527015 25372 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0808 12:48:20.527043 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0808 12:48:20.527060 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0808 12:48:20.527088 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.527110 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.527133 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.527140 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.527152 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.527164 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.527183 25372 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0808 12:48:20.527220 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0808 12:48:20.527337 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.527358 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.527400 25372 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0808 12:48:20.527418 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:48:20.527429 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.527439 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.527458 25372 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0808 12:48:20.527502 25372 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0808 12:48:20.527523 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:48:20.527534 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.527544 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0808 12:48:20.527579 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.527598 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.527625 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.527633 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.527645 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.527657 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.527675 25372 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0808 12:48:20.527702 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.527714 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0808 12:48:20.527787 25372 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0808 12:48:20.527807 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.527846 25372 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0808 12:48:20.527865 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:48:20.527876 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.527888 25372 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0808 12:48:20.527920 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.527995 25372 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0808 12:48:20.528019 25372 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0808 12:48:20.528065 25372 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0808 12:48:20.528090 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:48:20.528102 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.528114 25372 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0808 12:48:20.528152 25372 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0808 12:48:20.528173 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.528195 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.528203 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.528215 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.528227 25372 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0808 12:48:20.528247 25372 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0808 12:48:20.528285 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.528297 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.528333 25372 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0808 12:48:20.528392 25372 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0808 12:48:20.528417 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.528459 25372 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0808 12:48:20.528478 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:48:20.528489 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.528500 25372 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0808 12:48:20.528520 25372 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0808 12:48:20.528611 25372 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0808 12:48:20.528609 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.528671 25372 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0808 12:48:20.528693 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:48:20.528708 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.528722 25372 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0808 12:48:20.528766 25372 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0808 12:48:20.528789 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.528812 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.528820 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.528832 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.528845 25372 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0808 12:48:20.528864 25372 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0808 12:48:20.528921 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.528933 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.528959 25372 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0808 12:48:20.529001 25372 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0808 12:48:20.529035 25372 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0808 12:48:20.529072 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.529093 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.529112 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.529120 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.529156 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:48:20.529171 25372 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0808 12:48:20.529186 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.529204 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.529261 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0808 12:48:20.529273 25372 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0808 12:48:20.529289 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0808 12:48:20.529324 25372 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0808 12:48:20.529344 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.529364 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.529372 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.529388 25372 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0808 12:48:20.529405 25372 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0808 12:48:20.529432 25372 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0808 12:48:20.529492 25372 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.529512 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.529554 25372 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0808 12:48:20.529572 25372 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0808 12:48:20.529582 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.529593 25372 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0808 12:48:20.529614 25372 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.529632 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0808 12:48:20.529652 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.529660 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.529671 25372 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0808 12:48:20.529682 25372 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0808 12:48:20.529739 25372 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0808 12:48:20.529773 25372 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.529792 25372 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0808 12:48:20.529812 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0808 12:48:20.529820 25372 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0808 12:48:20.529835 25372 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.058s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.040s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.024s === RUN TestDiskRenderAzure I0808 12:48:20.499065 25375 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0808 12:48:20.499349 25375 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0808 12:48:20.499480 25375 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0808 12:48:20.499866 25375 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0808 12:48:20.500033 25375 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0808 12:48:20.500205 25375 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0808 12:48:20.500411 25375 resourcegroup.go:108] Creating a new Resource Group with name: rg I0808 12:48:20.500418 25375 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0808 12:48:20.500549 25375 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0808 12:48:20.500955 25375 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0808 12:48:20.501153 25375 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0808 12:48:20.501310 25375 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0808 12:48:20.501543 25375 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0808 12:48:20.501776 25375 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.029s ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.028s ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] === RUN TestProjectIAMBinding I0808 12:48:20.521069 25378 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.521625 25378 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0808 12:48:20.521658 25378 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.522099 25378 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0808 12:48:20.522136 25378 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.522286 25378 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0808 12:48:20.522401 25378 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.522489 25378 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0808 12:48:20.522513 25378 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.522621 25378 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0808 12:48:20.522644 25378 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.522692 25378 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0808 12:48:20.522799 25378 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.523041 25378 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0808 12:48:20.523062 25378 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.523357 25378 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0808 12:48:20.523382 25378 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0808 12:48:20.523497 25378 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.052s ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.055s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.036s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.025s ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.024s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.006s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.033s ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0808 12:48:20.532164 25384 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0808 12:48:20.532221 25384 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0808 12:48:20.532232 25384 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0808 12:48:20.532245 25384 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0808 12:48:20.532254 25384 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0808 12:48:20.532265 25384 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0808 12:48:20.532274 25384 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0808 12:48:20.532685 25384 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.060s ? k8s.io/kops/upup/pkg/fi/secrets [no test files] === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.005s ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.005s ? k8s.io/kops/util/pkg/env [no test files] === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.006s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.005s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.005s ? k8s.io/kops/util/pkg/mirrors [no test files] === RUN TestGetProxyEnvVars W0808 12:48:20.496210 25391 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.021s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.024s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.005s ? k8s.io/kops/util/pkg/tables [no test files] === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.004s ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.023s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0808 12:48:24.524467 25845 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.048s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... kubernetes >>> kops*: Package size: 146.3 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r12.apk >>> kops: Build complete at Fri, 08 Aug 2025 12:50:08 +0000 elapsed time 0h 3m 49s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/4) Purging .makedepends-kops (20250808.124621) (2/4) Purging kubernetes (1.33.2-r2) (3/4) Purging go (1.24.6-r0) (4/4) Purging bash (5.3.3-r0) bash-5.3.3-r0.pre-deinstall: Executing script... busybox-1.37.0-r22.trigger: Executing script... OK: 441 MiB in 106 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...