>>> kops: Building testing/kops 1.28.4-r15 (using abuild 3.16.0-r0) started Thu, 04 Dec 2025 12:32:56 +0000 >>> kops: Validating /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/4) Installing kubernetes (1.34.2-r1) (2/4) Installing go (1.25.5-r0) (3/4) Installing bash (5.3.3-r1) Executing bash-5.3.3-r1.post-install (4/4) Installing .makedepends-kops (20251204.123257) Executing busybox-1.37.0-r29.trigger OK: 595 MiB in 111 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz Connecting to distfiles.alpinelinux.org (172.105.82.32:443) saving to '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' kops-1.28.4.tar.gz.p 100% |********************************| 32.7M 0:00:00 ETA '/var/cache/distfiles/edge/kops-1.28.4.tar.gz.part' saved /var/cache/distfiles/edge/kops-1.28.4.tar.gz: OK >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz /var/cache/distfiles/edge/kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading github.com/spf13/pflag v1.0.5 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading github.com/spf13/cobra v1.7.0 go: downloading golang.org/x/crypto v0.14.0 go: downloading k8s.io/apimachinery v0.28.1 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading k8s.io/client-go v0.28.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/api v0.28.1 go: downloading go.uber.org/multierr v1.11.0 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading golang.org/x/net v0.17.0 go: downloading google.golang.org/api v0.138.0 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading k8s.io/mount-utils v0.28.1 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading golang.org/x/sys v0.13.0 go: downloading golang.org/x/term v0.13.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading golang.org/x/time v0.3.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/kr/fs v0.1.0 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading golang.org/x/text v0.13.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/google/btree v1.0.1 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading github.com/moby/spdystream v0.2.0 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/josharian/intern v1.0.0 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading github.com/stretchr/testify v1.8.4 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/google/logger v1.1.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I1204 12:34:41.100890 15976 addon.go:250] addon test wants to update all nodes I1204 12:34:41.102377 15976 addon.go:250] addon test wants to update workers nodes I1204 12:34:41.102634 15976 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I1204 12:34:41.102911 15976 addon.go:283] installing PKI for "test" I1204 12:34:41.287905 15976 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (0.23s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 0.278s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.044s ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] === RUN TestCreateClusterMinimal I1204 12:34:42.713363 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:42.713526 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:42.713552 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:42.713585 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:42.713603 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:42.713641 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:42.713675 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:42.713683 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:42.713712 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:42.713738 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:42.717255 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.717286 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.738982 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:42.739245 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:42.739727 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:42.750321 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:42.750376 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:42.750393 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:42.750424 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:42.750449 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:42.750470 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:42.750487 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:42.750497 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:42.750521 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:42.750549 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:42.753086 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.753129 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.798450 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:42.798772 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:42.799325 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:42.804137 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:42.804222 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:42.804246 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:42.804283 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:42.804303 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:42.804328 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:42.804351 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:42.804365 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:42.804387 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:42.804403 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:42.806962 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.806998 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.862272 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:42.862389 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:42.862614 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:42.866325 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:42.866379 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:42.866407 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:42.866427 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:42.866440 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:42.866461 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:42.866479 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:42.866487 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:42.866503 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:42.866514 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:42.868691 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.868718 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.890439 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:42.890543 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:42.890737 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:42.894579 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:42.894635 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:42.894660 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:42.894680 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:42.894696 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:42.894715 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:42.894732 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:42.894741 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:42.894756 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:42.894768 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:42.914751 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.914800 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.933279 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:42.933386 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:42.933595 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:42.939261 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:42.939342 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:42.939364 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:42.939391 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:42.939409 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:42.939436 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:42.939463 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:42.939475 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:42.939495 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:42.939511 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:42.941950 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.941977 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.973517 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:42.973591 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:42.973815 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:42.977346 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:42.977392 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:42.977407 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:42.977425 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:42.977438 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:42.977457 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:42.977474 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:42.977483 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:42.977497 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:42.977508 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:42.979756 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:42.979783 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.000020 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.000150 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:43.000357 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.29s) === RUN TestCreateClusterHetzner I1204 12:34:43.003942 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.004009 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.004024 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.004043 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.004056 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.004073 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.004091 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.004099 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.004124 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.004137 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.006758 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.006799 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1204 12:34:43.069690 17225 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1204 12:34:43.069718 17225 new_cluster.go:1373] Cloud Provider ID: "hetzner" I1204 12:34:43.076490 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.076568 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.076588 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.076614 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.076632 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.076653 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.076675 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.076685 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.076700 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.076715 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.079888 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.079938 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.132501 17225 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.13s) === RUN TestCreateClusterOpenStack I1204 12:34:43.135866 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.135924 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.135941 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.135958 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.135969 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.135988 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.136004 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.136012 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.136025 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.136035 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.139323 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.139355 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1204 12:34:43.184557 17225 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1204 12:34:43.184604 17225 new_cluster.go:1373] Cloud Provider ID: "openstack" I1204 12:34:43.186004 17225 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.06s) === RUN TestCreateClusterOpenStackOctavia I1204 12:34:43.191068 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.191143 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.191161 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.191179 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.191192 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.191209 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.191225 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.191234 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.191247 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.191260 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.194202 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.194230 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1204 12:34:43.201514 17225 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1204 12:34:43.201544 17225 new_cluster.go:1373] Cloud Provider ID: "openstack" I1204 12:34:43.203068 17225 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1204 12:34:43.203081 17225 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.02s) === RUN TestCreateClusterOpenStackNoDNS I1204 12:34:43.208030 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.208088 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.208105 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.208135 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.208150 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.208170 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.208187 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.208196 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.208211 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.208222 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.211298 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.211343 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1204 12:34:43.235762 17225 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1204 12:34:43.235811 17225 new_cluster.go:1373] Cloud Provider ID: "openstack" I1204 12:34:43.235878 17225 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I1204 12:34:43.235902 17225 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.04s) === RUN TestCreateClusterCilium I1204 12:34:43.249563 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.249672 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.249702 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.249740 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.249768 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.249806 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.249842 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.249862 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.249886 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.249908 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.254217 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.254267 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.274427 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.274638 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:43.275012 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.03s) === RUN TestCreateClusterOverride I1204 12:34:43.282912 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.283016 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.283045 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.283077 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.283103 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.283156 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.283189 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.283207 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.283236 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.283256 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.304992 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.305054 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.324719 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.325081 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:43.325316 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.05s) === RUN TestCreateClusterKubernetesFeatureGates I1204 12:34:43.329257 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.329324 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.329343 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.329366 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.329381 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.329399 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.329423 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.329439 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.329454 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.329465 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.332372 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.332403 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.349486 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.349617 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:43.349898 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.03s) === RUN TestCreateClusterComplex I1204 12:34:43.354925 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.354992 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.355010 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.355034 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.355051 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.355072 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.355091 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.355101 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.355130 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.355143 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.358079 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.358140 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.384322 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.384681 17225 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I1204 12:34:43.384707 17225 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I1204 12:34:43.384721 17225 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I1204 12:34:43.385187 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.05s) === RUN TestCreateClusterComplexPrivate I1204 12:34:43.400662 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.400769 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.400799 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.400831 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.400856 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.400889 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.400918 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.400935 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.400959 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.400976 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.405898 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.405928 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.418864 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.419062 17225 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I1204 12:34:43.419069 17225 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I1204 12:34:43.419073 17225 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I1204 12:34:43.419077 17225 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I1204 12:34:43.419083 17225 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I1204 12:34:43.419087 17225 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I1204 12:34:43.419090 17225 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I1204 12:34:43.419097 17225 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I1204 12:34:43.419104 17225 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I1204 12:34:43.419136 17225 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I1204 12:34:43.419449 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.03s) === RUN TestCreateClusterHA I1204 12:34:43.426724 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.426782 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.426800 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.426817 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.426830 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.426848 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.426865 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.426874 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.426887 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.426897 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.429818 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.429842 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.461276 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.461480 17225 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1204 12:34:43.461487 17225 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1204 12:34:43.461492 17225 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1204 12:34:43.461704 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:43.466976 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.467037 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.467053 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.467069 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.467083 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.467101 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.467136 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.467151 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.467172 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.467185 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.470166 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.470204 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.483591 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.483947 17225 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1204 12:34:43.483962 17225 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1204 12:34:43.483970 17225 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1204 12:34:43.484293 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.07s) === RUN TestCreateClusterMinimalGCE I1204 12:34:43.493326 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.493399 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.493426 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.493451 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.493468 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.493489 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.493512 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.493522 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.493539 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.493552 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.496694 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.496757 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.521036 17225 new_cluster.go:1373] Cloud Provider ID: "gce" I1204 12:34:43.521202 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I1204 12:34:43.527774 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.527855 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.527881 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.527916 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.527939 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.527968 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.527996 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.528012 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.528033 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.528052 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.531995 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.532032 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.543192 17225 new_cluster.go:1373] Cloud Provider ID: "gce" I1204 12:34:43.543274 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.06s) === RUN TestCreateClusterHAGCE I1204 12:34:43.548938 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.549021 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.549048 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.549076 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.549098 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.549139 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.549169 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.549184 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.549205 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.549223 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.553453 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.553526 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.609334 17225 new_cluster.go:1373] Cloud Provider ID: "gce" I1204 12:34:43.609449 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.07s) === RUN TestCreateClusterGCE I1204 12:34:43.616409 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.616469 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.616489 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.616509 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.616524 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.616545 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.616565 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.616574 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.616592 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.616605 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.620453 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.620506 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.685234 17225 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1204 12:34:43.685341 17225 new_cluster.go:1373] Cloud Provider ID: "gce" I1204 12:34:43.685425 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.08s) === RUN TestCreateClusterHASharedZone I1204 12:34:43.693053 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.693147 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.693171 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.693199 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.693218 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.693242 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.693263 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.693277 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.693297 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.693313 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.696061 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.696085 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1204 12:34:43.710702 17225 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1204 12:34:43.710737 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.710874 17225 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I1204 12:34:43.711078 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.02s) === RUN TestCreateClusterHASharedZones I1204 12:34:43.715804 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.715860 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.715876 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.715894 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.715911 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.715928 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.715946 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.715955 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.715970 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.715981 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.719074 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.719097 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W1204 12:34:43.739050 17225 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I1204 12:34:43.739090 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.739332 17225 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I1204 12:34:43.739343 17225 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I1204 12:34:43.739568 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.03s) === RUN TestCreateClusterPrivate I1204 12:34:43.745745 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.745806 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.745822 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.745839 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.745853 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.745871 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.745889 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.745901 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.745915 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.745927 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.749036 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.749073 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.771016 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.771284 17225 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1204 12:34:43.771302 17225 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1204 12:34:43.771670 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:43.771723 17225 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.03s) === RUN TestCreateClusterPrivateGCE I1204 12:34:43.778438 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.778511 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.778532 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.778559 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.778585 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.778612 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.778637 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.778653 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.778673 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.778689 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.782143 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.782177 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.824006 17225 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I1204 12:34:43.824092 17225 new_cluster.go:1373] Cloud Provider ID: "gce" I1204 12:34:43.824198 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.06s) === RUN TestCreateClusterWithNGWSpecified I1204 12:34:43.834744 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.834856 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.834888 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.834930 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.834957 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.834992 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.835026 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.835046 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.835072 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.835093 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.838972 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.839012 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.859576 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.859730 17225 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1204 12:34:43.859745 17225 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1204 12:34:43.859974 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:43.860003 17225 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.03s) === RUN TestCreateClusterWithINGWSpecified I1204 12:34:43.864708 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.864766 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.864782 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.864800 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.864814 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.864841 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.864859 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.864868 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.864882 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.864893 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.867777 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.867810 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.942373 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:43.942502 17225 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1204 12:34:43.942513 17225 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1204 12:34:43.942719 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:43.942740 17225 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.08s) === RUN TestCreateClusterSharedVPC I1204 12:34:43.946868 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:43.946926 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:43.946942 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:43.946960 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:43.946975 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:43.946992 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:43.947009 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:43.947018 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:43.947031 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:43.947043 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:43.950350 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:43.950418 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.002261 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:44.002447 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.002512 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.002558 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.002579 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.002630 17225 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I1204 12:34:44.002993 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.06s) === RUN TestCreateClusterSharedSubnets I1204 12:34:44.009826 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:44.009925 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:44.009951 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:44.009979 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:44.010002 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:44.010030 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:44.010056 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:44.010072 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:44.010095 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:44.010128 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:44.014171 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.014208 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.049994 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.050038 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.050137 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:44.050249 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.050266 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.050284 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.050295 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.050565 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.05s) === RUN TestCreateClusterSharedSubnetsVpcLookup I1204 12:34:44.055604 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:44.055671 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:44.055690 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:44.055711 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:44.055728 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:44.055749 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:44.055768 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:44.055779 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:44.055796 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:44.055808 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:44.059403 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.059445 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.093904 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:34:44.093972 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.093996 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.094083 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:44.094331 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.094359 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.094388 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.094405 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.094758 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.05s) === RUN TestCreateClusterPrivateSharedSubnets I1204 12:34:44.102071 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:44.102185 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:44.102214 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:44.102244 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:44.102271 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:44.102302 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:44.102331 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:44.102349 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:44.102375 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:44.102396 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:44.106929 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.106976 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.168954 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.169000 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.169040 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.169052 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.169104 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:44.169229 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.169244 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.169260 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:34:44.169269 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:34:44.169540 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.07s) === RUN TestCreateClusterIPv6 I1204 12:34:44.174127 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:44.174201 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:44.174219 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:44.174239 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:44.174255 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:44.174275 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:44.174296 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:44.174306 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:44.174322 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:44.174335 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:44.178554 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.178580 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.199911 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:44.200046 17225 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I1204 12:34:44.200062 17225 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I1204 12:34:44.200469 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.03s) === RUN TestCreateClusterDifferentAMIs I1204 12:34:44.205236 17225 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1204 12:34:44.205251 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:44.205318 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:44.205337 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:44.205356 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:44.205371 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:44.205393 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:44.205414 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:44.205424 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:44.205443 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:44.205456 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:44.209415 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.209471 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.230540 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:44.230678 17225 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I1204 12:34:44.230703 17225 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I1204 12:34:44.231091 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:44.240379 17225 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.04s) === RUN TestCreateClusterKarpenter I1204 12:34:44.240492 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:44.240592 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:44.240621 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:44.240653 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:44.240680 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:44.240716 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:44.240747 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:44.240767 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:44.240802 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:44.240821 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:44.245263 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.245314 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I1204 12:34:44.279566 17225 new_cluster.go:1373] Cloud Provider ID: "aws" I1204 12:34:44.279735 17225 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I1204 12:34:44.279748 17225 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I1204 12:34:44.279757 17225 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I1204 12:34:44.280145 17225 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.05s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I1204 12:34:44.286252 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:44.286325 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:44.286346 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:44.286411 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:44.286431 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:44.286456 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:44.286478 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:44.286492 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:44.286510 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:44.286531 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:44.295030 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I1204 12:34:44.296828 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:44.296934 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:44.296962 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:44.296997 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:44.297024 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:44.297062 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:44.297091 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:44.297109 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:44.297153 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:44.297174 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:44.315484 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1204 12:34:44.317925 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:44.317988 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1204 12:34:48.113108 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:49.827705 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:34:49.828462 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:34:49.828480 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:34:49.828554 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:34:49.830600 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:34:49.834153 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:34:49.834591 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:49.835034 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:49.835276 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:49.835329 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:49.835374 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:34:49.835615 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:34:49.835929 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:34:49.840516 17225 target.go:111] Terraform output is in /tmp/test3797378219/out --- PASS: TestMinimal (5.55s) === RUN TestMinimal_v1_23 I1204 12:34:49.844246 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:49.844363 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:49.844396 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:49.844434 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:49.844462 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:49.844498 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:49.844529 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:49.844547 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:49.844575 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:49.844595 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:49.861944 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1204 12:34:49.863673 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:49.863712 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:51.231515 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:51.333021 17225 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1204 12:34:51.334345 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:34:51.334381 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:34:51.334457 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:34:51.336009 17225 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1204 12:34:51.340251 17225 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1204 12:34:51.340586 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:51.340827 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:51.341028 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:51.341451 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:51.341539 17225 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1204 12:34:51.341775 17225 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1204 12:34:51.341943 17225 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1204 12:34:51.346256 17225 target.go:111] Terraform output is in /tmp/test277829836/out --- PASS: TestMinimal_v1_23 (1.51s) === RUN TestMinimal_v1_24 I1204 12:34:51.349871 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:51.349981 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:51.350013 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:51.350048 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:51.350081 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:51.350131 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:51.350166 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:51.350184 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:51.350215 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:51.350233 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:51.366882 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:34:51.368806 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:51.368859 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:52.335522 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:52.567207 17225 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1204 12:34:52.567596 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:34:52.567635 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:34:52.567751 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:34:52.570153 17225 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1204 12:34:52.573679 17225 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1204 12:34:52.573872 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:52.574246 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:52.574384 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:52.574602 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:52.574692 17225 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1204 12:34:52.574932 17225 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1204 12:34:52.575135 17225 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1204 12:34:52.581810 17225 target.go:111] Terraform output is in /tmp/test1296121394/out --- PASS: TestMinimal_v1_24 (1.24s) === RUN TestMinimal_v1_25 I1204 12:34:52.585607 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:52.585731 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:52.585764 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:52.585805 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:52.585838 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:52.585882 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:52.585920 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:52.585939 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:52.585965 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:52.585986 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:52.607243 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1204 12:34:52.609693 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:52.609749 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:53.554836 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:53.638822 17225 executor.go:111] Tasks: 0 done / 105 total; 46 can run I1204 12:34:53.641334 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:34:53.641363 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:34:53.641426 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:34:53.641929 17225 executor.go:111] Tasks: 46 done / 105 total; 23 can run I1204 12:34:53.645669 17225 executor.go:111] Tasks: 69 done / 105 total; 28 can run I1204 12:34:53.647393 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:53.648177 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:53.648253 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:53.649188 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:53.650382 17225 executor.go:111] Tasks: 97 done / 105 total; 2 can run I1204 12:34:53.650646 17225 executor.go:111] Tasks: 99 done / 105 total; 6 can run I1204 12:34:53.650865 17225 executor.go:111] Tasks: 105 done / 105 total; 0 can run I1204 12:34:53.653703 17225 target.go:111] Terraform output is in /tmp/test63969512/out --- PASS: TestMinimal_v1_25 (1.07s) === RUN TestMinimal_v1_26 I1204 12:34:53.656467 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:53.656545 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:53.656568 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:53.656597 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:53.656620 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:53.656650 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:53.656674 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:53.656689 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:53.656709 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:53.656726 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:53.669266 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1204 12:34:53.670502 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:53.670548 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:54.623687 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:54.729315 17225 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1204 12:34:54.729644 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:34:54.729676 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:34:54.729771 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:34:54.733547 17225 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1204 12:34:54.737799 17225 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1204 12:34:54.737985 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:54.738435 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:54.738555 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:54.739153 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:54.739240 17225 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1204 12:34:54.739497 17225 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1204 12:34:54.739955 17225 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1204 12:34:54.744420 17225 target.go:111] Terraform output is in /tmp/test251772159/out --- PASS: TestMinimal_v1_26 (1.09s) === RUN TestMinimal_v1_27 I1204 12:34:54.747952 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:54.748051 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:54.748078 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:54.748162 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:54.748196 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:54.748230 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:54.748259 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:54.748277 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:54.748305 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:54.748326 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:54.768784 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1204 12:34:54.771539 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:54.771599 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.051965 17225 zones.go:93] ListHostedZonesPages { } I1204 12:34:57.193189 17225 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1204 12:34:57.194484 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:34:57.194523 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:34:57.194620 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:34:57.197028 17225 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1204 12:34:57.201274 17225 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1204 12:34:57.201668 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.201924 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.202033 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.202590 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.202704 17225 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1204 12:34:57.202938 17225 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1204 12:34:57.203163 17225 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1204 12:34:57.211322 17225 target.go:111] Terraform output is in /tmp/test3020921151/out --- PASS: TestMinimal_v1_27 (2.47s) === RUN TestMinimal_NoneDNS I1204 12:34:57.215347 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:57.215451 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:57.215479 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:57.215518 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:57.215547 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:57.215582 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:57.215610 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:57.215631 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:57.215658 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:57.215679 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1204 12:34:57.238953 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.239020 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.940093 17225 executor.go:111] Tasks: 0 done / 110 total; 43 can run I1204 12:34:57.942925 17225 executor.go:111] Tasks: 43 done / 110 total; 24 can run I1204 12:34:57.945384 17225 executor.go:111] Tasks: 67 done / 110 total; 29 can run I1204 12:34:57.946506 17225 executor.go:111] Tasks: 96 done / 110 total; 2 can run I1204 12:34:57.946582 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:34:57.946651 17225 loadbalancers.go:35] PageSize not implemented I1204 12:34:57.946749 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:34:57.946832 17225 loadbalancers.go:35] PageSize not implemented I1204 12:34:57.950390 17225 executor.go:111] Tasks: 98 done / 110 total; 4 can run I1204 12:34:57.950519 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.950711 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.950999 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.951069 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:57.951177 17225 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1204 12:34:57.951373 17225 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1204 12:34:57.951618 17225 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1204 12:34:57.956049 17225 target.go:111] Terraform output is in /tmp/test3908230325/out --- PASS: TestMinimal_NoneDNS (0.75s) === RUN TestHetzner I1204 12:34:57.962096 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:34:59.009345 17225 executor.go:111] Tasks: 0 done / 46 total; 37 can run I1204 12:34:59.013046 17225 executor.go:111] Tasks: 37 done / 46 total; 3 can run I1204 12:34:59.013416 17225 executor.go:111] Tasks: 40 done / 46 total; 2 can run I1204 12:34:59.020394 17225 executor.go:111] Tasks: 42 done / 46 total; 4 can run I1204 12:34:59.021147 17225 executor.go:111] Tasks: 46 done / 46 total; 0 can run I1204 12:34:59.022887 17225 target.go:111] Terraform output is in /tmp/test54231279/out --- PASS: TestHetzner (1.06s) === RUN TestNvidia I1204 12:34:59.025194 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:59.025300 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:59.025331 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:59.025368 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:59.025396 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:59.025431 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:59.025465 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:59.025484 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:59.025509 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:59.025530 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:59.044315 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:34:59.046827 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:34:59.046888 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.014673 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:00.153380 17225 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1204 12:35:00.154928 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:00.154954 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:00.155034 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:00.157359 17225 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1204 12:35:00.165354 17225 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1204 12:35:00.165935 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.166150 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.166346 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.166569 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.166643 17225 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1204 12:35:00.166853 17225 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1204 12:35:00.167050 17225 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1204 12:35:00.171349 17225 target.go:111] Terraform output is in /tmp/test52853142/out --- PASS: TestNvidia (1.15s) === RUN TestMinimalGossip I1204 12:35:00.175056 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.175164 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:00.175192 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:00.175224 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:00.175255 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:00.175290 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:00.175317 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:00.175344 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:00.175370 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:00.175389 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:00.196412 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.196470 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.883917 17225 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1204 12:35:00.887966 17225 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1204 12:35:00.890412 17225 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1204 12:35:00.891238 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.891453 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.891528 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.891685 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.891720 17225 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1204 12:35:00.891849 17225 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1204 12:35:00.891983 17225 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1204 12:35:00.895529 17225 target.go:111] Terraform output is in /tmp/test2333560355/out --- PASS: TestMinimalGossip (0.72s) === RUN TestMinimalGossipIRSA I1204 12:35:00.897951 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.898018 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:00.898037 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:00.898059 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:00.898075 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:00.898096 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:00.898125 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:00.898139 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:00.898154 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:00.898166 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:00.914173 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:00.914246 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:01.629533 17225 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1204 12:35:01.631808 17225 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1204 12:35:01.637978 17225 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1204 12:35:01.638119 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:01.638321 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:01.638450 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:01.638518 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:01.638575 17225 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1204 12:35:01.638776 17225 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1204 12:35:01.638992 17225 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1204 12:35:01.643711 17225 target.go:111] Terraform output is in /tmp/test4274791353/out --- PASS: TestMinimalGossipIRSA (0.75s) === RUN TestMinimalGCE I1204 12:35:01.648018 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:01.649442 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:35:02.799421 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:35:02.799490 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:35:02.799575 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1204 12:35:02.799594 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1204 12:35:02.799606 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1204 12:35:02.799643 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1204 12:35:02.800430 17225 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1204 12:35:02.804561 17225 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1204 12:35:02.808199 17225 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1204 12:35:02.808844 17225 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1204 12:35:02.809053 17225 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1204 12:35:02.810814 17225 target.go:111] Terraform output is in /tmp/test1361233693/out --- PASS: TestMinimalGCE (1.16s) === RUN TestMinimalGCEPrivate I1204 12:35:02.812919 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:02.813885 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:35:03.773139 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:35:03.773227 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:35:03.773334 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W1204 12:35:03.773356 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W1204 12:35:03.773376 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W1204 12:35:03.773428 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1204 12:35:03.774520 17225 executor.go:111] Tasks: 0 done / 65 total; 41 can run I1204 12:35:03.778036 17225 executor.go:111] Tasks: 41 done / 65 total; 17 can run I1204 12:35:03.782266 17225 executor.go:111] Tasks: 58 done / 65 total; 5 can run I1204 12:35:03.783012 17225 executor.go:111] Tasks: 63 done / 65 total; 2 can run I1204 12:35:03.783182 17225 executor.go:111] Tasks: 65 done / 65 total; 0 can run I1204 12:35:03.785650 17225 target.go:111] Terraform output is in /tmp/test961471620/out --- PASS: TestMinimalGCEPrivate (0.98s) === RUN TestMinimalGCEInternalLoadBalancer I1204 12:35:03.788304 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:03.789747 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:35:04.749303 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:35:04.749372 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:35:04.749483 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W1204 12:35:04.749501 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W1204 12:35:04.749520 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W1204 12:35:04.749572 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1204 12:35:04.749608 17225 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1204 12:35:04.750748 17225 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1204 12:35:04.753667 17225 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1204 12:35:04.754072 17225 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1204 12:35:04.754293 17225 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1204 12:35:04.758351 17225 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1204 12:35:04.759014 17225 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1204 12:35:04.759190 17225 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1204 12:35:04.759419 17225 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1204 12:35:04.759591 17225 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1204 12:35:04.762253 17225 target.go:111] Terraform output is in /tmp/test3174915998/out --- PASS: TestMinimalGCEInternalLoadBalancer (0.98s) === RUN TestMinimalGCEPublicLoadBalancer I1204 12:35:04.764906 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:04.766352 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:35:05.710073 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:35:05.710190 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:35:05.710290 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W1204 12:35:05.710303 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W1204 12:35:05.710315 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W1204 12:35:05.710354 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1204 12:35:05.711376 17225 executor.go:111] Tasks: 0 done / 71 total; 43 can run I1204 12:35:05.714639 17225 executor.go:111] Tasks: 43 done / 71 total; 19 can run I1204 12:35:05.718956 17225 executor.go:111] Tasks: 62 done / 71 total; 7 can run I1204 12:35:05.719913 17225 executor.go:111] Tasks: 69 done / 71 total; 2 can run I1204 12:35:05.720044 17225 executor.go:111] Tasks: 71 done / 71 total; 0 can run I1204 12:35:05.722319 17225 target.go:111] Terraform output is in /tmp/test346476068/out --- PASS: TestMinimalGCEPublicLoadBalancer (0.96s) === RUN TestMinimalGCELongClusterName I1204 12:35:05.724366 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:05.725599 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:35:06.684387 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:35:06.684480 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:35:06.684582 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1204 12:35:06.684600 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1204 12:35:06.684618 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1204 12:35:06.684667 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1204 12:35:06.685668 17225 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1204 12:35:06.687976 17225 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1204 12:35:06.691278 17225 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1204 12:35:06.691821 17225 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1204 12:35:06.691933 17225 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1204 12:35:06.693923 17225 target.go:111] Terraform output is in /tmp/test4022071806/out --- PASS: TestMinimalGCELongClusterName (0.97s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I1204 12:35:06.695873 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:06.697107 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:35:07.640297 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:35:07.640373 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:35:07.640500 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W1204 12:35:07.640518 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W1204 12:35:07.640536 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W1204 12:35:07.640584 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1204 12:35:07.640619 17225 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1204 12:35:07.641828 17225 executor.go:111] Tasks: 0 done / 70 total; 42 can run I1204 12:35:07.645251 17225 executor.go:111] Tasks: 42 done / 70 total; 16 can run I1204 12:35:07.646898 17225 executor.go:111] Tasks: 58 done / 70 total; 2 can run I1204 12:35:07.647014 17225 executor.go:111] Tasks: 60 done / 70 total; 2 can run I1204 12:35:07.649784 17225 executor.go:111] Tasks: 62 done / 70 total; 4 can run I1204 12:35:07.650359 17225 executor.go:111] Tasks: 66 done / 70 total; 2 can run I1204 12:35:07.650491 17225 executor.go:111] Tasks: 68 done / 70 total; 1 can run I1204 12:35:07.650604 17225 executor.go:111] Tasks: 69 done / 70 total; 1 can run I1204 12:35:07.650708 17225 executor.go:111] Tasks: 70 done / 70 total; 0 can run I1204 12:35:07.653401 17225 target.go:111] Terraform output is in /tmp/test4148172402/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (0.97s) === RUN TestMinimalGCEDNSNone I1204 12:35:07.665872 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:07.666838 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:35:08.599264 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:35:08.599310 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:35:08.599397 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1204 12:35:08.599410 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1204 12:35:08.599424 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1204 12:35:08.599462 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1204 12:35:08.599489 17225 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I1204 12:35:08.600388 17225 executor.go:111] Tasks: 0 done / 72 total; 41 can run I1204 12:35:08.603869 17225 executor.go:111] Tasks: 41 done / 72 total; 18 can run I1204 12:35:08.605540 17225 executor.go:111] Tasks: 59 done / 72 total; 2 can run I1204 12:35:08.605787 17225 executor.go:111] Tasks: 61 done / 72 total; 2 can run I1204 12:35:08.612349 17225 executor.go:111] Tasks: 63 done / 72 total; 4 can run I1204 12:35:08.613154 17225 executor.go:111] Tasks: 67 done / 72 total; 2 can run I1204 12:35:08.613346 17225 executor.go:111] Tasks: 69 done / 72 total; 1 can run I1204 12:35:08.613480 17225 executor.go:111] Tasks: 70 done / 72 total; 2 can run I1204 12:35:08.613622 17225 executor.go:111] Tasks: 72 done / 72 total; 0 can run I1204 12:35:08.616506 17225 target.go:111] Terraform output is in /tmp/test211370241/out --- PASS: TestMinimalGCEDNSNone (0.95s) === RUN TestMinimalScaleway I1204 12:35:08.619060 17225 featureflag.go:164] FeatureFlag "Scaleway"=true I1204 12:35:08.619076 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:09.740149 17225 executor.go:111] Tasks: 0 done / 49 total; 37 can run I1204 12:35:09.742922 17225 executor.go:111] Tasks: 37 done / 49 total; 6 can run I1204 12:35:09.746826 17225 executor.go:111] Tasks: 43 done / 49 total; 6 can run I1204 12:35:09.747795 17225 executor.go:111] Tasks: 49 done / 49 total; 0 can run I1204 12:35:09.749552 17225 target.go:111] Terraform output is in /tmp/test2415930812/out I1204 12:35:09.752111 17225 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (1.13s) === RUN TestHA I1204 12:35:09.752249 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:09.752350 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:09.752380 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:09.752416 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:09.752445 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:09.752486 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:09.752514 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:09.752532 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:09.752559 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:09.752584 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:09.781906 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:09.784966 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:09.785038 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:09.785076 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:09.785110 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:10.359746 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:10.508512 17225 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1204 12:35:10.509003 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:10.509022 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:10.509075 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:10.512265 17225 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1204 12:35:10.519559 17225 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1204 12:35:10.519914 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:10.520131 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:10.520285 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:10.520346 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:10.520499 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:10.520565 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:10.520819 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:10.520877 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:10.520940 17225 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1204 12:35:10.521197 17225 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1204 12:35:10.521442 17225 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1204 12:35:10.526977 17225 target.go:111] Terraform output is in /tmp/test3650338131/out --- PASS: TestHA (0.78s) === RUN TestHighAvailabilityGCE I1204 12:35:10.531366 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:10.532944 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:35:11.519606 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:35:11.519729 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:35:11.519963 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W1204 12:35:11.519991 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W1204 12:35:11.520018 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W1204 12:35:11.520135 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1204 12:35:11.520264 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups W1204 12:35:11.520389 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1204 12:35:11.524665 17225 executor.go:111] Tasks: 0 done / 82 total; 49 can run I1204 12:35:11.530376 17225 executor.go:111] Tasks: 49 done / 82 total; 19 can run I1204 12:35:11.535159 17225 executor.go:111] Tasks: 68 done / 82 total; 8 can run I1204 12:35:11.536029 17225 executor.go:111] Tasks: 76 done / 82 total; 6 can run I1204 12:35:11.536290 17225 executor.go:111] Tasks: 82 done / 82 total; 0 can run I1204 12:35:11.539896 17225 target.go:111] Terraform output is in /tmp/test1541098603/out --- PASS: TestHighAvailabilityGCE (1.01s) === RUN TestComplex I1204 12:35:11.543613 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:11.543723 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:11.543760 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:11.543835 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:11.543866 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:11.543904 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:11.543935 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:11.543953 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:11.543979 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:11.544003 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:11.570428 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:35:11.573784 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:11.573862 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:12.527179 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:12.654537 17225 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1204 12:35:12.655059 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:12.655087 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:12.655189 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:12.657002 17225 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1204 12:35:12.659553 17225 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1204 12:35:12.660196 17225 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1204 12:35:12.660328 17225 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1204 12:35:12.660386 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:12.660423 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:12.660523 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:12.660585 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:12.664878 17225 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1204 12:35:12.665098 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:12.665320 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:12.665662 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:12.665933 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:12.666019 17225 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1204 12:35:12.666353 17225 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1204 12:35:12.666574 17225 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1204 12:35:12.671803 17225 target.go:111] Terraform output is in /tmp/test3584025842/out I1204 12:35:12.686370 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:12.686466 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:12.686501 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:12.686538 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:12.686566 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:12.686598 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:12.686630 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:12.686648 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:12.686672 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:12.686690 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:12.706846 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:35:12.709392 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:12.709454 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:13.284576 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:13.430441 17225 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1204 12:35:13.431434 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:13.431470 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:13.431543 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:13.434096 17225 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1204 12:35:13.439161 17225 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1204 12:35:13.440767 17225 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1204 12:35:13.440967 17225 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1204 12:35:13.441033 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:13.441093 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:13.441207 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:13.441273 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:13.445518 17225 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1204 12:35:13.445646 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:13.445817 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:13.446247 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:13.446664 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:13.446804 17225 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1204 12:35:13.447022 17225 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1204 12:35:13.447251 17225 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1204 12:35:13.452875 17225 target.go:111] Terraform output is in /tmp/test4253697454/out --- PASS: TestComplex (1.91s) === RUN TestCompress I1204 12:35:13.456409 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:13.456511 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:13.456540 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:13.456575 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:13.456603 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:13.456636 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:13.456677 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:13.456697 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:13.456722 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:13.456742 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:13.474703 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:13.477431 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:13.477494 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.054170 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:14.194458 17225 executor.go:111] Tasks: 0 done / 100 total; 44 can run I1204 12:35:14.196300 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:14.196330 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:14.196423 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:14.198886 17225 executor.go:111] Tasks: 44 done / 100 total; 23 can run I1204 12:35:14.207676 17225 executor.go:111] Tasks: 67 done / 100 total; 25 can run I1204 12:35:14.207917 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.208278 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.209369 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.209977 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.210067 17225 executor.go:111] Tasks: 92 done / 100 total; 2 can run I1204 12:35:14.210320 17225 executor.go:111] Tasks: 94 done / 100 total; 6 can run I1204 12:35:14.210571 17225 executor.go:111] Tasks: 100 done / 100 total; 0 can run I1204 12:35:14.214616 17225 target.go:111] Terraform output is in /tmp/test2945344384/out --- PASS: TestCompress (0.76s) === RUN TestExternalPolicies I1204 12:35:14.218059 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:14.218177 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:14.218210 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:14.218247 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:14.218277 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:14.218314 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:14.218351 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:14.218371 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:14.218397 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:14.218417 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:14.240377 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:14.243321 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.243382 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.821503 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:14.950156 17225 executor.go:111] Tasks: 0 done / 115 total; 47 can run I1204 12:35:14.952789 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:14.952803 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:14.952860 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:14.954383 17225 executor.go:111] Tasks: 47 done / 115 total; 22 can run I1204 12:35:14.956807 17225 executor.go:111] Tasks: 69 done / 115 total; 30 can run I1204 12:35:14.957483 17225 executor.go:111] Tasks: 99 done / 115 total; 4 can run W1204 12:35:14.957572 17225 api.go:53] PageSize not implemented W1204 12:35:14.957686 17225 api.go:53] PageSize not implemented I1204 12:35:14.962176 17225 executor.go:111] Tasks: 103 done / 115 total; 4 can run I1204 12:35:14.962335 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.962525 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.962735 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.963148 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:14.963236 17225 executor.go:111] Tasks: 107 done / 115 total; 2 can run I1204 12:35:14.963522 17225 executor.go:111] Tasks: 109 done / 115 total; 6 can run I1204 12:35:14.963718 17225 executor.go:111] Tasks: 115 done / 115 total; 0 can run I1204 12:35:14.968358 17225 target.go:111] Terraform output is in /tmp/test1952663501/out --- PASS: TestExternalPolicies (0.75s) === RUN TestMinimalIPv6 I1204 12:35:14.971942 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:14.972041 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:14.972069 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:14.972099 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:14.972152 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:14.972201 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:14.972272 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:14.972294 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:14.972321 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:14.972341 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:14.998054 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:15.000969 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:15.001033 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:15.583011 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:15.709550 17225 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1204 12:35:15.709924 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:15.709952 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:15.710038 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:15.713870 17225 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1204 12:35:15.716171 17225 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1204 12:35:15.716904 17225 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1204 12:35:15.717228 17225 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1204 12:35:15.717281 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:15.717335 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:15.717398 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:15.717469 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:15.721375 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:35:15.721508 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:15.721681 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:15.722793 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:15.722885 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:15.722991 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:35:15.723627 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:35:15.724316 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:35:15.732223 17225 target.go:111] Terraform output is in /tmp/test3427079104/out --- PASS: TestMinimalIPv6 (0.76s) === RUN TestMinimalIPv6Calico I1204 12:35:15.736534 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:15.736633 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:15.736662 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:15.736732 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:15.736760 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:15.736793 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:15.736821 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:15.736841 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:15.736866 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:15.736885 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:15.759002 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:15.761955 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:15.762016 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:16.329158 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:16.673618 17225 executor.go:111] Tasks: 0 done / 138 total; 47 can run I1204 12:35:16.674612 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:16.674649 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:16.674766 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:16.676846 17225 executor.go:111] Tasks: 47 done / 138 total; 25 can run I1204 12:35:16.679588 17225 executor.go:111] Tasks: 72 done / 138 total; 37 can run I1204 12:35:16.680346 17225 executor.go:111] Tasks: 109 done / 138 total; 9 can run I1204 12:35:16.680639 17225 executor.go:111] Tasks: 118 done / 138 total; 8 can run I1204 12:35:16.680752 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:16.680816 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:16.680906 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:16.680977 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:16.685041 17225 executor.go:111] Tasks: 126 done / 138 total; 4 can run I1204 12:35:16.685201 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:16.685304 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:16.685657 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:16.685748 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:16.685824 17225 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1204 12:35:16.686063 17225 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1204 12:35:16.686301 17225 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1204 12:35:16.692555 17225 target.go:111] Terraform output is in /tmp/test3512142297/out --- PASS: TestMinimalIPv6Calico (0.96s) === RUN TestMinimalIPv6Cilium I1204 12:35:16.697151 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:16.697267 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:16.697300 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:16.697336 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:16.697366 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:16.697405 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:16.697471 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:16.697491 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:16.697519 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:16.697540 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:16.724223 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:16.727464 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:16.727535 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:17.294447 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:17.464096 17225 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1204 12:35:17.469807 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:17.469826 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:17.469862 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:17.469893 17225 executor.go:111] Tasks: 47 done / 137 total; 25 can run I1204 12:35:17.471259 17225 executor.go:111] Tasks: 72 done / 137 total; 36 can run I1204 12:35:17.471883 17225 executor.go:111] Tasks: 108 done / 137 total; 9 can run I1204 12:35:17.472204 17225 executor.go:111] Tasks: 117 done / 137 total; 8 can run I1204 12:35:17.472298 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:17.472352 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:17.472440 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:17.472468 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:17.475590 17225 executor.go:111] Tasks: 125 done / 137 total; 4 can run I1204 12:35:17.475681 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:17.475809 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:17.475991 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:17.476126 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:17.476204 17225 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1204 12:35:17.476421 17225 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1204 12:35:17.476559 17225 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1204 12:35:17.479826 17225 target.go:111] Terraform output is in /tmp/test1352363291/out --- PASS: TestMinimalIPv6Cilium (0.78s) === RUN TestMinimalIPv6NoSubnetPrefix I1204 12:35:17.482050 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:17.482122 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:17.482142 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:17.482163 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:17.482179 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:17.482201 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:17.482242 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:17.482253 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:17.482271 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:17.482284 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:17.495105 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:17.496925 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:17.496966 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:18.070437 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:18.215391 17225 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1204 12:35:18.216267 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:18.216310 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:18.216424 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:18.218271 17225 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1204 12:35:18.220825 17225 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1204 12:35:18.221523 17225 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1204 12:35:18.222165 17225 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1204 12:35:18.222293 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:18.222348 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:18.222454 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:18.222518 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:18.226559 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:35:18.226709 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:18.226904 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:18.227143 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:18.227452 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:18.227539 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:35:18.227774 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:35:18.227993 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:35:18.235067 17225 target.go:111] Terraform output is in /tmp/test4277800180/out --- PASS: TestMinimalIPv6NoSubnetPrefix (0.76s) === RUN TestMinimalWarmPool I1204 12:35:18.238856 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:18.238985 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:18.239028 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:18.239087 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:18.239152 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:18.239219 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:18.239260 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:18.239301 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:18.239349 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:18.239382 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:18.262481 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:18.265864 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:18.265933 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:18.836633 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:19.000165 17225 executor.go:111] Tasks: 0 done / 102 total; 46 can run I1204 12:35:19.002188 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:19.002216 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:19.003045 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:19.004057 17225 executor.go:111] Tasks: 46 done / 102 total; 23 can run I1204 12:35:19.010771 17225 executor.go:111] Tasks: 69 done / 102 total; 25 can run I1204 12:35:19.011657 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.012047 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.012104 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.012594 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.012675 17225 executor.go:111] Tasks: 94 done / 102 total; 2 can run I1204 12:35:19.012886 17225 executor.go:111] Tasks: 96 done / 102 total; 6 can run I1204 12:35:19.013055 17225 executor.go:111] Tasks: 102 done / 102 total; 0 can run I1204 12:35:19.017460 17225 target.go:111] Terraform output is in /tmp/test2551844073/out --- PASS: TestMinimalWarmPool (0.78s) === RUN TestMinimalEtcd I1204 12:35:19.021161 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:19.021270 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:19.021301 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:19.021338 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:19.021369 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:19.021404 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:19.021434 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:19.021453 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:19.021480 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:19.021499 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:19.041522 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:19.044112 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.044297 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.613524 17225 zones.go:93] ListHostedZonesPages { } W1204 12:35:19.742264 17225 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W1204 12:35:19.742316 17225 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W1204 12:35:19.744499 17225 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I1204 12:35:19.754957 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:35:19.755558 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:19.755584 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:19.755657 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:19.757694 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:35:19.761746 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:35:19.762022 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.762178 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.762638 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.762709 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.762770 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:35:19.762984 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:35:19.763248 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:35:19.767429 17225 target.go:111] Terraform output is in /tmp/test3573340267/out --- PASS: TestMinimalEtcd (0.75s) === RUN TestMinimalGp3 I1204 12:35:19.771085 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:19.771211 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:19.771246 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:19.771289 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:19.771320 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:19.771358 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:19.771394 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:19.771413 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:19.771439 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:19.771461 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:19.791954 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:19.794606 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:19.794681 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:20.368543 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:20.495295 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:35:20.497948 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:20.497985 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:20.498055 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:20.498876 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:35:20.503223 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:35:20.503592 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:20.503833 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:20.504237 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:20.504308 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:20.504366 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:35:20.504613 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:35:20.504790 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:35:20.508939 17225 target.go:111] Terraform output is in /tmp/test3413703130/out --- PASS: TestMinimalGp3 (0.74s) === RUN TestMinimalLongClusterName I1204 12:35:20.512515 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:20.512624 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:20.512657 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:20.512691 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:20.512718 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:20.512754 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:20.512787 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:20.512807 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:20.512833 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:20.512852 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:20.534784 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:20.537394 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:20.537488 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1204 12:35:21.105087 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:21.240328 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:35:21.242983 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:21.243013 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:21.243134 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:21.244962 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:35:21.249392 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:35:21.249687 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:21.249819 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:21.250010 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:21.250368 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:21.250452 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:35:21.250651 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:35:21.250879 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:35:21.255178 17225 target.go:111] Terraform output is in /tmp/test191757910/out --- PASS: TestMinimalLongClusterName (0.75s) === RUN TestExistingSG I1204 12:35:21.262304 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:21.262419 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:21.262453 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:21.262493 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:21.262523 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:21.262559 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:21.262593 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:21.262612 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:21.262638 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:21.262659 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:21.288628 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:21.291733 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:21.291804 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:21.291847 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:21.291883 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:21.862642 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:22.003231 17225 executor.go:111] Tasks: 0 done / 163 total; 53 can run I1204 12:35:22.006232 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:22.006277 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:22.006359 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:22.010861 17225 executor.go:111] Tasks: 53 done / 163 total; 26 can run I1204 12:35:22.015936 17225 executor.go:111] Tasks: 79 done / 163 total; 54 can run I1204 12:35:22.018039 17225 executor.go:111] Tasks: 133 done / 163 total; 6 can run W1204 12:35:22.018100 17225 api.go:53] PageSize not implemented W1204 12:35:22.018169 17225 api.go:53] PageSize not implemented W1204 12:35:22.018219 17225 api.go:53] PageSize not implemented W1204 12:35:22.018328 17225 api.go:53] PageSize not implemented I1204 12:35:22.022423 17225 executor.go:111] Tasks: 139 done / 163 total; 8 can run I1204 12:35:22.022560 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.022736 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.022924 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.022998 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.023140 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.023335 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.023476 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.023553 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.023638 17225 executor.go:111] Tasks: 147 done / 163 total; 4 can run I1204 12:35:22.023891 17225 executor.go:111] Tasks: 151 done / 163 total; 12 can run I1204 12:35:22.024214 17225 executor.go:111] Tasks: 163 done / 163 total; 0 can run I1204 12:35:22.030658 17225 target.go:111] Terraform output is in /tmp/test1207347324/out --- PASS: TestExistingSG (0.77s) === RUN TestBastionAdditionalUserData I1204 12:35:22.035060 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:22.035182 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:22.035212 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:22.035245 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:22.035274 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:22.035319 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:22.035349 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:22.035366 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:22.035393 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:22.035413 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:22.059674 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:22.063965 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.064037 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.064077 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.627218 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:22.766858 17225 executor.go:111] Tasks: 0 done / 137 total; 47 can run I1204 12:35:22.767813 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:22.767832 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:22.767900 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:22.773825 17225 executor.go:111] Tasks: 47 done / 137 total; 30 can run I1204 12:35:22.776788 17225 executor.go:111] Tasks: 77 done / 137 total; 35 can run I1204 12:35:22.777502 17225 executor.go:111] Tasks: 112 done / 137 total; 6 can run W1204 12:35:22.777607 17225 api.go:53] PageSize not implemented W1204 12:35:22.777717 17225 api.go:53] PageSize not implemented W1204 12:35:22.777839 17225 api.go:53] PageSize not implemented I1204 12:35:22.782130 17225 executor.go:111] Tasks: 118 done / 137 total; 7 can run I1204 12:35:22.782299 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.782538 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.782754 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.782995 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.783071 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.783187 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.783296 17225 executor.go:111] Tasks: 125 done / 137 total; 3 can run I1204 12:35:22.783566 17225 executor.go:111] Tasks: 128 done / 137 total; 9 can run I1204 12:35:22.783818 17225 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1204 12:35:22.789507 17225 target.go:111] Terraform output is in /tmp/test138111034/out --- PASS: TestBastionAdditionalUserData (0.76s) === RUN TestPrivateFlannel I1204 12:35:22.793726 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:22.793834 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:22.793868 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:22.793901 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:22.793930 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:22.793965 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:22.794032 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:22.794054 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:22.794082 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:22.794103 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:22.816389 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:22.819217 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.819283 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:22.819323 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:23.378523 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:23.529891 17225 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1204 12:35:23.530434 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:23.530483 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:23.530595 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:23.537399 17225 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1204 12:35:23.540280 17225 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1204 12:35:23.540670 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:23.540863 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:23.540959 17225 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1204 12:35:23.541063 17225 api.go:53] PageSize not implemented W1204 12:35:23.541155 17225 api.go:53] PageSize not implemented I1204 12:35:23.545335 17225 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1204 12:35:23.545466 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:23.545572 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:23.545832 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:23.546218 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:23.546321 17225 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1204 12:35:23.546554 17225 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1204 12:35:23.546799 17225 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1204 12:35:23.552625 17225 target.go:111] Terraform output is in /tmp/test896034838/out --- PASS: TestPrivateFlannel (0.76s) === RUN TestPrivateCalico I1204 12:35:23.556963 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:23.557073 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:23.557106 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:23.557165 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:23.557196 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:23.557233 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:23.557303 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:23.557322 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:23.557351 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:23.557373 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:23.580696 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:23.583707 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:23.583772 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:23.583812 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:24.156423 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:24.482807 17225 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1204 12:35:24.483602 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:24.483633 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:24.483715 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:24.485666 17225 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1204 12:35:24.488163 17225 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1204 12:35:24.488567 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:24.488770 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:24.488973 17225 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1204 12:35:24.489103 17225 api.go:53] PageSize not implemented W1204 12:35:24.489154 17225 api.go:53] PageSize not implemented I1204 12:35:24.493298 17225 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1204 12:35:24.493438 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:24.493627 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:24.494027 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:24.494103 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:24.494185 17225 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1204 12:35:24.494408 17225 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1204 12:35:24.494663 17225 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1204 12:35:24.500404 17225 target.go:111] Terraform output is in /tmp/test977109138/out --- PASS: TestPrivateCalico (0.95s) === RUN TestPrivateCilium I1204 12:35:24.505503 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:24.505610 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:24.505639 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:24.505674 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:24.505701 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:24.505740 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:24.505769 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:24.505794 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:24.505823 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:24.505843 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:24.533904 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:24.537294 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:24.537374 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:24.537416 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.110324 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:25.281253 17225 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1204 12:35:25.282648 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:25.282701 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:25.282849 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:25.289434 17225 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1204 12:35:25.291839 17225 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1204 12:35:25.292247 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.292389 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.292505 17225 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1204 12:35:25.292578 17225 api.go:53] PageSize not implemented W1204 12:35:25.292618 17225 api.go:53] PageSize not implemented I1204 12:35:25.296830 17225 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1204 12:35:25.297180 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.297433 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.297811 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.297864 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.297973 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:35:25.298234 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:35:25.298475 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:35:25.304103 17225 target.go:111] Terraform output is in /tmp/test1942746729/out --- PASS: TestPrivateCilium (0.80s) === RUN TestPrivateCilium2 I1204 12:35:25.308367 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:25.308476 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:25.308510 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:25.308545 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:25.308573 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:25.308608 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:25.308679 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:25.308702 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:25.308728 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:25.308750 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:25.331874 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:35:25.336972 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.337162 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.337268 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:25.895717 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:26.453630 17225 executor.go:111] Tasks: 0 done / 138 total; 50 can run I1204 12:35:26.456447 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:26.456517 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:26.456687 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:26.462398 17225 executor.go:111] Tasks: 50 done / 138 total; 30 can run I1204 12:35:26.464917 17225 executor.go:111] Tasks: 80 done / 138 total; 36 can run I1204 12:35:26.465269 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:26.465408 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:26.465592 17225 executor.go:111] Tasks: 116 done / 138 total; 6 can run W1204 12:35:26.465691 17225 api.go:53] PageSize not implemented W1204 12:35:26.465806 17225 api.go:53] PageSize not implemented I1204 12:35:26.469968 17225 executor.go:111] Tasks: 122 done / 138 total; 8 can run I1204 12:35:26.470154 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:26.470294 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:26.470525 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:26.470845 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:26.470950 17225 executor.go:111] Tasks: 130 done / 138 total; 2 can run I1204 12:35:26.471242 17225 executor.go:111] Tasks: 132 done / 138 total; 6 can run I1204 12:35:26.471450 17225 executor.go:111] Tasks: 138 done / 138 total; 0 can run I1204 12:35:26.477679 17225 target.go:111] Terraform output is in /tmp/test1122162108/out --- PASS: TestPrivateCilium2 (1.18s) === RUN TestPrivateCiliumAdvanced I1204 12:35:26.486274 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:26.486395 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:26.486428 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:26.486468 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:26.486500 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:26.486537 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:26.486570 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:26.486590 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:26.486618 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:26.486638 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:26.516444 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:26.519551 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:26.519610 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:26.519649 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.085230 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:27.279585 17225 executor.go:111] Tasks: 0 done / 142 total; 54 can run I1204 12:35:27.280020 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:27.280057 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:27.281267 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:27.288675 17225 executor.go:111] Tasks: 54 done / 142 total; 30 can run I1204 12:35:27.291589 17225 executor.go:111] Tasks: 84 done / 142 total; 36 can run I1204 12:35:27.292010 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.292181 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.292269 17225 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1204 12:35:27.292398 17225 api.go:53] PageSize not implemented W1204 12:35:27.292525 17225 api.go:53] PageSize not implemented I1204 12:35:27.297330 17225 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1204 12:35:27.297481 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.297659 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.298080 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.298171 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.298248 17225 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1204 12:35:27.298487 17225 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1204 12:35:27.298704 17225 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1204 12:35:27.304739 17225 target.go:111] Terraform output is in /tmp/test4141339213/out --- PASS: TestPrivateCiliumAdvanced (0.82s) === RUN TestPrivateCiliumENI I1204 12:35:27.309374 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:27.309497 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:27.309531 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:27.309572 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:27.309605 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:27.309639 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:27.309672 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:27.309695 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:27.309725 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:27.309746 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:27.329819 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:27.332632 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.332692 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.332729 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:27.906001 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:28.095556 17225 executor.go:111] Tasks: 0 done / 136 total; 48 can run I1204 12:35:28.097891 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:28.097917 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:28.097987 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:28.099527 17225 executor.go:111] Tasks: 48 done / 136 total; 30 can run I1204 12:35:28.102214 17225 executor.go:111] Tasks: 78 done / 136 total; 36 can run I1204 12:35:28.102389 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:28.102513 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:28.102848 17225 executor.go:111] Tasks: 114 done / 136 total; 6 can run W1204 12:35:28.102930 17225 api.go:53] PageSize not implemented W1204 12:35:28.102969 17225 api.go:53] PageSize not implemented I1204 12:35:28.107181 17225 executor.go:111] Tasks: 120 done / 136 total; 8 can run I1204 12:35:28.107321 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:28.107517 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:28.107661 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:28.108071 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:28.108190 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:35:28.108411 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:35:28.108667 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:35:28.118996 17225 target.go:111] Terraform output is in /tmp/test3491778297/out --- PASS: TestPrivateCiliumENI (0.81s) === RUN TestPrivateCanal I1204 12:35:28.123811 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:28.124011 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:28.124044 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:28.124133 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:28.124166 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:28.124201 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:28.124233 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:28.124253 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:28.124280 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:28.124302 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:28.145309 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:28.148017 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:28.148078 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:28.148133 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:28.722037 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:29.041483 17225 executor.go:111] Tasks: 0 done / 137 total; 49 can run I1204 12:35:29.042886 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:29.042940 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:29.043051 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:29.044491 17225 executor.go:111] Tasks: 49 done / 137 total; 30 can run I1204 12:35:29.046596 17225 executor.go:111] Tasks: 79 done / 137 total; 36 can run I1204 12:35:29.046852 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.047018 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.047203 17225 executor.go:111] Tasks: 115 done / 137 total; 6 can run W1204 12:35:29.047323 17225 api.go:53] PageSize not implemented W1204 12:35:29.047443 17225 api.go:53] PageSize not implemented I1204 12:35:29.051406 17225 executor.go:111] Tasks: 121 done / 137 total; 8 can run I1204 12:35:29.051706 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.051902 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.052258 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.052335 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.052390 17225 executor.go:111] Tasks: 129 done / 137 total; 2 can run I1204 12:35:29.052602 17225 executor.go:111] Tasks: 131 done / 137 total; 6 can run I1204 12:35:29.052837 17225 executor.go:111] Tasks: 137 done / 137 total; 0 can run I1204 12:35:29.058290 17225 target.go:111] Terraform output is in /tmp/test2390013618/out --- PASS: TestPrivateCanal (0.94s) === RUN TestPrivateKopeio I1204 12:35:29.063250 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:29.063357 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:29.063388 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:29.063423 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:29.063450 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:29.063486 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:29.063518 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:29.063539 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:29.063565 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:29.063585 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:29.090559 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:29.093486 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.093553 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.093593 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.667564 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:29.821037 17225 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1204 12:35:29.823357 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:29.823392 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:29.823478 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:29.824838 17225 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1204 12:35:29.827249 17225 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1204 12:35:29.827835 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.827976 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.828065 17225 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1204 12:35:29.828236 17225 api.go:53] PageSize not implemented W1204 12:35:29.828333 17225 api.go:53] PageSize not implemented I1204 12:35:29.832315 17225 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1204 12:35:29.832553 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.832675 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.832953 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.833291 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.833392 17225 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1204 12:35:29.833612 17225 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1204 12:35:29.833870 17225 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1204 12:35:29.844780 17225 target.go:111] Terraform output is in /tmp/test4283152957/out --- PASS: TestPrivateKopeio (0.79s) === RUN TestUnmanaged I1204 12:35:29.848706 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:29.848816 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:29.848847 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:29.848882 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:29.848913 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:29.848948 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:29.848979 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:29.848998 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:29.849024 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:29.849044 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:29.871620 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:29.874499 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.874558 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:29.874595 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:30.445416 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:30.586257 17225 executor.go:111] Tasks: 0 done / 126 total; 46 can run I1204 12:35:30.587050 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:30.587077 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:30.587182 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:30.589072 17225 executor.go:111] Tasks: 46 done / 126 total; 27 can run I1204 12:35:30.591919 17225 executor.go:111] Tasks: 73 done / 126 total; 33 can run I1204 12:35:30.592185 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:30.592373 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:30.592576 17225 executor.go:111] Tasks: 106 done / 126 total; 5 can run W1204 12:35:30.592667 17225 api.go:53] PageSize not implemented W1204 12:35:30.592704 17225 api.go:53] PageSize not implemented I1204 12:35:30.599571 17225 executor.go:111] Tasks: 111 done / 126 total; 7 can run I1204 12:35:30.599869 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:30.600580 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:30.601634 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:30.602033 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:30.602143 17225 executor.go:111] Tasks: 118 done / 126 total; 2 can run I1204 12:35:30.602414 17225 executor.go:111] Tasks: 120 done / 126 total; 6 can run I1204 12:35:30.602793 17225 executor.go:111] Tasks: 126 done / 126 total; 0 can run I1204 12:35:30.608353 17225 target.go:111] Terraform output is in /tmp/test3778742063/out --- PASS: TestUnmanaged (0.76s) === RUN TestPrivateSharedSubnet I1204 12:35:30.612127 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:30.612229 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:30.612259 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:30.612296 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:30.612325 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:30.612361 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:30.612394 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:30.612412 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:30.612439 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:30.612460 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:30.633549 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:30.636223 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:30.636284 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:30.636322 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.204025 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:31.346825 17225 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1204 12:35:31.347803 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:31.347848 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:31.349460 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:31.353850 17225 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1204 12:35:31.354715 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:35:31.355427 17225 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1204 12:35:31.355555 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.355709 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.355842 17225 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1204 12:35:31.355882 17225 api.go:53] PageSize not implemented W1204 12:35:31.355913 17225 api.go:53] PageSize not implemented I1204 12:35:31.360088 17225 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1204 12:35:31.360340 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.360519 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.360739 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.360926 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.361015 17225 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1204 12:35:31.361215 17225 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1204 12:35:31.361435 17225 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1204 12:35:31.366529 17225 target.go:111] Terraform output is in /tmp/test3235789776/out --- PASS: TestPrivateSharedSubnet (0.76s) === RUN TestPrivateSharedIP I1204 12:35:31.370530 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:31.370656 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:31.370690 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:31.370728 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:31.370760 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:31.370798 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:31.370831 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:31.370850 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:31.370879 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:31.370899 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:31.393440 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:31.396079 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.396157 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.396198 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:31.969814 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:32.118214 17225 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1204 12:35:32.118700 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:32.118738 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:32.118819 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:32.124414 17225 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1204 12:35:32.125971 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:35:32.128701 17225 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1204 12:35:32.129220 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.129358 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.129532 17225 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1204 12:35:32.129583 17225 api.go:53] PageSize not implemented W1204 12:35:32.129713 17225 api.go:53] PageSize not implemented I1204 12:35:32.134212 17225 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1204 12:35:32.134418 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.134638 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.134818 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.135265 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.135349 17225 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1204 12:35:32.135604 17225 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1204 12:35:32.135823 17225 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1204 12:35:32.141273 17225 target.go:111] Terraform output is in /tmp/test2348203232/out --- PASS: TestPrivateSharedIP (0.77s) === RUN TestPrivateDns1 I1204 12:35:32.145174 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:32.145280 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:32.145313 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:32.145347 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:32.145376 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:32.145411 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:32.145448 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:32.145469 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:32.145497 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:32.145518 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1204 12:35:32.170408 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.170479 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.170520 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.942801 17225 executor.go:111] Tasks: 0 done / 135 total; 46 can run I1204 12:35:32.946064 17225 executor.go:111] Tasks: 46 done / 135 total; 28 can run I1204 12:35:32.947034 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I1204 12:35:32.947089 17225 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I1204 12:35:32.947236 17225 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I1204 12:35:32.947253 17225 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I1204 12:35:32.947564 17225 executor.go:111] Tasks: 74 done / 135 total; 39 can run I1204 12:35:32.949407 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.949681 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.953909 17225 executor.go:111] Tasks: 113 done / 135 total; 6 can run W1204 12:35:32.954073 17225 api.go:53] PageSize not implemented W1204 12:35:32.954156 17225 api.go:53] PageSize not implemented I1204 12:35:32.958659 17225 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1204 12:35:32.958904 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.959093 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.959527 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.959608 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.959671 17225 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1204 12:35:32.959964 17225 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1204 12:35:32.960227 17225 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1204 12:35:32.965905 17225 target.go:111] Terraform output is in /tmp/test4060049039/out --- PASS: TestPrivateDns1 (0.82s) === RUN TestPrivateDns2 I1204 12:35:32.969852 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:32.969962 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:32.969994 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:32.970036 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:32.970067 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:32.970102 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:32.970162 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:32.970180 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:32.970206 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:32.970227 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:32.994059 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.994135 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:32.994177 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:33.707972 17225 executor.go:111] Tasks: 0 done / 132 total; 45 can run I1204 12:35:33.711359 17225 executor.go:111] Tasks: 45 done / 132 total; 26 can run I1204 12:35:33.711519 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:35:33.711750 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I1204 12:35:33.711787 17225 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I1204 12:35:33.711861 17225 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I1204 12:35:33.711877 17225 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I1204 12:35:33.711962 17225 executor.go:111] Tasks: 71 done / 132 total; 39 can run I1204 12:35:33.712541 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:33.712672 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:33.714829 17225 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1204 12:35:33.714920 17225 api.go:53] PageSize not implemented W1204 12:35:33.715007 17225 api.go:53] PageSize not implemented I1204 12:35:33.719107 17225 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1204 12:35:33.719369 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:33.719592 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:33.719797 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:33.720190 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:33.720293 17225 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1204 12:35:33.720512 17225 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1204 12:35:33.720769 17225 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1204 12:35:33.725919 17225 target.go:111] Terraform output is in /tmp/test2078684792/out --- PASS: TestPrivateDns2 (0.76s) === RUN TestDiscoveryFeatureGate I1204 12:35:33.733796 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:33.733912 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:33.733943 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:33.733981 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:33.734010 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:33.734043 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:33.734106 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:33.734160 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:33.734193 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:33.734214 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:33.754249 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:35:33.756885 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:33.756948 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:34.330004 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:34.504869 17225 executor.go:111] Tasks: 0 done / 113 total; 52 can run I1204 12:35:34.507513 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:34.507555 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:34.507636 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:34.507698 17225 executor.go:111] Tasks: 52 done / 113 total; 28 can run I1204 12:35:34.511913 17225 executor.go:111] Tasks: 80 done / 113 total; 25 can run I1204 12:35:34.512287 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:34.512550 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:34.512910 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:34.512984 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:34.513044 17225 executor.go:111] Tasks: 105 done / 113 total; 2 can run I1204 12:35:34.513294 17225 executor.go:111] Tasks: 107 done / 113 total; 6 can run I1204 12:35:34.513557 17225 executor.go:111] Tasks: 113 done / 113 total; 0 can run I1204 12:35:34.518997 17225 target.go:111] Terraform output is in /tmp/test3604443082/out --- PASS: TestDiscoveryFeatureGate (0.79s) === RUN TestVFSServiceAccountIssuerDiscovery I1204 12:35:34.523571 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:34.523683 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:34.523717 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:34.523754 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:34.523785 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:34.523829 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:34.523859 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:34.523877 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:34.523906 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:34.523927 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:34.543174 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:34.545757 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:34.545823 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:35.116798 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:35.257691 17225 executor.go:111] Tasks: 0 done / 104 total; 47 can run I1204 12:35:35.258588 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:35.258618 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:35.258698 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:35.260529 17225 executor.go:111] Tasks: 47 done / 104 total; 24 can run I1204 12:35:35.264903 17225 executor.go:111] Tasks: 71 done / 104 total; 25 can run I1204 12:35:35.265329 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:35.265558 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:35.265945 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:35.266042 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:35.266181 17225 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1204 12:35:35.266436 17225 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1204 12:35:35.266672 17225 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1204 12:35:35.270935 17225 target.go:111] Terraform output is in /tmp/test2869567126/out --- PASS: TestVFSServiceAccountIssuerDiscovery (0.75s) === RUN TestAWSLBController I1204 12:35:35.274685 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:35.274792 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:35.274825 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:35.274861 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:35.274890 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:35.274927 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:35.274957 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:35.274978 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:35.275005 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:35.275027 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:35.294421 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:35.296943 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:35.297004 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:35.867384 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:36.448242 17225 executor.go:111] Tasks: 0 done / 116 total; 54 can run I1204 12:35:36.450312 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:36.450330 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:36.450386 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:36.454044 17225 executor.go:111] Tasks: 54 done / 116 total; 29 can run I1204 12:35:36.461639 17225 executor.go:111] Tasks: 83 done / 116 total; 25 can run I1204 12:35:36.461962 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:36.462158 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:36.462542 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:36.462665 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:36.462793 17225 executor.go:111] Tasks: 108 done / 116 total; 2 can run I1204 12:35:36.463060 17225 executor.go:111] Tasks: 110 done / 116 total; 6 can run I1204 12:35:36.463343 17225 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1204 12:35:36.469484 17225 target.go:111] Terraform output is in /tmp/test999872484/out --- PASS: TestAWSLBController (1.20s) === RUN TestManyAddons I1204 12:35:36.478188 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:36.478303 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:36.478336 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:36.478378 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:36.478410 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:36.478450 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:36.478484 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:36.478505 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:36.478535 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:36.478557 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:36.499989 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:36.502869 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:36.502929 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:37.067443 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:37.703812 17225 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1204 12:35:37.704521 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:37.704560 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:37.704640 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:37.708658 17225 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1204 12:35:37.713335 17225 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1204 12:35:37.713810 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:37.713970 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:37.714415 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:37.714503 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:37.714572 17225 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1204 12:35:37.714794 17225 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1204 12:35:37.715068 17225 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1204 12:35:37.720465 17225 target.go:111] Terraform output is in /tmp/test3818233912/out --- PASS: TestManyAddons (1.25s) === RUN TestManyAddonsCCMIRSA I1204 12:35:37.732205 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:37.732320 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:37.732352 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:37.732390 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:37.732429 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:37.732471 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:37.732503 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:37.732521 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:37.732549 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:37.732570 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:37.755292 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:37.758231 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:37.758295 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:38.321449 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:38.990369 17225 executor.go:111] Tasks: 0 done / 123 total; 59 can run I1204 12:35:38.992271 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:38.992319 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:38.992437 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:38.993728 17225 executor.go:111] Tasks: 59 done / 123 total; 30 can run I1204 12:35:39.003403 17225 executor.go:111] Tasks: 89 done / 123 total; 26 can run I1204 12:35:39.003600 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:39.003950 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:39.004164 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:39.004562 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:39.004683 17225 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1204 12:35:39.004940 17225 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1204 12:35:39.005170 17225 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1204 12:35:39.011913 17225 target.go:111] Terraform output is in /tmp/test2822579391/out --- PASS: TestManyAddonsCCMIRSA (1.29s) === RUN TestManyAddonsCCMIRSA23 I1204 12:35:39.020771 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:39.020885 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:39.020918 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:39.020951 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:39.020979 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:39.021016 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:39.021087 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:39.021106 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:39.021152 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:39.021175 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:39.042744 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1204 12:35:39.045652 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:39.045712 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:39.620543 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:40.293638 17225 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1204 12:35:40.295880 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:40.295924 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:40.296005 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:40.301700 17225 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1204 12:35:40.306193 17225 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1204 12:35:40.306531 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:40.306767 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:40.306920 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:40.307412 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:40.307505 17225 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1204 12:35:40.307757 17225 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1204 12:35:40.308009 17225 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1204 12:35:40.314963 17225 target.go:111] Terraform output is in /tmp/test2665123174/out --- PASS: TestManyAddonsCCMIRSA23 (1.30s) === RUN TestManyAddonsCCMIRSA24 I1204 12:35:40.324326 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:40.324435 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:40.324467 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:40.324502 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:40.324531 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:40.324567 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:40.324639 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:40.324658 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:40.324690 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:40.324711 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:40.349206 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:35:40.352320 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:40.352403 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:40.917804 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:41.544288 17225 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1204 12:35:41.546867 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:41.546909 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:41.547096 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:41.549736 17225 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1204 12:35:41.551910 17225 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1204 12:35:41.552049 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:41.552267 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:41.552857 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:41.552974 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:41.553072 17225 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1204 12:35:41.553292 17225 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1204 12:35:41.553541 17225 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1204 12:35:41.559724 17225 target.go:111] Terraform output is in /tmp/test3967452319/out --- PASS: TestManyAddonsCCMIRSA24 (1.25s) === RUN TestManyAddonsCCMIRSA25 I1204 12:35:41.577740 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:41.577815 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:41.577851 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:41.577886 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:41.577901 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:41.577925 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:41.577974 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:41.577984 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:41.578013 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:41.578026 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:41.590486 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1204 12:35:41.592245 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:41.592292 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:42.169852 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:42.830590 17225 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1204 12:35:42.833547 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:42.833584 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:42.833684 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:42.837026 17225 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1204 12:35:42.841670 17225 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1204 12:35:42.842054 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:42.842279 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:42.842448 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:42.842854 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:42.842950 17225 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1204 12:35:42.843277 17225 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1204 12:35:42.843541 17225 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1204 12:35:42.849875 17225 target.go:111] Terraform output is in /tmp/test1453533111/out --- PASS: TestManyAddonsCCMIRSA25 (1.28s) === RUN TestManyAddonsCCMIRSA26 I1204 12:35:42.861340 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:42.861465 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:42.861495 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:42.861532 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:42.861569 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:42.861604 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:42.861671 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:42.861691 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:42.861716 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:42.861736 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:42.884705 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1204 12:35:42.887637 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:42.887700 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:43.457460 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:44.167570 17225 executor.go:111] Tasks: 0 done / 124 total; 60 can run I1204 12:35:44.168779 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:44.168808 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:44.168884 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:44.170858 17225 executor.go:111] Tasks: 60 done / 124 total; 30 can run I1204 12:35:44.175529 17225 executor.go:111] Tasks: 90 done / 124 total; 26 can run I1204 12:35:44.175854 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:44.176090 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:44.176258 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:44.176647 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:44.176750 17225 executor.go:111] Tasks: 116 done / 124 total; 2 can run I1204 12:35:44.176959 17225 executor.go:111] Tasks: 118 done / 124 total; 6 can run I1204 12:35:44.177197 17225 executor.go:111] Tasks: 124 done / 124 total; 0 can run I1204 12:35:44.183460 17225 target.go:111] Terraform output is in /tmp/test1823677567/out --- PASS: TestManyAddonsCCMIRSA26 (1.34s) === RUN TestManyAddonsGCE I1204 12:35:44.197591 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:35:45.527817 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:35:45.527880 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:35:45.527933 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W1204 12:35:45.527944 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W1204 12:35:45.527953 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W1204 12:35:45.527992 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1204 12:35:45.528644 17225 executor.go:111] Tasks: 0 done / 67 total; 44 can run I1204 12:35:45.537288 17225 executor.go:111] Tasks: 44 done / 67 total; 17 can run I1204 12:35:45.541674 17225 executor.go:111] Tasks: 61 done / 67 total; 4 can run I1204 12:35:45.542370 17225 executor.go:111] Tasks: 65 done / 67 total; 2 can run I1204 12:35:45.542545 17225 executor.go:111] Tasks: 67 done / 67 total; 0 can run I1204 12:35:45.546043 17225 target.go:111] Terraform output is in /tmp/test764424515/out --- PASS: TestManyAddonsGCE (1.35s) === RUN TestCCM I1204 12:35:45.552330 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:45.552435 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:45.552467 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:45.552506 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:45.552537 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:45.552571 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:45.552608 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:45.552628 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:45.552654 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:45.552674 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:45.573863 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:45.576648 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:45.576710 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:46.144918 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:46.774280 17225 executor.go:111] Tasks: 0 done / 110 total; 51 can run I1204 12:35:46.774716 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:46.774738 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:46.774808 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:46.777362 17225 executor.go:111] Tasks: 51 done / 110 total; 24 can run I1204 12:35:46.781966 17225 executor.go:111] Tasks: 75 done / 110 total; 27 can run I1204 12:35:46.782319 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:46.782465 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:46.782694 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:46.783153 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:46.783249 17225 executor.go:111] Tasks: 102 done / 110 total; 2 can run I1204 12:35:46.783735 17225 executor.go:111] Tasks: 104 done / 110 total; 6 can run I1204 12:35:46.784002 17225 executor.go:111] Tasks: 110 done / 110 total; 0 can run I1204 12:35:46.789482 17225 target.go:111] Terraform output is in /tmp/test3099892434/out --- PASS: TestCCM (1.25s) === RUN TestExternalDNS I1204 12:35:46.798376 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:46.798490 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:46.798522 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:46.798562 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:46.798592 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:46.798627 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:46.798658 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:46.798677 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:46.798709 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:46.798731 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:46.824051 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:46.826674 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:46.826743 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:47.403343 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:47.548718 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:35:47.549484 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:47.549519 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:47.549600 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:47.552381 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:35:47.556809 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:35:47.557553 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:47.557798 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:47.558092 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:47.558173 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:47.558233 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:35:47.558425 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:35:47.558601 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:35:47.562736 17225 target.go:111] Terraform output is in /tmp/test2490244238/out --- PASS: TestExternalDNS (0.77s) === RUN TestExternalDNSIRSA I1204 12:35:47.566754 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:47.566865 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:47.566894 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:47.566931 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:47.566959 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:47.566994 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:47.567034 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:47.567056 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:47.567086 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:47.567106 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:47.591651 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:47.594481 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:47.594554 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:48.162498 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:48.328396 17225 executor.go:111] Tasks: 0 done / 112 total; 51 can run I1204 12:35:48.332905 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:48.332965 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:48.333199 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:48.335900 17225 executor.go:111] Tasks: 51 done / 112 total; 28 can run I1204 12:35:48.341089 17225 executor.go:111] Tasks: 79 done / 112 total; 25 can run I1204 12:35:48.341355 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:48.341583 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:48.341944 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:48.342020 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:48.342098 17225 executor.go:111] Tasks: 104 done / 112 total; 2 can run I1204 12:35:48.342332 17225 executor.go:111] Tasks: 106 done / 112 total; 6 can run I1204 12:35:48.342540 17225 executor.go:111] Tasks: 112 done / 112 total; 0 can run I1204 12:35:48.347561 17225 target.go:111] Terraform output is in /tmp/test4155947836/out --- PASS: TestExternalDNSIRSA (0.79s) === RUN TestKarpenter I1204 12:35:48.352065 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:48.352180 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:48.352214 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:48.352248 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:48.352276 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:48.352318 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:48.352348 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:48.352368 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:48.352394 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:48.352414 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:48.377013 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:48.379818 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:48.379873 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:48.379916 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:48.953056 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:49.112812 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.112930 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.113020 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1204 12:35:49.233811 17225 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W1204 12:35:49.233875 17225 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1204 12:35:49.233889 17225 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W1204 12:35:49.233897 17225 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W1204 12:35:49.233904 17225 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I1204 12:35:49.249454 17225 executor.go:111] Tasks: 0 done / 122 total; 54 can run I1204 12:35:49.253138 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:49.253179 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:49.253265 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:49.257096 17225 executor.go:111] Tasks: 54 done / 122 total; 31 can run I1204 12:35:49.263014 17225 executor.go:111] Tasks: 85 done / 122 total; 29 can run I1204 12:35:49.263269 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.263453 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.263609 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.263749 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.263819 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.264051 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.264227 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.264453 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.264559 17225 executor.go:111] Tasks: 114 done / 122 total; 2 can run I1204 12:35:49.264807 17225 executor.go:111] Tasks: 116 done / 122 total; 6 can run I1204 12:35:49.265064 17225 executor.go:111] Tasks: 122 done / 122 total; 0 can run I1204 12:35:49.271586 17225 target.go:111] Terraform output is in /tmp/test2255714550/out --- PASS: TestKarpenter (0.93s) === RUN TestSharedSubnet I1204 12:35:49.277545 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:49.277659 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:49.277704 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:49.277789 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:49.277822 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:49.277860 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:49.277893 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:49.277910 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:49.277938 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:49.277962 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:49.298167 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:49.300649 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.300717 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:49.874651 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:50.024211 17225 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1204 12:35:50.027144 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:50.027189 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:50.027313 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:50.029244 17225 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1204 12:35:50.030957 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:35:50.035562 17225 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1204 12:35:50.035843 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.036202 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.036408 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.036871 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.036964 17225 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1204 12:35:50.037243 17225 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1204 12:35:50.037511 17225 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1204 12:35:50.041803 17225 target.go:111] Terraform output is in /tmp/test1369609143/out --- PASS: TestSharedSubnet (0.77s) === RUN TestSharedVPC I1204 12:35:50.045493 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:50.045601 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:50.045634 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:50.045671 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:50.045700 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:50.045733 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:50.045765 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:50.045785 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:50.045810 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:50.045834 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:50.065403 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:50.067865 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.067925 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.638652 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:50.780545 17225 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1204 12:35:50.781691 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:50.781726 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:50.781798 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:50.783254 17225 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1204 12:35:50.783512 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:35:50.787652 17225 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1204 12:35:50.788018 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.788238 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.788404 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.788832 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.788929 17225 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1204 12:35:50.789181 17225 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1204 12:35:50.789467 17225 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1204 12:35:50.793715 17225 target.go:111] Terraform output is in /tmp/test551600556/out --- PASS: TestSharedVPC (0.75s) === RUN TestSharedVPCIPv6 I1204 12:35:50.797542 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:50.797650 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:50.797683 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:50.797718 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:50.797748 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:50.797782 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:50.797849 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:50.797871 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:50.797898 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:50.797920 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:50.799566 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:35:50.799635 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:35:50.824466 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:35:50.824518 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I1204 12:35:50.824585 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:35:50.827056 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:50.827105 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:51.391706 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:51.538208 17225 executor.go:111] Tasks: 0 done / 133 total; 45 can run I1204 12:35:51.538744 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:51.538777 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:51.538864 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:51.546475 17225 executor.go:111] Tasks: 45 done / 133 total; 29 can run I1204 12:35:51.546869 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:35:51.547036 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:35:51.549458 17225 executor.go:111] Tasks: 74 done / 133 total; 37 can run I1204 12:35:51.550132 17225 executor.go:111] Tasks: 111 done / 133 total; 6 can run I1204 12:35:51.550194 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:51.550258 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:51.550368 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:35:51.550431 17225 loadbalancers.go:35] PageSize not implemented I1204 12:35:51.554663 17225 executor.go:111] Tasks: 117 done / 133 total; 8 can run I1204 12:35:51.554809 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:51.554955 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:51.555164 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:51.555547 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:51.555632 17225 executor.go:111] Tasks: 125 done / 133 total; 2 can run I1204 12:35:51.555895 17225 executor.go:111] Tasks: 127 done / 133 total; 6 can run I1204 12:35:51.556101 17225 executor.go:111] Tasks: 133 done / 133 total; 0 can run I1204 12:35:51.561361 17225 target.go:111] Terraform output is in /tmp/test3583518062/out --- PASS: TestSharedVPCIPv6 (0.77s) === RUN TestExistingIAM I1204 12:35:51.565588 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:51.565689 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:51.565719 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:51.565749 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:51.565776 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:51.565809 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:51.565840 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:51.565858 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:51.565884 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:51.565906 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:51.591300 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:51.594207 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:51.594264 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:51.594302 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:51.594336 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.164637 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:52.320730 17225 executor.go:111] Tasks: 0 done / 117 total; 51 can run I1204 12:35:52.322877 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:52.322905 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:52.322984 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:52.328789 17225 executor.go:111] Tasks: 51 done / 117 total; 19 can run I1204 12:35:52.334514 17225 executor.go:111] Tasks: 70 done / 117 total; 31 can run I1204 12:35:52.334924 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.335132 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.335334 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.335452 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.335533 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.335704 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.335775 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.336173 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.336271 17225 executor.go:111] Tasks: 101 done / 117 total; 4 can run I1204 12:35:52.336594 17225 executor.go:111] Tasks: 105 done / 117 total; 12 can run I1204 12:35:52.336914 17225 executor.go:111] Tasks: 117 done / 117 total; 0 can run I1204 12:35:52.342403 17225 target.go:111] Terraform output is in /tmp/test2785401080/out --- PASS: TestExistingIAM (0.78s) === RUN TestPhaseNetwork I1204 12:35:52.346616 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:52.346723 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:52.346755 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:52.346793 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:52.346820 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:52.346855 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:52.346889 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:52.346908 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:52.346935 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:52.346956 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:52.368329 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:52.371127 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.371192 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.371235 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:52.945383 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:53.090850 17225 executor.go:111] Tasks: 0 done / 135 total; 47 can run I1204 12:35:53.091403 17225 executor.go:111] Tasks: 47 done / 135 total; 30 can run I1204 12:35:53.091829 17225 executor.go:111] Tasks: 77 done / 135 total; 36 can run I1204 12:35:53.092305 17225 executor.go:111] Tasks: 113 done / 135 total; 6 can run I1204 12:35:53.092459 17225 executor.go:111] Tasks: 119 done / 135 total; 8 can run I1204 12:35:53.092593 17225 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1204 12:35:53.092668 17225 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1204 12:35:53.092749 17225 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1204 12:35:53.093580 17225 target.go:111] Terraform output is in /tmp/test3937173182/out --- PASS: TestPhaseNetwork (0.75s) === RUN TestExternalLoadBalancer I1204 12:35:53.094037 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:53.094173 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:53.094207 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:53.094246 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:53.094276 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:53.094314 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:53.094349 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:53.094371 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:53.094400 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:53.094423 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:53.118928 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:53.121549 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.121626 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.694102 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:53.835652 17225 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1204 12:35:53.837411 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:53.837444 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:53.837521 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:53.838950 17225 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1204 12:35:53.843476 17225 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1204 12:35:53.843901 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.844144 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.845825 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.846024 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.846362 17225 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1204 12:35:53.846981 17225 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1204 12:35:53.848074 17225 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1204 12:35:53.854668 17225 target.go:111] Terraform output is in /tmp/test2481616277/out --- PASS: TestExternalLoadBalancer (0.76s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I1204 12:35:53.858585 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:53.858692 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:53.858725 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:53.858763 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:53.858794 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:53.858831 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:53.858862 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:53.858882 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:53.858909 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:53.858930 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:53.884454 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:53.887404 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.887467 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.887507 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.887542 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.887575 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.887606 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:53.887642 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.456721 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:54.595106 17225 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1204 12:35:54.595610 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:54.595665 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:54.595857 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:54.599077 17225 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1204 12:35:54.604818 17225 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1204 12:35:54.605136 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.605336 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.605561 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.605769 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.605934 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.606000 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.606064 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.606141 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.606240 17225 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1204 12:35:54.606499 17225 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1204 12:35:54.606763 17225 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1204 12:35:54.612817 17225 target.go:111] Terraform output is in /tmp/test3484607326/out --- PASS: TestMixedInstancesASG (0.76s) === RUN TestMixedInstancesSpotASG I1204 12:35:54.617712 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:54.617824 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:54.617857 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:54.617896 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:54.617927 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:54.617962 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:54.617994 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:54.618012 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:54.618079 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:54.618104 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:54.648085 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:54.651001 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.651064 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.651100 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.651145 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.651177 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.651204 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:54.651231 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.227670 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:55.383349 17225 executor.go:111] Tasks: 0 done / 127 total; 53 can run I1204 12:35:55.384257 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:55.384295 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:55.384377 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:55.386302 17225 executor.go:111] Tasks: 53 done / 127 total; 27 can run I1204 12:35:55.396664 17225 executor.go:111] Tasks: 80 done / 127 total; 31 can run I1204 12:35:55.396916 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.397187 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.397435 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.397607 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.397687 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.397908 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.398000 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.398386 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.398491 17225 executor.go:111] Tasks: 111 done / 127 total; 4 can run I1204 12:35:55.398826 17225 executor.go:111] Tasks: 115 done / 127 total; 12 can run I1204 12:35:55.399101 17225 executor.go:111] Tasks: 127 done / 127 total; 0 can run I1204 12:35:55.405216 17225 target.go:111] Terraform output is in /tmp/test1576111279/out --- PASS: TestMixedInstancesSpotASG (0.79s) === RUN TestAdditionalObjects I1204 12:35:55.409764 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:55.409876 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:55.409913 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:55.409951 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:55.409981 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:55.410019 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:55.410050 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:55.410071 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:55.410097 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:55.410131 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:55.430866 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1204 12:35:55.433548 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:55.433615 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.006435 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:56.129962 17225 executor.go:111] Tasks: 0 done / 104 total; 45 can run I1204 12:35:56.131324 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:56.131379 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:56.131496 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:56.133081 17225 executor.go:111] Tasks: 45 done / 104 total; 23 can run I1204 12:35:56.137935 17225 executor.go:111] Tasks: 68 done / 104 total; 28 can run I1204 12:35:56.138350 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.138551 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.138930 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.138976 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.139077 17225 executor.go:111] Tasks: 96 done / 104 total; 2 can run I1204 12:35:56.139313 17225 executor.go:111] Tasks: 98 done / 104 total; 6 can run I1204 12:35:56.139530 17225 executor.go:111] Tasks: 104 done / 104 total; 0 can run I1204 12:35:56.143951 17225 target.go:111] Terraform output is in /tmp/test3817394025/out --- PASS: TestAdditionalObjects (0.74s) === RUN TestContainerd I1204 12:35:56.147679 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:56.147794 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:56.147826 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:56.147860 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:56.147888 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:56.147930 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:56.147962 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:56.147981 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:56.148026 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:56.148050 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:56.171848 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:56.174343 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.174407 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.746753 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:56.895394 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:35:56.895962 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:56.895998 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:56.896079 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:56.897893 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:35:56.902635 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:35:56.902925 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.903156 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.903347 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.903735 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.903830 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:35:56.904074 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:35:56.904345 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:35:56.908748 17225 target.go:111] Terraform output is in /tmp/test700965030/out --- PASS: TestContainerd (0.77s) === RUN TestContainerdCustom I1204 12:35:56.916936 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:56.917053 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:56.917085 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:56.917146 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:56.917181 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:56.917220 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:56.917254 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:56.917273 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:56.917299 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:56.917322 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:56.939070 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:56.941794 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:56.941859 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:57.433261 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:57.568523 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:35:57.569090 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:57.569152 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:57.569248 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:57.572288 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:35:57.576683 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:35:57.577062 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:57.577232 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:57.577430 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:57.577853 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:57.577974 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:35:57.578269 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:35:57.578550 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:35:57.582625 17225 target.go:111] Terraform output is in /tmp/test2358498510/out --- PASS: TestContainerdCustom (0.67s) === RUN TestDockerCustom I1204 12:35:57.586301 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:57.586400 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:57.586430 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:57.586467 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:57.586497 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:57.586530 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:57.586559 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:57.586580 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:57.586606 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:57.586627 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:57.610960 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I1204 12:35:57.613761 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:57.613831 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:58.107261 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:58.242224 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:35:58.242616 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:58.242650 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:58.242738 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:58.245162 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:35:58.249725 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:35:58.250213 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:58.250420 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:58.250761 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:58.250829 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:58.250893 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:35:58.251102 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:35:58.251361 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:35:58.255784 17225 target.go:111] Terraform output is in /tmp/test4159111362/out --- PASS: TestDockerCustom (0.67s) === RUN TestAPIServerNodes I1204 12:35:58.259558 17225 featureflag.go:164] FeatureFlag "APIServerNodes"=true I1204 12:35:58.259578 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:58.259683 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:58.259716 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:58.259754 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:58.259784 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:58.259818 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:58.259853 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:58.259876 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:58.259906 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:58.259927 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:58.280856 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1204 12:35:58.283576 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:58.283640 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:58.283680 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:58.908282 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:59.047454 17225 executor.go:111] Tasks: 0 done / 114 total; 47 can run I1204 12:35:59.049943 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:59.049978 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:59.050049 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:59.051280 17225 executor.go:111] Tasks: 47 done / 114 total; 28 can run I1204 12:35:59.056037 17225 executor.go:111] Tasks: 75 done / 114 total; 27 can run I1204 12:35:59.056217 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.056587 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.056772 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.056847 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.056986 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.057159 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.057247 17225 executor.go:111] Tasks: 102 done / 114 total; 3 can run I1204 12:35:59.057477 17225 executor.go:111] Tasks: 105 done / 114 total; 9 can run I1204 12:35:59.057751 17225 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1204 12:35:59.062590 17225 target.go:111] Terraform output is in /tmp/test2917482583/out I1204 12:35:59.067105 17225 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (0.81s) === RUN TestNTHIMDSProcessor I1204 12:35:59.067228 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:59.067334 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:59.067367 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:59.067402 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:59.067431 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:59.067465 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:59.067495 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:59.067512 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:59.067539 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:59.067560 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:59.084402 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:59.086471 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.086520 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.657310 17225 zones.go:93] ListHostedZonesPages { } I1204 12:35:59.792130 17225 executor.go:111] Tasks: 0 done / 90 total; 44 can run I1204 12:35:59.793440 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:35:59.793475 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:35:59.793550 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:35:59.796229 17225 executor.go:111] Tasks: 44 done / 90 total; 19 can run I1204 12:35:59.800558 17225 executor.go:111] Tasks: 63 done / 90 total; 21 can run I1204 12:35:59.800875 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.801109 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.801486 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.801559 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.801630 17225 executor.go:111] Tasks: 84 done / 90 total; 2 can run I1204 12:35:59.801854 17225 executor.go:111] Tasks: 86 done / 90 total; 4 can run I1204 12:35:59.802040 17225 executor.go:111] Tasks: 90 done / 90 total; 0 can run I1204 12:35:59.805877 17225 target.go:111] Terraform output is in /tmp/test1853646621/out --- PASS: TestNTHIMDSProcessor (0.74s) === RUN TestNTHIMDSProcessorIRSA I1204 12:35:59.809471 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:59.809584 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:59.809616 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:59.809651 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:59.809680 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:59.809716 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:59.809746 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:59.809764 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:59.809796 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:59.809817 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:59.830420 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:35:59.832984 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:35:59.833044 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:00.398838 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:00.549357 17225 executor.go:111] Tasks: 0 done / 101 total; 50 can run I1204 12:36:00.550446 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:36:00.550482 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:00.550556 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:36:00.552308 17225 executor.go:111] Tasks: 50 done / 101 total; 24 can run I1204 12:36:00.557497 17225 executor.go:111] Tasks: 74 done / 101 total; 21 can run I1204 12:36:00.557899 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:00.558147 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:00.558564 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:00.558637 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:00.558711 17225 executor.go:111] Tasks: 95 done / 101 total; 2 can run I1204 12:36:00.558941 17225 executor.go:111] Tasks: 97 done / 101 total; 4 can run I1204 12:36:00.559128 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:36:00.563970 17225 target.go:111] Terraform output is in /tmp/test3575056397/out --- PASS: TestNTHIMDSProcessorIRSA (0.76s) === RUN TestCustomIRSA I1204 12:36:00.568003 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:00.568104 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:00.568147 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:00.568183 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:00.568213 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:00.568249 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:00.568278 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:00.568296 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:00.568323 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:00.568344 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:36:00.590030 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:00.597374 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:00.597464 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:01.174790 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:01.698151 17225 executor.go:111] Tasks: 0 done / 114 total; 52 can run I1204 12:36:01.700355 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:36:01.700403 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:01.700521 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:36:01.702574 17225 executor.go:111] Tasks: 52 done / 114 total; 29 can run I1204 12:36:01.707079 17225 executor.go:111] Tasks: 81 done / 114 total; 25 can run I1204 12:36:01.707354 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:01.707601 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:01.707959 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:01.708074 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:01.708180 17225 executor.go:111] Tasks: 106 done / 114 total; 2 can run I1204 12:36:01.708385 17225 executor.go:111] Tasks: 108 done / 114 total; 6 can run I1204 12:36:01.708644 17225 executor.go:111] Tasks: 114 done / 114 total; 0 can run I1204 12:36:01.714005 17225 target.go:111] Terraform output is in /tmp/test2569887027/out --- PASS: TestCustomIRSA (1.15s) === RUN TestClusterNameDigit I1204 12:36:01.720535 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:01.720641 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:01.720672 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:01.720707 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:01.720774 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:01.720833 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:01.720866 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:01.720886 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:01.720917 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:01.720938 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:36:01.742288 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:01.744421 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:01.744474 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:02.319589 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:02.467389 17225 executor.go:111] Tasks: 0 done / 109 total; 49 can run I1204 12:36:02.467864 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:36:02.467886 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:02.467955 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:36:02.470789 17225 executor.go:111] Tasks: 49 done / 109 total; 27 can run I1204 12:36:02.475327 17225 executor.go:111] Tasks: 76 done / 109 total; 25 can run I1204 12:36:02.475672 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:02.475918 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:02.476287 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:02.476353 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:02.476411 17225 executor.go:111] Tasks: 101 done / 109 total; 2 can run I1204 12:36:02.476604 17225 executor.go:111] Tasks: 103 done / 109 total; 6 can run I1204 12:36:02.476814 17225 executor.go:111] Tasks: 109 done / 109 total; 0 can run I1204 12:36:02.481638 17225 target.go:111] Terraform output is in /tmp/test3290801670/out --- PASS: TestClusterNameDigit (0.77s) === RUN TestCASPriorityExpander I1204 12:36:02.485900 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:02.486011 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:02.486044 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:02.486078 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:02.486127 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:02.486167 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:02.486201 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:02.486221 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:02.486248 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:02.486271 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:36:02.515280 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1204 12:36:02.518314 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:02.518389 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:02.518430 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:02.518464 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1204 12:36:03.472321 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:03.629828 17225 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1204 12:36:03.632002 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:36:03.632022 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:03.632078 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:36:03.633585 17225 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1204 12:36:03.641868 17225 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1204 12:36:03.642252 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.642523 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.642643 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.642727 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.642945 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.643099 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.643359 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.643614 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.643712 17225 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1204 12:36:03.644073 17225 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1204 12:36:03.644376 17225 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1204 12:36:03.649563 17225 target.go:111] Terraform output is in /tmp/test1147533622/out --- PASS: TestCASPriorityExpander (1.17s) === RUN TestCASPriorityExpanderCustom I1204 12:36:03.653888 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:03.654000 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:03.654033 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:03.654071 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:03.654101 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:03.654156 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:03.654191 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:03.654210 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:03.654241 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:03.654261 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:36:03.678533 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I1204 12:36:03.681619 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.681681 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.681720 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:03.681756 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1204 12:36:04.262940 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:04.444719 17225 executor.go:111] Tasks: 0 done / 116 total; 46 can run I1204 12:36:04.448367 17225 dnszone.go:241] Check for existing route53 zone to re-use with name "" I1204 12:36:04.448420 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:04.448564 17225 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I1204 12:36:04.451680 17225 executor.go:111] Tasks: 46 done / 116 total; 25 can run I1204 12:36:04.455764 17225 executor.go:111] Tasks: 71 done / 116 total; 29 can run I1204 12:36:04.456166 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:04.456405 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:04.456556 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:04.456785 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:04.456995 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:04.457076 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:04.457283 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:04.457437 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:04.457535 17225 executor.go:111] Tasks: 100 done / 116 total; 4 can run I1204 12:36:04.457865 17225 executor.go:111] Tasks: 104 done / 116 total; 12 can run I1204 12:36:04.458141 17225 executor.go:111] Tasks: 116 done / 116 total; 0 can run I1204 12:36:04.463332 17225 target.go:111] Terraform output is in /tmp/test1828007639/out --- PASS: TestCASPriorityExpanderCustom (0.81s) === RUN TestLifecycleMinimalAWS I1204 12:36:04.467712 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:04.467829 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:04.467868 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:04.467904 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:04.467932 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:04.467968 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:04.467999 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:04.468021 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:04.468047 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:04.468068 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1204 12:36:04.486847 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1204 12:36:04.489265 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:04.489328 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1204 12:36:05.196495 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:05.349342 17225 iamrole.go:89] ListRoles: { } I1204 12:36:05.350418 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:36:05.350747 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:05.351095 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:05.351514 17225 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.351520 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:05.351680 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:05.351730 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:05.351878 17225 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.351956 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:05.351993 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1204 12:36:05.352033 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1204 12:36:05.352052 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:05.352069 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:05.352099 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:05.352286 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:05.352418 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1204 12:36:05.352528 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1204 12:36:05.352512 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:05.352667 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:05.352739 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:05.352821 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1204 12:36:05.352883 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" }] } I1204 12:36:05.352929 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.356977 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:36:05.357776 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1204 12:36:05.357513 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:05.358328 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:05.358481 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1204 12:36:05.358503 17225 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1204 12:36:05.358543 17225 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I1204 12:36:05.358610 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:05.358620 17225 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1204 12:36:05.358665 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:05.358685 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1204 12:36:05.358822 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1204 12:36:05.358799 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1204 12:36:05.358799 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:05.358909 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1204 12:36:05.359021 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1204 12:36:05.359641 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1204 12:36:05.359767 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:05.359843 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:05.359919 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:05.359962 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:05.359994 17225 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1204 12:36:05.360044 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:05.360074 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:05.360101 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:05.360146 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1204 12:36:05.360328 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:05.360413 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:05.360449 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:05.360477 17225 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1204 12:36:05.361165 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1204 12:36:05.364331 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:36:05.364566 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.364734 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" }] }] } I1204 12:36:05.364860 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.364955 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:05.365078 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:05.365220 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:05.365307 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:05.365445 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.365656 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.365790 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:05.365848 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:05.365899 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.366052 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.366196 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.366305 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.366402 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.366499 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.366591 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:05.366670 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:05.366744 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:05.366809 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.366930 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.367033 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1204 12:36:05.367067 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1204 12:36:05.367110 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:05.367279 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:36:05.367529 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:36:05.367737 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:36:05.367773 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:05.367829 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:05.367893 17225 dns.go:235] Pre-creating DNS records I1204 12:36:05.367917 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:05.372852 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I1204 12:36:05.375414 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:05.375477 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I1204 12:36:05.988818 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:06.132101 17225 iamrole.go:89] ListRoles: { } I1204 12:36:06.133036 17225 executor.go:111] Tasks: 0 done / 101 total; 45 can run I1204 12:36:06.133811 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.134587 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:06.134811 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.135466 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.135538 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:06.135561 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:06.135589 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:06.135665 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:06.135999 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.137413 17225 executor.go:111] Tasks: 45 done / 101 total; 23 can run I1204 12:36:06.137516 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1204 12:36:06.137534 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1204 12:36:06.137691 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:06.138669 17225 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1204 12:36:06.137741 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I1204 12:36:06.138914 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1204 12:36:06.139103 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1204 12:36:06.139595 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:06.139758 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.139934 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:06.140034 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:06.140068 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:06.146380 17225 executor.go:111] Tasks: 68 done / 101 total; 25 can run I1204 12:36:06.146594 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:06.146710 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:06.146961 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:06.147081 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:06.147164 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:06.147333 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:06.147455 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:06.147885 17225 executor.go:111] Tasks: 93 done / 101 total; 2 can run I1204 12:36:06.148059 17225 executor.go:111] Tasks: 95 done / 101 total; 6 can run I1204 12:36:06.148242 17225 executor.go:111] Tasks: 101 done / 101 total; 0 can run I1204 12:36:06.150332 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:06.150388 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:06.150437 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:06.150476 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:06.150514 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:06.150551 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:06.150588 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:06.150631 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:06.150678 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:06.150731 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:06.150787 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:06.150828 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:06.150870 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:06.150920 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:06.150958 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:06.151000 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:06.151039 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:06.151083 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:06.151135 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:06.151177 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:06.151213 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:06.151264 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:06.151306 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:06.151349 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:06.152326 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:06.152434 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:06.152458 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:06.152507 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.152561 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1204 12:36:06.152634 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.152694 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.152751 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.152814 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.152861 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.152908 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1204 12:36:06.152968 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.153024 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:06.153068 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1204 12:36:06.153141 17225 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1204 12:36:06.153190 17225 api.go:53] PageSize not implemented I1204 12:36:06.153221 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:06.153255 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:06.153280 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:06.153319 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:06.153343 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1204 12:36:06.153404 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:06.153462 17225 iamrole.go:89] ListRoles: { } I1204 12:36:06.153514 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:06.153549 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:06.153605 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:06.153661 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:06.153702 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } autoscaling-config:lt-1 ok autoscaling-group:nodes.minimal.example.com ok I1204 12:36:06.154195 17225 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1204 12:36:06.154196 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I1204 12:36:06.154267 17225 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1204 12:36:06.154288 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I1204 12:36:06.154097 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.minimal.example.com. ok I1204 12:36:06.154324 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1204 12:36:06.154316 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:06.154362 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I1204 12:36:06.154387 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W1204 12:36:06.154589 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:06.154618 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:06.154651 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1204 12:36:06.154726 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1204 12:36:06.154777 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:06.154816 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1204 12:36:06.154913 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:06.154925 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1204 12:36:06.154948 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-2 ok I1204 12:36:06.155043 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1204 12:36:06.155071 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1204 12:36:06.155181 17225 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1204 12:36:06.155196 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1204 12:36:06.155234 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1204 12:36:06.155266 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1204 12:36:06.155301 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1204 12:36:06.155310 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1204 12:36:06.155331 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I1204 12:36:06.155388 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1204 12:36:06.155454 17225 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1204 12:36:06.155508 17225 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (1.69s) === RUN TestLifecycleMinimalOpenstack I1204 12:36:06.155952 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I1204 12:36:06.161759 17225 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:36:06.878049 17225 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1204 12:36:06.878094 17225 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1204 12:36:06.890807 17225 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/12/04 12:36:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1204 12:36:06.898015 17225 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1204 12:36:06.913914 17225 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1204 12:36:06.919542 17225 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/12/04 12:36:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:06 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1204 12:36:06.921812 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1204 12:36:06.921997 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1204 12:36:06.922086 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1204 12:36:07.926511 17225 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:36:08.612044 17225 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1204 12:36:08.612077 17225 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1204 12:36:08.619980 17225 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2025/12/04 12:36:08 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:08 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1204 12:36:08.624428 17225 executor.go:111] Tasks: 41 done / 92 total; 43 can run I1204 12:36:08.629890 17225 executor.go:111] Tasks: 84 done / 92 total; 5 can run I1204 12:36:08.630776 17225 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2025/12/04 12:36:08 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:08 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:08 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1204 12:36:08.632330 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1204 12:36:08.632764 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1204 12:36:08.632831 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1204 12:36:08.633040 17225 executor.go:111] Tasks: 92 done / 92 total; 0 can run I1204 12:36:08.634010 17225 delete_cluster.go:128] Looking for cloud resources to delete 2025/12/04 12:36:08 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) ServerGroup:fbd27ee4-3bf1-48f1-8390-095cad309c04 ok Subnet:0f318c6c-7bd5-4099-8f1f-6f8e10901eb5 ok SecurityGroup:6cfec37f-7284-4db6-883e-5512ccf26559 ok ServerGroup:ad769ddd-a4ec-4ccf-bd9b-45075370c8da ok Port:c8c6216c-5328-4391-8036-cd3a22d4fc8b ok Instance:ed993e94-be94-4e2f-a09f-84799aad07d1 ok Instance:24497f73-1261-49ef-b917-24a0c2df1e10 ok Port:20aff323-bf14-4b5f-b4df-c2322cf89992 ok Instance:25633bfe-8a3c-4bc3-b439-78ad113b2a98 ok Port:d6a50baa-b25f-43b1-9017-dc2221a3a6d1 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Network:4c43ef5c-3013-4ccb-a491-401f66df7ec0 ok SecurityGroup:5f8fa94b-d124-46c1-883c-c022fc7b1f87 ok SecurityGroup:2efdfc26-6802-477c-ba7f-295d6eee4d1e ok --- PASS: TestLifecycleMinimalOpenstack (3.57s) === RUN TestLifecycleMinimalGCE I1204 12:36:09.729345 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I1204 12:36:09.730599 17225 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:36:10.642942 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:36:10.643026 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:36:10.643141 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1204 12:36:10.643162 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1204 12:36:10.643180 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1204 12:36:10.643238 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1204 12:36:10.644358 17225 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1204 12:36:10.647015 17225 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1204 12:36:10.651320 17225 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1204 12:36:10.652138 17225 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1204 12:36:10.652305 17225 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1204 12:36:10.652383 17225 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:36:11.599243 17225 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W1204 12:36:11.599319 17225 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W1204 12:36:11.599404 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W1204 12:36:11.599425 17225 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W1204 12:36:11.599443 17225 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W1204 12:36:11.599495 17225 autoscalinggroup.go:151] enabling storage-rw for etcd backups I1204 12:36:11.600813 17225 executor.go:111] Tasks: 0 done / 64 total; 41 can run I1204 12:36:11.603787 17225 executor.go:111] Tasks: 41 done / 64 total; 17 can run I1204 12:36:11.607896 17225 executor.go:111] Tasks: 58 done / 64 total; 4 can run I1204 12:36:11.608637 17225 executor.go:111] Tasks: 62 done / 64 total; 2 can run I1204 12:36:11.608759 17225 executor.go:111] Tasks: 64 done / 64 total; 0 can run I1204 12:36:11.609955 17225 delete_cluster.go:128] Looking for cloud resources to delete I1204 12:36:11.610014 17225 gce.go:99] Scanning zones: [us-test1-a] I1204 12:36:11.610353 17225 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I1204 12:36:11.610376 17225 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:node-to-master-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1764851770 ok InstanceTemplate:nodes-minimal-gce-example-com-1764851770 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (1.88s) === RUN TestLifecycleFloatingIPOpenstack I1204 12:36:11.611601 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I1204 12:36:11.617525 17225 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:36:12.306576 17225 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1204 12:36:12.306613 17225 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1204 12:36:12.318334 17225 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/12/04 12:36:12 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:12 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1204 12:36:12.328531 17225 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1204 12:36:12.335486 17225 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1204 12:36:12.341395 17225 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/12/04 12:36:12 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:12 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:12 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1204 12:36:12.343529 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1204 12:36:12.343601 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1204 12:36:12.343814 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1204 12:36:13.347885 17225 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W1204 12:36:14.026700 17225 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W1204 12:36:14.026725 17225 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I1204 12:36:14.039690 17225 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2025/12/04 12:36:14 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:14 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I1204 12:36:14.046410 17225 executor.go:111] Tasks: 42 done / 94 total; 43 can run I1204 12:36:14.051910 17225 executor.go:111] Tasks: 85 done / 94 total; 6 can run I1204 12:36:14.053266 17225 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2025/12/04 12:36:14 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:14 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2025/12/04 12:36:14 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W1204 12:36:14.058722 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W1204 12:36:14.061102 17225 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I1204 12:36:14.061753 17225 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1204 12:36:14.063332 17225 delete_cluster.go:128] Looking for cloud resources to delete 2025/12/04 12:36:14 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) SecurityGroup:6be55162-322e-495c-ada0-4a6633d673c4 ok Port:df66f2b5-1ef5-44c0-8e0d-822e4c23bc5c ok Port:1a18d99e-40bb-47fb-aafd-cdce25c33896 ok Instance:04182f5f-4d6f-4a87-8c09-e28f7f56f475 ok Port:38dd0020-3003-4098-8e46-e3c0e3b6dfd3 ok Router-IF:5c3d1309-2a5a-4a46-a3e1-abbeceaef5b4 ok Port:c8ec1a7d-6f2c-472f-88cc-3609a779d578 ok Subnet:5c3d1309-2a5a-4a46-a3e1-abbeceaef5b4 ok SecurityGroup:fdfc6059-a460-44d4-b81f-bd50b000c425 ok ServerGroup:3a01e97f-2749-4a34-8a8c-5e9ad724f8ab ok Router:221a576c-6ec9-4775-b11d-cdacb5b7ef79 ok ServerGroup:860b7470-1d6d-4ef1-bf59-8573b3bdd6df ok Instance:6e7dd53f-92cc-465c-8743-9da807df39d1 ok Network:5e733835-4d1b-44ef-b333-e3c8c81cb672 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Instance:a57eb4d0-dd94-49ea-8bea-8fdc673bfaec ok SecurityGroup:d8547247-5b24-4368-a1c4-e58c5ce1f2cd ok --- PASS: TestLifecycleFloatingIPOpenstack (3.55s) === RUN TestLifecyclePrivateCalico I1204 12:36:15.165258 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:15.165376 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:15.165408 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:15.165443 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:15.165471 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:15.165504 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:15.165533 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:15.165551 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:15.165580 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:15.165600 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I1204 12:36:15.187586 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:36:15.190752 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:15.190811 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:15.190850 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:15.760222 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:16.121911 17225 iamrole.go:89] ListRoles: { } I1204 12:36:16.122991 17225 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1204 12:36:16.123431 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I1204 12:36:16.123540 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1204 12:36:16.123533 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:16.123782 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:16.124996 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:16.125161 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:16.125330 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I1204 12:36:16.125870 17225 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.125633 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:16.126048 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:16.126007 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I1204 12:36:16.126148 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:16.126347 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.128196 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] }] } I1204 12:36:16.128788 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:16.128989 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:16.129065 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I1204 12:36:16.129068 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:16.129172 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" }] } I1204 12:36:16.129238 17225 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.129932 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1204 12:36:16.129956 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1204 12:36:16.129975 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:16.130011 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:16.130570 17225 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1204 12:36:16.130708 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1204 12:36:16.130724 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1204 12:36:16.130826 17225 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1204 12:36:16.130862 17225 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1204 12:36:16.130975 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1204 12:36:16.130966 17225 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1204 12:36:16.130875 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:16.131030 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1204 12:36:16.131102 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:16.131153 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1204 12:36:16.131180 17225 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1204 12:36:16.131224 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:16.131248 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1204 12:36:16.131289 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1204 12:36:16.131258 17225 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1204 12:36:16.131262 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I1204 12:36:16.131315 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1204 12:36:16.131344 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1204 12:36:16.131330 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1204 12:36:16.131422 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1204 12:36:16.131496 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:16.131567 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:16.131613 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:16.131644 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:16.131756 17225 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1204 12:36:16.131790 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1204 12:36:16.131918 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:16.131978 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] }] } I1204 12:36:16.132041 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:16.132094 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:16.132112 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1204 12:36:16.132172 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:16.132234 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1204 12:36:16.132306 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:16.132366 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:16.132399 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:16.132501 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1204 12:36:16.132544 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:16.132574 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:16.132608 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:16.132640 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:16.132670 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:16.132700 17225 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.132758 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:16.132791 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1204 12:36:16.132885 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1204 12:36:16.132927 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:16.132991 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:16.133030 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:16.133093 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:16.133163 17225 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1204 12:36:16.133212 17225 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I1204 12:36:16.133209 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1204 12:36:16.133540 17225 executor.go:111] Tasks: 79 done / 142 total; 41 can run W1204 12:36:16.133736 17225 api.go:53] PageSize not implemented I1204 12:36:16.133674 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1204 12:36:16.133763 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:16.133866 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:16.133830 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1204 12:36:16.133845 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:16.133906 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" }] }] } I1204 12:36:16.133960 17225 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] } I1204 12:36:16.134005 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:16.133992 17225 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], Type: "network" } I1204 12:36:16.134044 17225 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I1204 12:36:16.134041 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.134090 17225 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I1204 12:36:16.134256 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1204 12:36:16.134373 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I1204 12:36:16.134489 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.134624 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.134717 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1204 12:36:16.134805 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:16.134913 17225 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.135014 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.135175 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1204 12:36:16.135261 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.135383 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1204 12:36:16.135498 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:16.135559 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:16.135643 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:16.135721 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:16.135776 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:16.135853 17225 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } W1204 12:36:16.135985 17225 api.go:53] PageSize not implemented I1204 12:36:16.136008 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:16.135832 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.136063 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.136214 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" }] }] } I1204 12:36:16.136337 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1204 12:36:16.136380 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1204 12:36:16.136420 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:16.136459 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1204 12:36:16.136585 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" }] }] } I1204 12:36:16.136695 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1204 12:36:16.136795 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1204 12:36:16.136873 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.136980 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:16.137030 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1204 12:36:16.137112 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.137251 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.137367 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.137475 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1204 12:36:16.137516 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I1204 12:36:16.137551 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:16.137647 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:16.137734 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I1204 12:36:16.137849 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1204 12:36:16.137938 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.138028 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I1204 12:36:16.138165 17225 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1204 12:36:16.138231 17225 api.go:53] PageSize not implemented I1204 12:36:16.138268 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:16.138274 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:16.138329 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:16.138400 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1204 12:36:16.138429 17225 api.go:53] PageSize not implemented I1204 12:36:16.138431 17225 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:16.138465 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:16.138502 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:16.138541 17225 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" }] }] } I1204 12:36:16.138651 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1204 12:36:16.138684 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:16.138712 17225 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1204 12:36:16.138608 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:16.142413 17225 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1204 12:36:16.142588 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:16.142700 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1204 12:36:16.142742 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:16.142850 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:16.142933 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:16.143013 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:16.143570 17225 executor.go:111] Tasks: 134 done / 142 total; 2 can run I1204 12:36:16.143783 17225 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1204 12:36:16.143960 17225 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1204 12:36:16.144002 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:16.144027 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:16.144076 17225 dns.go:235] Pre-creating DNS records I1204 12:36:16.144096 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:16.149580 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:36:16.152419 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:16.152480 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:16.152526 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:16.725181 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:17.079227 17225 iamrole.go:89] ListRoles: { } I1204 12:36:17.080208 17225 executor.go:111] Tasks: 0 done / 142 total; 49 can run I1204 12:36:17.080538 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:17.080541 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.080920 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.081022 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:17.081046 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:17.081083 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:17.081165 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.081445 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.081716 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:17.083240 17225 executor.go:111] Tasks: 49 done / 142 total; 30 can run I1204 12:36:17.083442 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I1204 12:36:17.083412 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.083514 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1204 12:36:17.083543 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I1204 12:36:17.083491 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I1204 12:36:17.083551 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I1204 12:36:17.083618 17225 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I1204 12:36:17.083686 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:17.083729 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.083820 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:17.083884 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.083977 17225 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I1204 12:36:17.083975 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:17.084083 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I1204 12:36:17.084248 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:17.084303 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.084410 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:17.084438 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I1204 12:36:17.084537 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:17.084578 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:17.084638 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.084719 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I1204 12:36:17.084824 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:17.085353 17225 executor.go:111] Tasks: 79 done / 142 total; 41 can run I1204 12:36:17.085463 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:17.085531 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:17.085547 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1204 12:36:17.085583 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1204 12:36:17.085608 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I1204 12:36:17.085639 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I1204 12:36:17.085603 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:17.085664 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } W1204 12:36:17.085697 17225 api.go:53] PageSize not implemented I1204 12:36:17.085692 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:17.085798 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1204 12:36:17.085834 17225 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1204 12:36:17.085722 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:17.085863 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1204 12:36:17.085879 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:17.085908 17225 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } W1204 12:36:17.085982 17225 api.go:53] PageSize not implemented I1204 12:36:17.085996 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:17.086041 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:17.086167 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:17.086372 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.086454 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.086588 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:17.086754 17225 executor.go:111] Tasks: 120 done / 142 total; 6 can run W1204 12:36:17.086807 17225 api.go:53] PageSize not implemented I1204 12:36:17.086830 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:17.086865 17225 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I1204 12:36:17.086843 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:17.086854 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:17.086922 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1204 12:36:17.086952 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1204 12:36:17.086974 17225 api.go:53] PageSize not implemented I1204 12:36:17.087001 17225 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I1204 12:36:17.087048 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:17.087242 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:17.087320 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:17.091259 17225 executor.go:111] Tasks: 126 done / 142 total; 8 can run I1204 12:36:17.091377 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.091540 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.091622 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.091748 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.091785 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:17.092273 17225 executor.go:111] Tasks: 134 done / 142 total; 2 can run W1204 12:36:17.092346 17225 api.go:53] PageSize not implemented I1204 12:36:17.092361 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:17.092514 17225 executor.go:111] Tasks: 136 done / 142 total; 6 can run I1204 12:36:17.092716 17225 executor.go:111] Tasks: 142 done / 142 total; 0 can run I1204 12:36:17.095483 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:17.095541 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:17.095573 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:17.095595 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1204 12:36:17.095616 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:17.095638 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:17.095660 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:17.095680 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:17.095700 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:17.095724 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:17.095748 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:17.095774 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1204 12:36:17.095797 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1204 12:36:17.095820 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:17.095839 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:17.095857 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:17.095880 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:17.095899 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:17.095920 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:17.095942 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:17.095962 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:17.095984 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1204 12:36:17.096006 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:17.096029 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:17.096049 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:17.096071 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:17.096091 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:17.096110 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:17.096151 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:17.096175 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:17.096197 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:17.097448 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:17.097499 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:17.097514 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:17.097544 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.097586 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1204 12:36:17.097634 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.097678 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.097708 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.097742 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.097771 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.097801 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I1204 12:36:17.097837 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.097873 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:17.097893 17225 natgateway.go:117] DescribeNatGateways: { } I1204 12:36:17.097925 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I1204 12:36:17.097951 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W1204 12:36:17.097988 17225 api.go:53] PageSize not implemented I1204 12:36:17.098000 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I1204 12:36:17.098030 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:17.098049 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:17.098061 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I1204 12:36:17.098088 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:17.098106 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:17.098136 17225 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" ] } I1204 12:36:17.098180 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:17.098211 17225 iamrole.go:89] ListRoles: { } I1204 12:36:17.098247 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:17.098268 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:17.098302 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:17.098336 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:17.098372 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I1204 12:36:17.098400 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1204 12:36:17.098424 17225 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } autoscaling-config:lt-3 ok I1204 12:36:17.098897 17225 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } load-balancer:api-privatecalico-example-0uch4k ok I1204 12:36:17.098972 17225 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I1204 12:36:17.098958 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } autoscaling-group:bastion.privatecalico.example.com ok keypair:key-1 ok I1204 12:36:17.099033 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1204 12:36:17.099053 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:17.099094 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I1204 12:36:17.099150 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1204 12:36:17.099188 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } iam-instance-profile:nodes.privatecalico.example.com ok autoscaling-group:nodes.privatecalico.example.com ok I1204 12:36:17.099128 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } I1204 12:36:17.099241 17225 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I1204 12:36:17.099125 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok W1204 12:36:17.099277 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:17.099304 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:17.099340 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1204 12:36:17.099329 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1204 12:36:17.099389 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok route53-record:Z1AFAKE1ZON3YO/AAAA/api.privatecalico.example.com ok I1204 12:36:17.099388 17225 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1204 12:36:17.099440 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1204 12:36:17.099487 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:17.099526 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W1204 12:36:17.099678 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:17.099695 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok I1204 12:36:17.099726 17225 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1204 12:36:17.099765 17225 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1204 12:36:17.099788 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:17.099821 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W1204 12:36:17.099898 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:17.099908 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-2 ok I1204 12:36:17.099986 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1204 12:36:17.100013 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I1204 12:36:17.100032 17225 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I1204 12:36:17.100074 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I1204 12:36:17.100087 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I1204 12:36:17.100084 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1204 12:36:17.100128 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I1204 12:36:17.100129 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:17.100157 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I1204 12:36:17.100190 17225 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I1204 12:36:17.100200 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I1204 12:36:17.100219 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I1204 12:36:17.100168 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } I1204 12:36:17.100247 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I1204 12:36:17.100275 17225 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com W1204 12:36:17.100275 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:17.100285 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I1204 12:36:17.100289 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1204 12:36:17.100302 17225 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I1204 12:36:17.100360 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1204 12:36:17.100408 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1204 12:36:17.100467 17225 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1204 12:36:17.100521 17225 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (1.94s) === RUN TestLifecyclePrivateKopeio I1204 12:36:17.100895 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:17.100998 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:17.101025 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:17.101054 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:17.101081 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:17.101129 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:17.101161 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:17.101182 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:17.101209 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:17.101228 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I1204 12:36:17.123448 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:17.126392 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.126453 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.126491 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.703077 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:17.855943 17225 iamrole.go:89] ListRoles: { } I1204 12:36:17.857532 17225 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1204 12:36:17.857890 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I1204 12:36:17.857977 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1204 12:36:17.857964 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.858070 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I1204 12:36:17.858138 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1204 12:36:17.858144 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.858290 17225 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.858362 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:17.858402 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:17.858467 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:17.858487 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.858501 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:17.858556 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:17.858607 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:17.858733 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I1204 12:36:17.858797 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1204 12:36:17.859026 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.859151 17225 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.859218 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1204 12:36:17.859244 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1204 12:36:17.859265 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:17.859295 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:17.860997 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:17.861147 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.861303 17225 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1204 12:36:17.861386 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:17.861401 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1204 12:36:17.861493 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1204 12:36:17.861485 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1204 12:36:17.861552 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1204 12:36:17.861592 17225 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1204 12:36:17.861687 17225 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1204 12:36:17.861637 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] }] } I1204 12:36:17.861717 17225 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1204 12:36:17.861787 17225 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1204 12:36:17.861748 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.861823 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1204 12:36:17.861842 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1204 12:36:17.861814 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1204 12:36:17.861896 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.861929 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I1204 12:36:17.861991 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:17.862025 17225 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I1204 12:36:17.861946 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1204 12:36:17.862078 17225 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1204 12:36:17.862111 17225 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.862181 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:17.862154 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1204 12:36:17.862224 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:17.862254 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:17.862281 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:17.862343 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:17.862383 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:17.862420 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1204 12:36:17.862411 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.862499 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1204 12:36:17.862577 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I1204 12:36:17.862621 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1204 12:36:17.862767 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:17.862830 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1204 12:36:17.862906 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.862966 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:17.863016 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.863032 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1204 12:36:17.863076 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.863133 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I1204 12:36:17.863152 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1204 12:36:17.863228 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:17.863293 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:17.863322 17225 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] } I1204 12:36:17.863337 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1204 12:36:17.863376 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:17.863410 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:17.863435 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:17.863489 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:17.863516 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:17.863541 17225 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1204 12:36:17.863575 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:17.863605 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:17.863629 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1204 12:36:17.863711 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1204 12:36:17.863747 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1204 12:36:17.863778 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:17.863828 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1204 12:36:17.863857 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:17.863883 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1204 12:36:17.863909 17225 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] } I1204 12:36:17.863972 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1204 12:36:17.863717 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1204 12:36:17.864001 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1204 12:36:17.864096 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:17.864215 17225 executor.go:111] Tasks: 81 done / 144 total; 41 can run I1204 12:36:17.864322 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:17.864423 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } W1204 12:36:17.864573 17225 api.go:53] PageSize not implemented I1204 12:36:17.864523 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:17.864600 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:17.864596 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1204 12:36:17.864674 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:17.864759 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:17.864750 17225 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I1204 12:36:17.864804 17225 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1204 12:36:17.864832 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:17.864676 17225 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-1" },{ SubnetId: "subnet-2" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I1204 12:36:17.864868 17225 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1204 12:36:17.864907 17225 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1204 12:36:17.864834 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:17.864983 17225 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1204 12:36:17.865015 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1204 12:36:17.865043 17225 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I1204 12:36:17.865148 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1204 12:36:17.865270 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.865381 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:17.865489 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:17.865537 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:17.865622 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1204 12:36:17.865680 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1204 12:36:17.865710 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.865841 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:17.865891 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }] } I1204 12:36:17.865959 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.866065 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.866188 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:17.866256 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:17.866300 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:17.866339 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1204 12:36:17.866489 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1204 12:36:17.866602 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1204 12:36:17.866640 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I1204 12:36:17.866671 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.866770 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I1204 12:36:17.866802 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:17.866841 17225 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I1204 12:36:17.866870 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:17.866897 17225 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1204 12:36:17.866923 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I1204 12:36:17.867020 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I1204 12:36:17.867095 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.867217 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:17.867257 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.867337 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.867430 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.867523 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.867612 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.867700 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I1204 12:36:17.867790 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1204 12:36:17.867874 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1204 12:36:17.867907 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.867994 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1204 12:36:17.868059 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" }] }] } I1204 12:36:17.868170 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:17.868214 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1204 12:36:17.868242 17225 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W1204 12:36:17.868345 17225 api.go:53] PageSize not implemented I1204 12:36:17.868289 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.868366 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:17.868385 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.868478 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1204 12:36:17.868512 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:17.868547 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.868585 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1204 12:36:17.868617 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I1204 12:36:17.868721 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-4" } I1204 12:36:17.868753 17225 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I1204 12:36:17.868850 17225 executor.go:111] Tasks: 122 done / 144 total; 7 can run I1204 12:36:17.868921 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1204 12:36:17.868950 17225 api.go:53] PageSize not implemented I1204 12:36:17.868941 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:17.868997 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:17.869005 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:17.869106 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:17.869105 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-2" } W1204 12:36:17.869217 17225 api.go:53] PageSize not implemented I1204 12:36:17.869185 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:17.869189 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:17.869289 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-3" } I1204 12:36:17.869265 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:17.873527 17225 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1204 12:36:17.873708 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.873841 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.874000 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.874097 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.874677 17225 executor.go:111] Tasks: 136 done / 144 total; 2 can run I1204 12:36:17.874904 17225 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1204 12:36:17.875185 17225 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1204 12:36:17.875228 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:17.875255 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:17.875305 17225 dns.go:235] Pre-creating DNS records I1204 12:36:17.875325 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:17.880366 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:17.883063 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.883150 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:17.883194 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:18.458869 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:18.612835 17225 iamrole.go:89] ListRoles: { } I1204 12:36:18.614449 17225 executor.go:111] Tasks: 0 done / 144 total; 48 can run I1204 12:36:18.614685 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.614892 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:18.614874 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] }] } I1204 12:36:18.615323 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.615870 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.615961 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:18.615983 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:18.616022 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:18.616289 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:18.617870 17225 executor.go:111] Tasks: 48 done / 144 total; 33 can run I1204 12:36:18.618003 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.618145 17225 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1204 12:36:18.618136 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.618271 17225 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I1204 12:36:18.618268 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1204 12:36:18.618306 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1204 12:36:18.618317 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:18.618317 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I1204 12:36:18.618349 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.618389 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1204 12:36:18.618455 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.618485 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I1204 12:36:18.618549 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I1204 12:36:18.618668 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:18.618713 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.618810 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:18.618881 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.618981 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:18.619009 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I1204 12:36:18.619136 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:18.619188 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I1204 12:36:18.619324 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:18.619359 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.619430 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I1204 12:36:18.619511 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:18.619580 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.619705 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:18.619771 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:18.619875 17225 executor.go:111] Tasks: 81 done / 144 total; 41 can run W1204 12:36:18.620051 17225 api.go:53] PageSize not implemented I1204 12:36:18.620046 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:18.620074 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:18.620166 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:18.620195 17225 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I1204 12:36:18.620179 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:18.620250 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:18.620307 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:18.620277 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I1204 12:36:18.620327 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1204 12:36:18.620396 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1204 12:36:18.620425 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I1204 12:36:18.620427 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:18.620455 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I1204 12:36:18.620480 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W1204 12:36:18.620541 17225 api.go:53] PageSize not implemented I1204 12:36:18.620520 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:18.620557 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:18.620612 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1204 12:36:18.620688 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:18.620770 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:18.620939 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:18.621096 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:18.621235 17225 executor.go:111] Tasks: 122 done / 144 total; 7 can run W1204 12:36:18.621286 17225 api.go:53] PageSize not implemented I1204 12:36:18.621330 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:18.621321 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:18.621323 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:18.621386 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:18.621409 17225 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I1204 12:36:18.621371 17225 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" W1204 12:36:18.621422 17225 api.go:53] PageSize not implemented I1204 12:36:18.621420 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:18.621460 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:18.621573 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:18.621652 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:18.625448 17225 executor.go:111] Tasks: 129 done / 144 total; 7 can run I1204 12:36:18.625555 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:18.625677 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:18.625734 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:18.625861 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:18.626400 17225 executor.go:111] Tasks: 136 done / 144 total; 2 can run W1204 12:36:18.626499 17225 api.go:53] PageSize not implemented I1204 12:36:18.626522 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:18.626685 17225 executor.go:111] Tasks: 138 done / 144 total; 6 can run I1204 12:36:18.626832 17225 executor.go:111] Tasks: 144 done / 144 total; 0 can run I1204 12:36:18.629372 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:18.629422 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:18.629447 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:18.629467 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:18.629487 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:18.629509 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:18.629528 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:18.629549 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:18.629572 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:18.629596 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:18.629622 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1204 12:36:18.629644 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:18.629666 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:18.629685 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:18.629707 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:18.629725 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:18.629748 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1204 12:36:18.629772 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:18.629793 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:18.629815 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:18.629838 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1204 12:36:18.629861 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:18.629886 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:18.629904 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:18.629927 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1204 12:36:18.629950 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1204 12:36:18.629971 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:18.629994 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:18.630014 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:18.630035 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:18.630057 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:18.630081 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:18.631316 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:18.631368 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:18.631382 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:18.631415 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.631458 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1204 12:36:18.631503 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.631547 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.631579 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.631613 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.631644 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.631678 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I1204 12:36:18.631723 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.631770 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:18.631792 17225 natgateway.go:117] DescribeNatGateways: { } I1204 12:36:18.631818 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I1204 12:36:18.631849 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W1204 12:36:18.631885 17225 api.go:53] PageSize not implemented I1204 12:36:18.631897 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I1204 12:36:18.631926 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:18.631943 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:18.631954 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I1204 12:36:18.631980 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:18.631996 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:18.632009 17225 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" ] } I1204 12:36:18.632051 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:18.632079 17225 iamrole.go:89] ListRoles: { } I1204 12:36:18.632133 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:18.632154 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:18.632187 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:18.632223 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:18.632260 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-3","rtb-2"] } I1204 12:36:18.632290 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I1204 12:36:18.632314 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } autoscaling-config:lt-1 ok autoscaling-group:nodes.privatekopeio.example.com ok I1204 12:36:18.632822 17225 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok I1204 12:36:18.632905 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } autoscaling-group:bastion.privatekopeio.example.com ok I1204 12:36:18.632932 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } volume:vol-2 ok I1204 12:36:18.632975 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok I1204 12:36:18.632968 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1204 12:36:18.632975 17225 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I1204 12:36:18.633014 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:18.632993 17225 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } load-balancer:api-privatekopeio-example-tl2bv8 ok I1204 12:36:18.633026 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1204 12:36:18.633082 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I1204 12:36:18.633102 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1204 12:36:18.633159 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok I1204 12:36:18.633069 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1204 12:36:18.633243 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:18.633053 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.privatekopeio.example.com ok I1204 12:36:18.633264 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:18.633295 17225 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1204 12:36:18.633372 17225 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-3 ok I1204 12:36:18.633413 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1204 12:36:18.633456 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:18.633499 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } W1204 12:36:18.633602 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:18.633615 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1204 12:36:18.633638 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:18.633676 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 } ] } W1204 12:36:18.633796 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:18.633812 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-config:lt-2 ok I1204 12:36:18.633914 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I1204 12:36:18.633927 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I1204 12:36:18.633989 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com I1204 12:36:18.633975 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1204 12:36:18.634007 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I1204 12:36:18.634028 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1204 12:36:18.634044 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I1204 12:36:18.634061 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:18.634068 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I1204 12:36:18.634110 17225 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I1204 12:36:18.634138 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I1204 12:36:18.634166 17225 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I1204 12:36:18.634111 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W1204 12:36:18.634202 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:18.634190 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I1204 12:36:18.634213 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1204 12:36:18.634220 17225 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I1204 12:36:18.634262 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I1204 12:36:18.634286 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } iam-role:masters.privatekopeio.example.com ok I1204 12:36:18.634305 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1204 12:36:18.634431 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1204 12:36:18.634488 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1204 12:36:18.634530 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1204 12:36:18.634597 17225 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1204 12:36:18.634658 17225 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (1.53s) === RUN TestLifecycleIPv6 I1204 12:36:18.635101 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:18.635304 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:18.635337 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:18.635369 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:18.635400 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:18.635434 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:18.635465 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:18.635483 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:18.635510 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:18.635531 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I1204 12:36:18.658749 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:36:18.661887 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:18.661951 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:19.231609 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:19.378087 17225 iamrole.go:89] ListRoles: { } I1204 12:36:19.379602 17225 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1204 12:36:19.380025 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:19.380028 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.380133 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I1204 12:36:19.380221 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1204 12:36:19.380282 17225 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" }] }] } I1204 12:36:19.380325 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] }] } I1204 12:36:19.380456 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:19.380564 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:19.380551 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I1204 12:36:19.380605 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.380649 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I1204 12:36:19.380708 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:19.380794 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:19.380832 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1204 12:36:19.380858 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1204 12:36:19.380876 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:19.380903 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:19.380931 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.381046 17225 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1204 12:36:19.381156 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:19.381618 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:19.381755 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.382803 17225 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1204 12:36:19.382895 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1204 12:36:19.383029 17225 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1204 12:36:19.382994 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.383022 17225 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1204 12:36:19.383102 17225 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1204 12:36:19.383093 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1204 12:36:19.383219 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1204 12:36:19.383217 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1204 12:36:19.383262 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1204 12:36:19.383320 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1204 12:36:19.383362 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }], VpcId: "vpc-1" } I1204 12:36:19.383429 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:19.383471 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:19.383503 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.383516 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1204 12:36:19.383573 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1204 12:36:19.383653 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1204 12:36:19.383653 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:19.383813 17225 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1204 12:36:19.383853 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1204 12:36:19.383985 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:19.384050 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:19.384091 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:19.384140 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:19.384265 17225 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1204 12:36:19.384308 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.384441 17225 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.384500 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:19.384555 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.384621 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:19.384674 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.384751 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:19.384784 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I1204 12:36:19.384860 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1204 12:36:19.384896 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:19.384719 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1204 12:36:19.384952 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:19.385031 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:19.385083 17225 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" } ] } I1204 12:36:19.385166 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1204 12:36:19.385260 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1204 12:36:19.385303 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:19.385354 17225 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" } ] } I1204 12:36:19.385412 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1204 12:36:19.385440 17225 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I1204 12:36:19.385526 17225 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1204 12:36:19.385650 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.385802 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.385855 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1204 12:36:19.385933 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.386041 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.386147 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:19.386250 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:19.386377 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1204 12:36:19.386547 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1204 12:36:19.386634 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:19.386751 17225 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.386781 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:19.386899 17225 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }] }] } I1204 12:36:19.386999 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" }] }] } I1204 12:36:19.387134 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.387209 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" }] }] } I1204 12:36:19.387282 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1204 12:36:19.387314 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:19.387378 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.387481 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" }] }] } I1204 12:36:19.387586 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.387662 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.387719 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:19.387717 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1204 12:36:19.387785 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:19.387775 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1204 12:36:19.387850 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] }] } I1204 12:36:19.387877 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1204 12:36:19.387911 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" }] }] } I1204 12:36:19.387970 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I1204 12:36:19.388028 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:19.388064 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:19.388101 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1204 12:36:19.388146 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1204 12:36:19.388171 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1204 12:36:19.388294 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:19.388327 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:19.388351 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1204 12:36:19.388447 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:19.388484 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I1204 12:36:19.388571 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" }] }] } I1204 12:36:19.388659 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I1204 12:36:19.388730 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.388816 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.388902 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.389002 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1204 12:36:19.389037 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:19.389069 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.389217 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1204 12:36:19.389257 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1204 12:36:19.389290 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I1204 12:36:19.389352 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:19.389465 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-3" } I1204 12:36:19.389519 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1204 12:36:19.389558 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1204 12:36:19.389587 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.389715 17225 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1204 12:36:19.389781 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:19.389849 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:19.389910 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:19.389844 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:19.390014 17225 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-3" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I1204 12:36:19.390085 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1204 12:36:19.390146 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I1204 12:36:19.390192 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:19.390264 17225 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } I1204 12:36:19.390348 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:19.390347 17225 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.390411 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1204 12:36:19.390450 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1204 12:36:19.390479 17225 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1204 12:36:19.390523 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1204 12:36:19.390574 17225 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I1204 12:36:19.390640 17225 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1204 12:36:19.390639 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1204 12:36:19.390692 17225 api.go:53] PageSize not implemented I1204 12:36:19.390756 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I1204 12:36:19.390796 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I1204 12:36:19.390824 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:19.390913 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I1204 12:36:19.390940 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-6" } I1204 12:36:19.390961 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1204 12:36:19.390992 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:19.391043 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:19.391093 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:19.391188 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1204 12:36:19.391237 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I1204 12:36:19.391271 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-5" } I1204 12:36:19.391292 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1204 12:36:19.391314 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-1" } I1204 12:36:19.391335 17225 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-3"] }] } I1204 12:36:19.391424 17225 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-3", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I1204 12:36:19.391490 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1204 12:36:19.391521 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1204 12:36:19.391548 17225 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I1204 12:36:19.391607 17225 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1204 12:36:19.391654 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:19.391691 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:19.391677 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:19.391706 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1204 12:36:19.391766 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:19.391780 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:19.391822 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:19.391860 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:19.391907 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:19.391905 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I1204 12:36:19.391922 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1204 12:36:19.391949 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1204 12:36:19.391948 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:19.392088 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:19.392210 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1204 12:36:19.392145 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:19.392254 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:19.392355 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-3" } I1204 12:36:19.396258 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:36:19.396454 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:19.396557 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:19.396643 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:19.396743 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:19.397137 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:36:19.397362 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:36:19.397566 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:36:19.397609 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:19.397637 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:19.397692 17225 dns.go:235] Pre-creating DNS records I1204 12:36:19.397712 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:19.402912 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I1204 12:36:19.406063 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:19.406146 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:19.977077 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:20.126545 17225 iamrole.go:89] ListRoles: { } I1204 12:36:20.128040 17225 executor.go:111] Tasks: 0 done / 136 total; 46 can run I1204 12:36:20.128821 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:20.128987 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.129462 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:20.129538 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.129613 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:20.129636 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:20.129672 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:20.129851 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.130176 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.131632 17225 executor.go:111] Tasks: 46 done / 136 total; 25 can run I1204 12:36:20.131737 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] }] } I1204 12:36:20.131834 17225 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1204 12:36:20.131848 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:20.131862 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I1204 12:36:20.131916 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.131949 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1204 12:36:20.131986 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1204 12:36:20.131985 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I1204 12:36:20.131998 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I1204 12:36:20.132133 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:20.132192 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.132280 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.132335 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I1204 12:36:20.132395 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:20.132416 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:20.132451 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.132501 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I1204 12:36:20.132547 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:20.133148 17225 executor.go:111] Tasks: 71 done / 136 total; 36 can run I1204 12:36:20.133278 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:20.133351 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] }] } I1204 12:36:20.133434 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.133604 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:20.133674 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.133784 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I1204 12:36:20.133862 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:20.134003 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.134136 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I1204 12:36:20.134176 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.134281 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:20.134356 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:20.134429 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1204 12:36:20.134460 17225 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I1204 12:36:20.134489 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1204 12:36:20.134533 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:20.134608 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:20.134678 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:20.134709 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.134798 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:20.134856 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1204 12:36:20.134883 17225 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1204 12:36:20.134905 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1204 12:36:20.134968 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I1204 12:36:20.135060 17225 executor.go:111] Tasks: 107 done / 136 total; 9 can run I1204 12:36:20.135149 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:20.135229 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:20.135289 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:20.135295 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:20.135355 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:20.135348 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:20.135370 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1204 12:36:20.135404 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1204 12:36:20.135409 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:20.135465 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:20.135429 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1204 12:36:20.135518 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1204 12:36:20.135545 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I1204 12:36:20.135574 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I1204 12:36:20.135565 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:20.135621 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } W1204 12:36:20.135644 17225 api.go:53] PageSize not implemented I1204 12:36:20.135662 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:20.135739 17225 executor.go:111] Tasks: 116 done / 136 total; 8 can run I1204 12:36:20.135797 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:20.135840 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1204 12:36:20.135856 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W1204 12:36:20.135888 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:20.135910 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I1204 12:36:20.135902 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1204 12:36:20.135843 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:20.135960 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:20.135987 17225 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1204 12:36:20.136014 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:20.136087 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:20.136137 17225 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I1204 12:36:20.136049 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1204 12:36:20.136204 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:20.136255 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:20.136277 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1204 12:36:20.136360 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:20.136391 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1204 12:36:20.140024 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:36:20.140152 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.140287 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.140350 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.140484 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.141034 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:36:20.141224 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:36:20.141419 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:36:20.144045 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:20.144096 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:20.144140 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:20.144164 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I1204 12:36:20.144185 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1204 12:36:20.144215 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:20.144237 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I1204 12:36:20.144262 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:20.144281 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:20.144304 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:20.144325 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:20.144348 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:20.144375 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:20.144400 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1204 12:36:20.144424 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I1204 12:36:20.144446 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:20.144467 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:20.144486 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:20.144508 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:20.144528 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:20.144552 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I1204 12:36:20.144574 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:20.144597 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:20.144618 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:20.144639 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:20.144662 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:20.144683 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:20.144705 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1204 12:36:20.144733 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I1204 12:36:20.144758 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I1204 12:36:20.144790 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I1204 12:36:20.144812 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:20.144831 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:20.144851 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:20.144876 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:20.144899 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:20.144922 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:20.146488 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:20.146545 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:20.146562 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:20.146598 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.146682 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1204 12:36:20.146730 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.146778 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.146817 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.146857 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.146894 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.146933 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I1204 12:36:20.146982 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.147042 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:20.147067 17225 natgateway.go:117] DescribeNatGateways: { } I1204 12:36:20.147106 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I1204 12:36:20.147158 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W1204 12:36:20.147200 17225 api.go:53] PageSize not implemented I1204 12:36:20.147216 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:20.147236 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:20.147249 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I1204 12:36:20.147278 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:20.147295 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:20.147309 17225 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" ] } I1204 12:36:20.147353 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:20.147385 17225 iamrole.go:89] ListRoles: { } I1204 12:36:20.147426 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:20.147449 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:20.147482 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:20.147519 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:20.147561 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3","rtb-1","rtb-2"] } I1204 12:36:20.147596 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1204 12:36:20.147622 17225 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I1204 12:36:20.147646 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I1204 12:36:20.147669 17225 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I1204 12:36:20.148199 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I1204 12:36:20.148270 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1204 12:36:20.148260 17225 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I1204 12:36:20.148326 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } I1204 12:36:20.148308 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1204 12:36:20.148375 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I1204 12:36:20.148371 17225 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } iam-instance-profile:nodes.minimal-ipv6.example.com ok nat-gateway:nat-2 ok autoscaling-group:nodes.minimal-ipv6.example.com ok autoscaling-config:lt-1 ok I1204 12:36:20.148425 17225 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } I1204 12:36:20.148408 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1204 12:36:20.148485 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I1204 12:36:20.148470 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } iam-instance-profile:masters.minimal-ipv6.example.com ok I1204 12:36:20.148440 17225 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I1204 12:36:20.148521 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I1204 12:36:20.148382 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } subnet:subnet-6 ok egress-only-internet-gateway:eigw-2 ok route53-record:Z1AFAKE1ZON3YO/AAAA/api.internal.minimal-ipv6.example.com. ok I1204 12:36:20.148570 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I1204 12:36:20.148655 17225 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1204 12:36:20.148719 17225 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1204 12:36:20.148748 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:20.148799 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W1204 12:36:20.149034 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:20.149054 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1204 12:36:20.149085 17225 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I1204 12:36:20.149155 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I1204 12:36:20.149206 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1204 12:36:20.149246 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:20.149280 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 } ] } W1204 12:36:20.149376 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:20.149387 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:20.149471 17225 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I1204 12:36:20.149490 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I1204 12:36:20.149516 17225 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I1204 12:36:20.149541 17225 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I1204 12:36:20.149554 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1204 12:36:20.149565 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I1204 12:36:20.149599 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1204 12:36:20.149626 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I1204 12:36:20.149639 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I1204 12:36:20.149645 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I1204 12:36:20.149668 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I1204 12:36:20.149692 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I1204 12:36:20.149714 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I1204 12:36:20.149686 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1204 12:36:20.149777 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1204 12:36:20.149823 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I1204 12:36:20.149880 17225 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1204 12:36:20.149934 17225 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (1.52s) === RUN TestLifecycleSharedVPC I1204 12:36:20.150344 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:20.150461 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:20.150492 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:20.150522 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:20.150552 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:20.150588 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:20.150619 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:20.150640 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:20.150667 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:20.150689 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I1204 12:36:20.169203 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:20.171701 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.171764 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.739612 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:20.881552 17225 iamrole.go:89] ListRoles: { } I1204 12:36:20.882538 17225 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1204 12:36:20.882792 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:20.882900 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I1204 12:36:20.882946 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1204 12:36:20.883010 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I1204 12:36:20.883069 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:20.883146 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I1204 12:36:20.883213 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I1204 12:36:20.883263 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:20.883376 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:20.883416 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:20.883494 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:20.883526 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:20.883610 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:20.883646 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:36:20.883699 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1204 12:36:20.883720 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1204 12:36:20.885516 17225 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1204 12:36:20.885641 17225 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1204 12:36:20.885740 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1204 12:36:20.885871 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1204 12:36:20.885920 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1204 12:36:20.885873 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1204 12:36:20.886016 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1204 12:36:20.886055 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I1204 12:36:20.886153 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:20.886147 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1204 12:36:20.886202 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:20.886230 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1204 12:36:20.886305 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:20.886340 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:20.886367 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:20.886440 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1204 12:36:20.886518 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I1204 12:36:20.886521 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:36:20.886617 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] }] } I1204 12:36:20.886773 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:20.886756 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" } ] }], VpcId: "vpc-12345678" } I1204 12:36:20.886838 17225 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" } ] } I1204 12:36:20.886912 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:20.886943 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:20.887760 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1204 12:36:20.889856 17225 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1204 12:36:20.890033 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1204 12:36:20.890243 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:20.890369 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1204 12:36:20.890410 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1204 12:36:20.890480 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:20.890644 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1204 12:36:20.890730 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.890866 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.890974 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1204 12:36:20.891096 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1204 12:36:20.891272 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1204 12:36:20.891385 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:20.891466 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1204 12:36:20.891593 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1204 12:36:20.891694 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1204 12:36:20.891795 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1204 12:36:20.891891 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1204 12:36:20.891988 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I1204 12:36:20.892075 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1204 12:36:20.892265 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1204 12:36:20.892309 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.892409 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.892483 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1204 12:36:20.892676 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" }] }] } I1204 12:36:20.892820 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I1204 12:36:20.893033 17225 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1204 12:36:20.893303 17225 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1204 12:36:20.893549 17225 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1204 12:36:20.893597 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:20.893625 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:20.893677 17225 dns.go:235] Pre-creating DNS records I1204 12:36:20.893703 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:20.898234 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:20.900671 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:20.900734 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:21.471592 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:21.611692 17225 iamrole.go:89] ListRoles: { } I1204 12:36:21.612669 17225 executor.go:111] Tasks: 0 done / 98 total; 44 can run I1204 12:36:21.613215 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:21.613742 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.614277 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:36:21.614357 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1204 12:36:21.614380 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1204 12:36:21.615227 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] }] } I1204 12:36:21.615485 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:21.616912 17225 executor.go:111] Tasks: 44 done / 98 total; 21 can run I1204 12:36:21.617094 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.617271 17225 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I1204 12:36:21.617299 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1204 12:36:21.617226 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I1204 12:36:21.617353 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:21.617413 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:21.617498 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:36:21.617622 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I1204 12:36:21.617780 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:21.617843 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.621244 17225 executor.go:111] Tasks: 65 done / 98 total; 25 can run I1204 12:36:21.621349 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:21.621454 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:21.621587 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:21.621785 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:21.622181 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:21.622377 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:21.622523 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:21.622862 17225 executor.go:111] Tasks: 90 done / 98 total; 2 can run I1204 12:36:21.623088 17225 executor.go:111] Tasks: 92 done / 98 total; 6 can run I1204 12:36:21.623309 17225 executor.go:111] Tasks: 98 done / 98 total; 0 can run I1204 12:36:21.625372 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:21.625422 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:21.625445 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:21.625469 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:21.625488 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:21.625508 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:21.625529 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:21.625554 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:21.625582 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:21.625603 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:21.625624 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:21.625645 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:21.625666 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:21.625687 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:21.625709 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:21.625732 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:21.625752 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:21.625771 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:21.625790 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:21.625812 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:21.625836 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:21.626862 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:21.626913 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:21.626929 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:21.626958 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.626996 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1204 12:36:21.627035 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.627079 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.627108 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.627154 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.627183 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.627209 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I1204 12:36:21.627240 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.627303 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I1204 12:36:21.627327 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W1204 12:36:21.627360 17225 api.go:53] PageSize not implemented I1204 12:36:21.627378 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:21.627400 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:21.627415 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:21.627432 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:21.627448 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1204 12:36:21.627488 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:21.627518 17225 iamrole.go:89] ListRoles: { } I1204 12:36:21.627553 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:21.627574 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:21.627610 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:21.627641 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:21.627665 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:21.627967 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:21.628002 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1204 12:36:21.628081 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok I1204 12:36:21.628053 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok W1204 12:36:21.628223 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-group:nodes.sharedvpc.example.com ok I1204 12:36:21.628247 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1204 12:36:21.628084 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedvpc.example.com. ok I1204 12:36:21.628277 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1204 12:36:21.628289 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1204 12:36:21.628345 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok I1204 12:36:21.628371 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:21.628421 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1204 12:36:21.628587 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:21.628614 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-1 ok I1204 12:36:21.628666 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1204 12:36:21.628732 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok I1204 12:36:21.628843 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1204 12:36:21.628864 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I1204 12:36:21.628930 17225 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I1204 12:36:21.628953 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I1204 12:36:21.628982 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I1204 12:36:21.629022 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I1204 12:36:21.629076 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I1204 12:36:21.629087 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I1204 12:36:21.629108 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I1204 12:36:21.629195 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (1.48s) === RUN TestLifecycleComplex I1204 12:36:21.629612 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:21.629731 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:21.629759 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:21.629788 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:21.629818 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:21.629854 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:21.629884 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:21.629907 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:21.629936 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:21.629958 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I1204 12:36:21.657332 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:21.660878 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:21.660947 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:22.236575 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:22.391163 17225 iamrole.go:89] ListRoles: { } I1204 12:36:22.392627 17225 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1204 12:36:22.392828 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:22.393020 17225 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.392985 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:22.393197 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:22.393321 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:22.393366 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W1204 12:36:22.393489 17225 api.go:53] PageSize not implemented I1204 12:36:22.393456 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:22.393614 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:22.393652 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:22.393801 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:22.393871 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1204 12:36:22.393974 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:22.394067 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1204 12:36:22.394098 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1204 12:36:22.394141 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:22.394182 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:22.394185 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I1204 12:36:22.394266 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] } I1204 12:36:22.394325 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1204 12:36:22.394708 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:22.394842 17225 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.394865 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I1204 12:36:22.394953 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:22.394946 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } I1204 12:36:22.396016 17225 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1204 12:36:22.396178 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:22.396211 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1204 12:36:22.396220 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:22.396215 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:22.396313 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:22.396378 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:22.396353 17225 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "Name", Value: "tcp-complex-example-com-vpjolq" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1204 12:36:22.396421 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1204 12:36:22.396395 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:22.396453 17225 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:22.396513 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:22.396564 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I1204 12:36:22.396589 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1204 12:36:22.396610 17225 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I1204 12:36:22.396690 17225 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:22.396656 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:22.396757 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:22.396792 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1204 12:36:22.396888 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I1204 12:36:22.396921 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:22.397080 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "nodes.complex.example.com" } ] }], VpcId: "vpc-1" } I1204 12:36:22.397183 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:22.397220 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:22.397251 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:22.397370 17225 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I1204 12:36:22.397411 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:22.397483 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:22.397535 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:22.397599 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:22.397570 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }], VpcId: "vpc-1" } I1204 12:36:22.397649 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:22.397662 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1204 12:36:22.397728 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:22.397797 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:22.397870 17225 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1204 12:36:22.397904 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:22.397938 17225 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I1204 12:36:22.398003 17225 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I1204 12:36:22.398061 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:22.398097 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:22.398148 17225 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1204 12:36:22.398220 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:22.398259 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:22.398071 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1204 12:36:22.398287 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "api-elb.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I1204 12:36:22.398350 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:22.398382 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:22.398413 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1204 12:36:22.398506 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I1204 12:36:22.398544 17225 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1204 12:36:22.398641 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:22.398685 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:22.398718 17225 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1204 12:36:22.398825 17225 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1204 12:36:22.398963 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.399094 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.399219 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.399391 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I1204 12:36:22.399467 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:22.399571 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1204 12:36:22.399601 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I1204 12:36:22.399633 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:22.399728 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-1", TransitGatewayId: "tgw-123456" } I1204 12:36:22.399838 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I1204 12:36:22.400022 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1204 12:36:22.400196 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I1204 12:36:22.400326 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:22.400392 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1204 12:36:22.400448 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:22.400546 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.400710 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:22.400818 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-1", TransitGatewayId: "tgw-0123456" } I1204 12:36:22.400863 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1204 12:36:22.400974 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:22.401036 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1204 12:36:22.401179 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1204 12:36:22.401287 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" } ] }] } I1204 12:36:22.401404 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1204 12:36:22.401442 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:22.401485 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I1204 12:36:22.401610 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I1204 12:36:22.401689 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I1204 12:36:22.401759 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I1204 12:36:22.401883 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1204 12:36:22.401925 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I1204 12:36:22.402028 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.402143 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.402252 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.402350 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1204 12:36:22.402416 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1204 12:36:22.402450 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1204 12:36:22.402479 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1204 12:36:22.402610 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" } ] }] } I1204 12:36:22.402715 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I1204 12:36:22.402782 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I1204 12:36:22.402877 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I1204 12:36:22.402942 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-2" } I1204 12:36:22.402975 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I1204 12:36:22.403038 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" } ] }] } I1204 12:36:22.403186 17225 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1204 12:36:22.403255 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1204 12:36:22.403260 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1204 12:36:22.403309 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:22.403370 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I1204 12:36:22.403403 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-3" } I1204 12:36:22.403393 17225 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-1" }], Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ], Type: "network" } I1204 12:36:22.403476 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:22.403520 17225 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1204 12:36:22.403586 17225 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1204 12:36:22.403635 17225 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1204 12:36:22.403686 17225 api.go:53] PageSize not implemented I1204 12:36:22.403724 17225 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1204 12:36:22.403765 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:22.403801 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:22.403808 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:22.403820 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:22.403906 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:22.403970 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:22.403880 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:22.403986 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:22.404073 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:22.404181 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:22.408149 17225 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1204 12:36:22.408304 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:22.408405 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:22.408491 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:22.408583 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:22.409191 17225 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1204 12:36:22.409399 17225 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1204 12:36:22.409598 17225 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1204 12:36:22.409637 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:22.409664 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:22.409717 17225 dns.go:235] Pre-creating DNS records I1204 12:36:22.409737 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:22.416084 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:22.419532 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:22.419600 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:22.997428 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:23.150597 17225 iamrole.go:89] ListRoles: { } I1204 12:36:23.152290 17225 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1204 12:36:23.152484 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1204 12:36:23.152645 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1204 12:36:23.152766 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:23.152844 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.152928 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:23.152926 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:23.152949 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:23.153024 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.153071 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] }] } I1204 12:36:23.153336 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.153669 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1204 12:36:23.153807 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W1204 12:36:23.154247 17225 api.go:53] PageSize not implemented I1204 12:36:23.155746 17225 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1204 12:36:23.155855 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:23.155900 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.156045 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:23.156012 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.156014 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:23.156127 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:23.156106 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.156160 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:23.156189 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.156206 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:23.156292 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:23.156328 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:23.156306 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.156425 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:23.156467 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.156601 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:23.156635 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:23.156763 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:23.156817 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:23.156965 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:23.157004 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.157076 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I1204 12:36:23.157202 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:23.157322 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:23.157378 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1204 12:36:23.157711 17225 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1204 12:36:23.157811 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:23.157931 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:23.158065 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.158211 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:23.158263 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:23.158429 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:23.158567 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:23.158836 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:23.158992 17225 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1204 12:36:23.159047 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:23.159076 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:23.159160 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:23.159174 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.159208 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.159232 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:23.159266 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:23.159291 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:23.159311 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1204 12:36:23.159388 17225 api.go:53] PageSize not implemented I1204 12:36:23.159449 17225 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1204 12:36:23.159507 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:23.159509 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1204 12:36:23.159548 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W1204 12:36:23.159553 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:23.159567 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:23.159566 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:23.159618 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:23.159593 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.159649 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:23.159692 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:23.159715 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.159803 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:23.159834 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.159898 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.164292 17225 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1204 12:36:23.164416 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.164547 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.164615 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.164731 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.165348 17225 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1204 12:36:23.165537 17225 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1204 12:36:23.165695 17225 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I1204 12:36:23.170595 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:23.173595 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.183404 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:23.186824 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.186894 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.757617 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:23.924390 17225 iamrole.go:89] ListRoles: { } I1204 12:36:23.925956 17225 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1204 12:36:23.926264 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1204 12:36:23.926467 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } W1204 12:36:23.926786 17225 api.go:53] PageSize not implemented I1204 12:36:23.926968 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1204 12:36:23.927153 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.927250 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:23.927267 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:23.927355 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:23.927417 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.927593 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.927726 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1204 12:36:23.927821 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:23.927905 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.929574 17225 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1204 12:36:23.929741 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.929787 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:23.929901 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:23.929960 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:23.930005 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:23.929943 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:23.930064 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:23.930052 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:23.930157 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:23.930140 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.930188 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:23.930234 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:23.930379 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:23.930422 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.930578 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.930659 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:23.930699 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.930765 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.930867 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:23.930932 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.931037 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:23.931065 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.931173 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:23.931295 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:23.931350 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:23.931529 17225 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1204 12:36:23.931731 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:23.931862 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:23.931998 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:23.932068 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:23.932158 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:23.932263 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:23.932579 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:23.932689 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:23.932787 17225 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1204 12:36:23.932841 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:23.932865 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:23.932939 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:23.932956 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.932992 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.933018 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:23.933047 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:23.933073 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:23.933095 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:23.933249 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I1204 12:36:23.933279 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:23.933302 17225 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I1204 12:36:23.933325 17225 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I1204 12:36:23.933347 17225 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I1204 12:36:23.933422 17225 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I1204 12:36:23.933470 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.933495 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W1204 12:36:23.933524 17225 api.go:53] PageSize not implemented I1204 12:36:23.933570 17225 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1204 12:36:23.933612 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:23.933650 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:23.933663 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.933636 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:23.933756 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:23.933785 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:23.933818 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:23.933811 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.933889 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:23.933907 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:23.933929 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.934008 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:23.934056 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:23.934069 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:23.938484 17225 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1204 12:36:23.938598 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.938736 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.939216 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.939358 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.939973 17225 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1204 12:36:23.940182 17225 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1204 12:36:23.940343 17225 executor.go:111] Tasks: 135 done / 135 total; 0 can run I1204 12:36:23.940377 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:23.940405 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:23.940459 17225 dns.go:235] Pre-creating DNS records I1204 12:36:23.946863 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:23.950431 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:23.950503 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:24.516047 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:24.647941 17225 iamrole.go:89] ListRoles: { } I1204 12:36:24.649531 17225 executor.go:111] Tasks: 0 done / 135 total; 51 can run I1204 12:36:24.650045 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:24.650199 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:24.650296 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:24.650320 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:24.650374 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:24.650551 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:24.650591 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1204 12:36:24.650688 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1204 12:36:24.650828 17225 api.go:53] PageSize not implemented I1204 12:36:24.650789 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:24.651318 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1204 12:36:24.651405 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:24.651466 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1204 12:36:24.652863 17225 executor.go:111] Tasks: 51 done / 135 total; 28 can run I1204 12:36:24.652984 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:24.652980 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:24.653109 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:24.653134 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:24.653059 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:24.653198 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:24.653225 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:24.653223 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:24.653276 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:24.653319 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:24.653298 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:24.653339 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:24.653405 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:24.653496 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:24.653602 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:24.653630 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1204 12:36:24.653733 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:24.653837 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:24.653879 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:24.653979 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:24.654012 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:24.654102 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:24.654180 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:24.654288 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:24.654335 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:24.654419 17225 executor.go:111] Tasks: 79 done / 135 total; 38 can run I1204 12:36:24.654511 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:24.654643 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:24.654740 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:24.654967 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:24.655033 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:24.655244 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I1204 12:36:24.655372 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:24.655405 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:24.655541 17225 executor.go:111] Tasks: 117 done / 135 total; 2 can run I1204 12:36:24.655610 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:24.655661 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:24.655674 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:24.655643 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:24.655699 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:24.655728 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:24.655756 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:24.655781 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:24.655805 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1204 12:36:24.655868 17225 api.go:53] PageSize not implemented I1204 12:36:24.655905 17225 executor.go:111] Tasks: 119 done / 135 total; 4 can run I1204 12:36:24.655970 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:24.655971 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:24.656024 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:24.656002 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:24.656048 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:24.656041 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:24.656089 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:24.656108 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:24.656143 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:24.656208 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:24.656231 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:24.656298 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:24.656331 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:24.656342 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:24.660723 17225 executor.go:111] Tasks: 123 done / 135 total; 4 can run I1204 12:36:24.660838 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:24.660968 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:24.661042 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:24.661199 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:24.661810 17225 executor.go:111] Tasks: 127 done / 135 total; 2 can run I1204 12:36:24.662025 17225 executor.go:111] Tasks: 129 done / 135 total; 6 can run I1204 12:36:24.662190 17225 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I1204 12:36:24.664886 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:24.667871 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:24.677705 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:24.683406 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:24.683605 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:25.257068 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:25.413820 17225 iamrole.go:89] ListRoles: { } I1204 12:36:25.415093 17225 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1204 12:36:25.415373 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:25.415515 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:25.415641 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:25.415637 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1204 12:36:25.415964 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W1204 12:36:25.417545 17225 api.go:53] PageSize not implemented I1204 12:36:25.417579 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:25.417747 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:25.417778 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:25.417858 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:25.418220 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:25.418289 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1204 12:36:25.418455 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I1204 12:36:25.419111 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1204 12:36:25.423132 17225 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1204 12:36:25.423260 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:25.423307 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:25.423273 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:25.423263 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:25.423344 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:25.423373 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:25.423390 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:25.423438 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:25.423530 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:25.423553 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:25.423602 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:25.423571 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:25.423687 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:25.423747 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I1204 12:36:25.423906 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:25.424032 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:25.424089 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:25.424188 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:25.424302 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:25.424330 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I1204 12:36:25.424422 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:25.424448 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:25.424509 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:25.424566 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:25.424624 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:25.424867 17225 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1204 12:36:25.425005 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:25.425101 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:25.425201 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:25.425285 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:25.425620 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:25.425719 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:25.425947 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:25.426051 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:25.426107 17225 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1204 12:36:25.426167 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:25.426195 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:25.426264 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:25.426278 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:25.426306 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:25.426329 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:25.426362 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:25.426386 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:25.426410 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1204 12:36:25.426488 17225 api.go:53] PageSize not implemented I1204 12:36:25.426534 17225 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1204 12:36:25.426586 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:25.426579 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:25.426632 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:25.426622 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:25.426663 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:25.426619 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:25.426648 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:25.426706 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:25.426748 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:25.426761 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:25.426850 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:25.426875 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:25.426949 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:25.426967 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:25.431084 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:36:25.431211 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:25.431350 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:25.431429 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:25.431577 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:25.431969 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:25.432025 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:25.432236 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:36:25.432446 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:36:25.432594 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:36:25.432644 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:25.432673 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:25.432732 17225 dns.go:235] Pre-creating DNS records I1204 12:36:25.439693 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:25.443074 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:25.443164 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.018156 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:26.182844 17225 iamrole.go:89] ListRoles: { } I1204 12:36:26.184432 17225 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1204 12:36:26.184685 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1204 12:36:26.184796 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.184881 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1204 12:36:26.184936 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:26.184976 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.185145 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:26.185235 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.185323 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:26.185344 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:26.185384 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.185413 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.185506 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1204 12:36:26.185575 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } W1204 12:36:26.185647 17225 api.go:53] PageSize not implemented I1204 12:36:26.187004 17225 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1204 12:36:26.187152 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I1204 12:36:26.187272 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:26.187360 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:26.187349 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.187358 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:26.187451 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:26.187491 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:26.187494 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.187566 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:26.187629 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:26.187664 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:26.187672 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:26.187716 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:26.187847 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:26.187887 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.187960 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:26.188064 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:26.188106 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.188195 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.188258 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.188352 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.188411 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:26.188532 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:26.188576 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.188708 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:26.188773 17225 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1204 12:36:26.189403 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] }] } I1204 12:36:26.189582 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:26.189719 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:26.189977 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:26.190065 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:26.190251 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:26.190315 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:26.190394 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:26.190467 17225 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1204 12:36:26.190516 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:26.190524 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:26.190573 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:26.190588 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.190621 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.190645 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:26.190673 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:26.190694 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:26.190715 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1204 12:36:26.190777 17225 api.go:53] PageSize not implemented I1204 12:36:26.190812 17225 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1204 12:36:26.190845 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1204 12:36:26.190860 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1204 12:36:26.190878 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:26.190888 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:26.190889 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.190991 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:26.191011 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:26.190958 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:26.191036 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:26.191058 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.191278 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:26.191330 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.191480 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:26.191515 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.195631 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:36:26.195759 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.195922 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.195998 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.196183 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.196821 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:36:26.197014 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:36:26.197231 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I1204 12:36:26.201230 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:26.204327 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.204391 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.216283 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:26.219524 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.219596 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.219634 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.797393 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:26.952454 17225 iamrole.go:89] ListRoles: { } I1204 12:36:26.953590 17225 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1204 12:36:26.953783 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1204 12:36:26.953916 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:26.953926 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:26.953997 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1204 12:36:26.954068 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1204 12:36:26.954162 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1204 12:36:26.955507 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:26.955578 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.956448 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:26.956541 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.957775 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.958431 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W1204 12:36:26.958773 17225 api.go:53] PageSize not implemented I1204 12:36:26.958846 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.961326 17225 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1204 12:36:26.961430 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.961479 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:26.961514 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:26.961572 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:26.961577 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.961615 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:26.961652 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:26.961683 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:26.961784 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:26.961824 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.961906 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:26.961960 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.962055 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.962138 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.962168 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:26.962209 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:26.962231 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:26.962204 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:26.962297 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:26.962410 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.962513 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:26.962568 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:26.962615 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:26.962643 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:26.962667 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.963357 17225 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1204 12:36:26.963550 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:26.963624 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:26.963770 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:26.963940 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:26.964161 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:26.964222 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:26.964330 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:26.964436 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:26.964553 17225 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1204 12:36:26.964603 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:26.964659 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:26.964737 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:26.964753 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.964787 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.964813 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:26.964847 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:26.964872 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:26.964893 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1204 12:36:26.964966 17225 api.go:53] PageSize not implemented I1204 12:36:26.965013 17225 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1204 12:36:26.965077 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:26.965168 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:26.965189 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:26.965213 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:26.965081 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:26.965232 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:26.965250 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.965332 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:26.965374 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:26.965393 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.965477 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:26.965514 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.965566 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:26.965584 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:26.970111 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:36:26.970220 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.970356 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.970431 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.970574 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.971063 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:36:26.971333 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:36:26.971506 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:36:26.971546 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:26.971585 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:26.971640 17225 dns.go:235] Pre-creating DNS records I1204 12:36:26.978057 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:26.981337 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.981403 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:26.981441 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.564673 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:27.726060 17225 iamrole.go:89] ListRoles: { } I1204 12:36:27.727633 17225 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1204 12:36:27.727858 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:27.728018 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1204 12:36:27.728212 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1204 12:36:27.728288 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1204 12:36:27.728400 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:27.728475 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:27.728564 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:27.728587 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:27.728634 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:27.728666 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:27.728775 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W1204 12:36:27.728956 17225 api.go:53] PageSize not implemented I1204 12:36:27.729023 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1204 12:36:27.729130 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:27.730245 17225 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1204 12:36:27.730385 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:27.730484 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:27.730528 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:27.730398 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1204 12:36:27.730527 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:27.730584 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:27.730592 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:27.730611 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:27.730688 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:27.730737 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:27.730775 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:27.730826 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:27.730943 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:27.731019 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:27.731144 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:27.731246 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:27.731371 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:27.731408 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1204 12:36:27.731516 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:27.731640 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:27.731686 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:27.731794 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:27.731825 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:27.731898 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:27.732024 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:27.732189 17225 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1204 12:36:27.732412 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:27.732524 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:27.732641 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:27.732719 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:27.732849 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:27.733013 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:27.733112 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:27.733205 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:27.733478 17225 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1204 12:36:27.733557 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:27.733553 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:27.733653 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:27.733668 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:27.733702 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:27.733727 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:27.733758 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:27.733782 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:27.733808 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1204 12:36:27.733881 17225 api.go:53] PageSize not implemented I1204 12:36:27.733931 17225 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1204 12:36:27.733973 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:27.734013 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:27.734024 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:27.734100 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:27.734024 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:27.734140 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:27.734198 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:27.734217 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:27.734247 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:27.734297 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:27.734316 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:27.734412 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:27.734456 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:27.734539 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:27.738457 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:36:27.738564 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.738729 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.738867 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.738999 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.739485 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:36:27.739673 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:36:27.739843 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I1204 12:36:27.742159 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:27.748644 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.748721 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.748756 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.757160 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:27.761312 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.761391 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.761433 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:27.761464 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:28.341783 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:28.496037 17225 iamrole.go:89] ListRoles: { } I1204 12:36:28.497216 17225 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1204 12:36:28.497432 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:28.497526 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:28.497595 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:28.497612 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:28.497642 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:28.497664 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1204 12:36:28.497760 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:28.499415 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } W1204 12:36:28.499628 17225 api.go:53] PageSize not implemented I1204 12:36:28.499607 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:28.501036 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:28.501767 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1204 12:36:28.502342 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1204 12:36:28.502708 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:28.505178 17225 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1204 12:36:28.505312 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:28.505447 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:28.505472 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:28.505544 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:28.505585 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:28.505593 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:28.505689 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:28.505674 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:28.505760 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:28.505807 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:28.505803 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:28.505867 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:28.505835 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:28.505958 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:28.505992 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:28.506080 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:28.506223 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:28.506263 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] }] } I1204 12:36:28.506367 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:28.506437 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:28.506495 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:28.506602 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:28.506641 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:28.506735 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:28.506842 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:28.506978 17225 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1204 12:36:28.507059 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:28.507203 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:28.507432 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:28.507610 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:28.507790 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:28.507854 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:28.507956 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:28.507983 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:28.508131 17225 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1204 12:36:28.508193 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1204 12:36:28.508201 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } W1204 12:36:28.508244 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:28.508284 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:28.508310 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:28.508327 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:28.508346 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:28.508396 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:28.508412 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1204 12:36:28.508467 17225 api.go:53] PageSize not implemented I1204 12:36:28.508500 17225 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1204 12:36:28.508542 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:28.508566 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:28.508549 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:28.508584 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:28.508595 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:28.508599 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:28.508649 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:28.508668 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:28.508695 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:28.508774 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:28.508807 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:28.508889 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:28.508952 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:28.508964 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:28.512716 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:36:28.512783 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:28.512858 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:28.512949 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:28.513084 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:28.513523 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:36:28.513713 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:36:28.513856 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:36:28.513899 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:28.513925 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:28.513978 17225 dns.go:235] Pre-creating DNS records I1204 12:36:28.520322 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I1204 12:36:28.523667 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:28.523729 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:28.523766 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:28.523796 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:29.104633 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:29.255632 17225 iamrole.go:89] ListRoles: { } I1204 12:36:29.256629 17225 executor.go:111] Tasks: 0 done / 136 total; 52 can run I1204 12:36:29.256827 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:29.256854 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I1204 12:36:29.256986 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.257085 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:29.257132 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:29.257204 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I1204 12:36:29.257394 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.257567 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W1204 12:36:29.257488 17225 api.go:53] PageSize not implemented I1204 12:36:29.257706 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I1204 12:36:29.258049 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.258200 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.258429 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I1204 12:36:29.258662 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I1204 12:36:29.259478 17225 executor.go:111] Tasks: 52 done / 136 total; 28 can run I1204 12:36:29.259549 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I1204 12:36:29.259626 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:29.259659 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I1204 12:36:29.259760 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:29.259766 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:29.259804 17225 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:29.259702 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I1204 12:36:29.259849 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:29.259814 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.259893 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I1204 12:36:29.259949 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:29.259955 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I1204 12:36:29.260061 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:29.260100 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I1204 12:36:29.259987 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.260193 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.260316 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I1204 12:36:29.260429 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:29.260464 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:29.260527 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I1204 12:36:29.260641 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:29.260689 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.260831 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:29.260864 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:29.260938 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:29.261083 17225 executor.go:111] Tasks: 80 done / 136 total; 38 can run I1204 12:36:29.261311 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:29.261429 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.261582 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I1204 12:36:29.261693 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:29.261784 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:29.261876 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:29.261969 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:29.262007 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:29.262055 17225 executor.go:111] Tasks: 118 done / 136 total; 2 can run I1204 12:36:29.262094 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:29.262137 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:29.262148 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:29.262163 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:29.262136 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:29.262176 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I1204 12:36:29.262194 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I1204 12:36:29.262211 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I1204 12:36:29.262224 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W1204 12:36:29.262264 17225 api.go:53] PageSize not implemented I1204 12:36:29.262288 17225 executor.go:111] Tasks: 120 done / 136 total; 4 can run I1204 12:36:29.262314 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:29.262333 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:29.262340 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:29.262365 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:29.262412 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:29.262433 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:29.262456 17225 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I1204 12:36:29.262452 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:29.262530 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:29.262558 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:29.262637 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:29.262668 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:29.262754 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { } I1204 12:36:29.262797 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:29.264721 17225 executor.go:111] Tasks: 124 done / 136 total; 4 can run I1204 12:36:29.264776 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:29.264850 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:29.265000 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:29.265070 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:29.265743 17225 executor.go:111] Tasks: 128 done / 136 total; 2 can run I1204 12:36:29.265945 17225 executor.go:111] Tasks: 130 done / 136 total; 6 can run I1204 12:36:29.266152 17225 executor.go:111] Tasks: 136 done / 136 total; 0 can run I1204 12:36:29.266274 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:29.266312 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:29.266338 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:29.266359 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:29.266379 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:29.266398 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:29.266417 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:29.266438 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:29.266464 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:29.266488 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:29.266506 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:29.266524 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:29.266547 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:29.266566 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:29.266589 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:29.266610 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:29.266631 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:29.266652 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:29.266675 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:29.266694 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:29.266714 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I1204 12:36:29.266735 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:29.266753 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:29.266771 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:29.266795 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:29.266821 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:29.266842 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:29.269995 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:29.270377 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:29.270432 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:29.270482 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.270613 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1204 12:36:29.270718 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.270819 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.270909 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.270985 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.271041 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.271137 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I1204 12:36:29.271243 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.271395 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I1204 12:36:29.271451 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W1204 12:36:29.271555 17225 api.go:53] PageSize not implemented I1204 12:36:29.271583 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:29.271619 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:29.271638 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I1204 12:36:29.271689 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:29.271735 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:29.271766 17225 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" ] } I1204 12:36:29.271870 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:29.271934 17225 iamrole.go:89] ListRoles: { } I1204 12:36:29.272069 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:29.272152 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:29.272271 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:29.272389 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:29.272490 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } autoscaling-config:lt-1 ok I1204 12:36:29.273423 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1204 12:36:29.273487 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } iam-instance-profile:nodes.complex.example.com ok I1204 12:36:29.273455 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1204 12:36:29.273525 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1204 12:36:29.273536 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok autoscaling-config:lt-2 ok I1204 12:36:29.273523 17225 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } autoscaling-group:nodes.complex.example.com ok I1204 12:36:29.273568 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok autoscaling-group:master-us-test-1a.masters.complex.example.com ok I1204 12:36:29.273608 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:29.273610 17225 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4 ok I1204 12:36:29.273651 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 } ] } W1204 12:36:29.273810 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:29.273766 17225 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5 ok I1204 12:36:29.273825 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1204 12:36:29.273703 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.complex.example.com. ok I1204 12:36:29.273849 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:29.274425 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 } ] } W1204 12:36:29.274676 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:29.274695 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:29.274730 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:29.274836 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1204 12:36:29.274869 17225 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1204 12:36:29.274917 17225 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1204 12:36:29.274954 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1204 12:36:29.275004 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1204 12:36:29.275085 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I1204 12:36:29.275141 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I1204 12:36:29.275156 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I1204 12:36:29.275185 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I1204 12:36:29.275097 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I1204 12:36:29.275208 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } subnet:subnet-1 ok I1204 12:36:29.275240 17225 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I1204 12:36:29.275250 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I1204 12:36:29.275267 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I1204 12:36:29.275258 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1204 12:36:29.275344 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I1204 12:36:29.275404 17225 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1204 12:36:29.275458 17225 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (7.65s) === RUN TestLifecycleExternalLB I1204 12:36:29.275835 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:29.275941 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:29.275967 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:29.275997 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:29.276024 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:29.276061 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:29.276090 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:29.276111 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:29.276153 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:29.276176 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I1204 12:36:29.295948 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:29.298589 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:29.298657 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:29.878603 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:30.000775 17225 iamrole.go:89] ListRoles: { } I1204 12:36:30.001776 17225 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1204 12:36:30.002028 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I1204 12:36:30.002156 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I1204 12:36:30.002174 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.002336 17225 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" }] }] } I1204 12:36:30.002407 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1204 12:36:30.002435 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1204 12:36:30.002459 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:30.003351 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.003585 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:30.003575 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:30.003557 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I1204 12:36:30.003729 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:30.003728 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I1204 12:36:30.003794 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:30.004392 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I1204 12:36:30.004609 17225 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1204 12:36:30.004812 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:30.004929 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:30.005198 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" }] }] } I1204 12:36:30.005329 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1204 12:36:30.005427 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W1204 12:36:30.005620 17225 api.go:53] PageSize not implemented I1204 12:36:30.005480 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1204 12:36:30.005693 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } W1204 12:36:30.005803 17225 api.go:53] PageSize not implemented I1204 12:36:30.005683 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:30.006101 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:30.006480 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1204 12:36:30.006608 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1204 12:36:30.006774 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } W1204 12:36:30.006900 17225 api.go:53] PageSize not implemented I1204 12:36:30.006852 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1204 12:36:30.006996 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1204 12:36:30.007045 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I1204 12:36:30.009422 17225 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1204 12:36:30.009505 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:30.009570 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1204 12:36:30.009576 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.009669 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1204 12:36:30.009719 17225 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1204 12:36:30.009701 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I1204 12:36:30.009728 17225 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1204 12:36:30.009787 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:30.009823 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1204 12:36:30.009876 17225 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1204 12:36:30.009907 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:30.009934 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:30.009954 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I1204 12:36:30.010038 17225 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" }] }] } I1204 12:36:30.010084 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.010171 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1204 12:36:30.010204 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1204 12:36:30.010345 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" } ] }], VpcId: "vpc-1" } I1204 12:36:30.010345 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1204 12:36:30.010524 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" }] }], VpcId: "vpc-1" } I1204 12:36:30.010600 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:30.010646 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:30.010675 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1204 12:36:30.010653 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1204 12:36:30.010808 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:30.010868 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:30.010906 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:30.010934 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:30.010975 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:30.011006 17225 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" } ] } I1204 12:36:30.012674 17225 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1204 12:36:30.012819 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.012923 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.012974 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" }] }] } I1204 12:36:30.013226 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" }] }] } I1204 12:36:30.013388 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:30.013506 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:30.013602 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1204 12:36:30.013725 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.013805 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.013973 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1204 12:36:30.014158 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:30.014275 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:30.014329 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1204 12:36:30.014527 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1204 12:36:30.014636 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:30.014713 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1204 12:36:30.014817 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1204 12:36:30.014943 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1204 12:36:30.015074 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1204 12:36:30.015194 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1204 12:36:30.015231 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1204 12:36:30.015264 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1204 12:36:30.015355 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I1204 12:36:30.015446 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" }] }] } I1204 12:36:30.015538 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I1204 12:36:30.015660 17225 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1204 12:36:30.015886 17225 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1204 12:36:30.016063 17225 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1204 12:36:30.016107 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:30.016160 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:30.016217 17225 dns.go:235] Pre-creating DNS records I1204 12:36:30.016242 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:30.021288 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:30.023950 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.024065 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.608286 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:30.759278 17225 iamrole.go:89] ListRoles: { } I1204 12:36:30.760424 17225 executor.go:111] Tasks: 0 done / 107 total; 51 can run I1204 12:36:30.760645 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W1204 12:36:30.760768 17225 api.go:53] PageSize not implemented I1204 12:36:30.760783 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:30.760812 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:30.760856 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:30.761034 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1204 12:36:30.761158 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1204 12:36:30.761094 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.761209 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } W1204 12:36:30.761408 17225 api.go:53] PageSize not implemented I1204 12:36:30.761348 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:30.761474 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1204 12:36:30.761549 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I1204 12:36:30.761587 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I1204 12:36:30.761633 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1204 12:36:30.761704 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I1204 12:36:30.761727 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } W1204 12:36:30.761734 17225 api.go:53] PageSize not implemented I1204 12:36:30.761789 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } I1204 12:36:30.762074 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:30.762180 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.764136 17225 executor.go:111] Tasks: 51 done / 107 total; 23 can run I1204 12:36:30.764244 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:30.764358 17225 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I1204 12:36:30.764332 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I1204 12:36:30.764406 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I1204 12:36:30.764460 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:30.764510 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.764668 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] }] } I1204 12:36:30.764799 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:30.764842 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I1204 12:36:30.764979 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:30.765029 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.765141 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:30.768801 17225 executor.go:111] Tasks: 74 done / 107 total; 25 can run I1204 12:36:30.768904 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:30.769058 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.769182 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:30.769334 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:30.769648 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.769770 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.770063 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.770661 17225 executor.go:111] Tasks: 99 done / 107 total; 2 can run I1204 12:36:30.770863 17225 executor.go:111] Tasks: 101 done / 107 total; 6 can run I1204 12:36:30.771029 17225 executor.go:111] Tasks: 107 done / 107 total; 0 can run I1204 12:36:30.773337 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:30.773384 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:30.773411 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:30.773435 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:30.773455 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:30.773473 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:30.773496 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:30.773517 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:30.773561 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:30.773588 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:30.773617 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:30.773639 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:30.773657 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:30.773679 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:30.773698 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:30.773718 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:30.773741 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:30.773766 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:30.773786 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:30.773806 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:30.773828 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:30.773852 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:30.773873 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:30.773894 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:30.774918 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:30.774970 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:30.774984 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:30.775015 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.775051 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1204 12:36:30.775087 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.775145 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.775178 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.775216 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.775246 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.775271 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I1204 12:36:30.775302 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.775335 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I1204 12:36:30.775361 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W1204 12:36:30.775395 17225 api.go:53] PageSize not implemented I1204 12:36:30.775411 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:30.775429 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:30.775442 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:30.775457 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:30.775490 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1204 12:36:30.775527 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:30.775553 17225 iamrole.go:89] ListRoles: { } I1204 12:36:30.775591 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:30.775612 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:30.775643 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:30.775675 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:30.775711 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:30.776035 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1204 12:36:30.776086 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok I1204 12:36:30.776081 17225 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I1204 12:36:30.776130 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } autoscaling-config:lt-2 ok I1204 12:36:30.776165 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I1204 12:36:30.776173 17225 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } I1204 12:36:30.776203 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } iam-instance-profile:nodes.externallb.example.com ok autoscaling-group:nodes.externallb.example.com ok internet-gateway:igw-2 ok I1204 12:36:30.776213 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.externallb.example.com. ok I1204 12:36:30.776247 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W1204 12:36:30.776417 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:30.776437 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1204 12:36:30.776468 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1204 12:36:30.776535 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1204 12:36:30.776574 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:30.776618 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1204 12:36:30.776707 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:30.776724 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:30.776749 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok I1204 12:36:30.776843 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1204 12:36:30.776860 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I1204 12:36:30.776907 17225 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I1204 12:36:30.776923 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I1204 12:36:30.776947 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I1204 12:36:30.776974 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I1204 12:36:30.777003 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I1204 12:36:30.777013 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I1204 12:36:30.777031 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I1204 12:36:30.777087 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1204 12:36:30.777158 17225 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1204 12:36:30.777214 17225 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (1.50s) === RUN TestLifecycleSharedSubnet I1204 12:36:30.777611 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:30.777722 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:30.777751 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:30.777786 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:30.777816 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:30.777852 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:30.777886 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:30.777906 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:30.777932 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:30.777954 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I1204 12:36:30.797928 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:30.801244 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:30.801346 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:31.388504 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:31.552379 17225 iamrole.go:89] ListRoles: { } I1204 12:36:31.553325 17225 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1204 12:36:31.553727 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:31.553859 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:36:31.553994 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1204 12:36:31.554025 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1204 12:36:31.554094 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I1204 12:36:31.554080 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:31.554228 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I1204 12:36:31.554319 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:31.554471 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:31.554520 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:31.554682 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:31.554801 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:31.554849 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1204 12:36:31.555334 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:31.556188 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I1204 12:36:31.556271 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I1204 12:36:31.557946 17225 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1204 12:36:31.558102 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1204 12:36:31.558200 17225 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1204 12:36:31.558188 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:36:31.558308 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1204 12:36:31.558320 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1204 12:36:31.558469 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1204 12:36:31.558525 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1204 12:36:31.558644 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1204 12:36:31.558718 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1204 12:36:31.558801 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:31.558849 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:31.558900 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1204 12:36:31.559096 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1204 12:36:31.559220 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:31.559269 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:31.559320 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:31.559379 17225 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" } ] } I1204 12:36:31.560060 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1204 12:36:31.562740 17225 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1204 12:36:31.562927 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1204 12:36:31.563079 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1204 12:36:31.563266 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1204 12:36:31.563428 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1204 12:36:31.563537 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" }] }] } I1204 12:36:31.563685 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1204 12:36:31.563836 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1204 12:36:31.564440 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:31.564553 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" }] }] } I1204 12:36:31.564659 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:31.564731 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1204 12:36:31.564879 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:31.565037 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" }] }] } I1204 12:36:31.566666 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1204 12:36:31.567221 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1204 12:36:31.567543 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:31.568410 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I1204 12:36:31.568794 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I1204 12:36:31.569211 17225 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1204 12:36:31.569715 17225 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1204 12:36:31.570777 17225 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1204 12:36:31.570827 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:31.570875 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:31.570937 17225 dns.go:235] Pre-creating DNS records I1204 12:36:31.570962 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:31.577439 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:31.580097 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:31.580179 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:32.162041 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:32.323350 17225 iamrole.go:89] ListRoles: { } I1204 12:36:32.324328 17225 executor.go:111] Tasks: 0 done / 94 total; 44 can run I1204 12:36:32.324575 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.324795 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.325997 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:32.326106 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:36:32.326295 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1204 12:36:32.326340 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1204 12:36:32.326835 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:32.327958 17225 executor.go:111] Tasks: 44 done / 94 total; 20 can run I1204 12:36:32.328082 17225 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1204 12:36:32.328146 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I1204 12:36:32.328293 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1204 12:36:32.328301 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1204 12:36:32.328465 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:32.328535 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:36:32.328629 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I1204 12:36:32.328760 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:32.334974 17225 executor.go:111] Tasks: 64 done / 94 total; 22 can run I1204 12:36:32.335215 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:32.335344 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:32.335503 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:32.335776 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:32.336420 17225 executor.go:111] Tasks: 86 done / 94 total; 2 can run I1204 12:36:32.336687 17225 executor.go:111] Tasks: 88 done / 94 total; 6 can run I1204 12:36:32.336906 17225 executor.go:111] Tasks: 94 done / 94 total; 0 can run I1204 12:36:32.339096 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:32.339164 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:32.339188 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:32.339211 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:32.339231 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:32.339250 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:32.339273 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:32.339301 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:32.339327 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:32.339350 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:32.339369 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:32.339387 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:32.339408 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:32.339433 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:32.339455 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:32.339476 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:32.339495 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:32.339516 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:32.339542 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:32.340860 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:32.340924 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:32.340939 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:32.340969 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.341011 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1204 12:36:32.341061 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.341156 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.341215 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.341272 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.341335 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.341383 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I1204 12:36:32.341434 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.341491 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I1204 12:36:32.341535 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W1204 12:36:32.341596 17225 api.go:53] PageSize not implemented I1204 12:36:32.341626 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:32.341660 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:32.341686 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:32.341719 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:32.341745 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1204 12:36:32.341819 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:32.341876 17225 iamrole.go:89] ListRoles: { } I1204 12:36:32.341939 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:32.341978 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:32.342026 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:32.342076 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:32.342521 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } autoscaling-group:nodes.sharedsubnet.example.com ok I1204 12:36:32.342534 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1204 12:36:32.342612 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I1204 12:36:32.342638 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1204 12:36:32.342711 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1204 12:36:32.342756 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:32.342760 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1204 12:36:32.342819 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } iam-instance-profile:nodes.sharedsubnet.example.com ok I1204 12:36:32.342674 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.sharedsubnet.example.com. ok I1204 12:36:32.342814 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1204 12:36:32.342973 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:32.343000 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I1204 12:36:32.343069 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:32.343128 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1204 12:36:32.343278 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:32.343291 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:32.343350 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I1204 12:36:32.343394 17225 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I1204 12:36:32.343407 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I1204 12:36:32.343440 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I1204 12:36:32.343469 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I1204 12:36:32.343499 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I1204 12:36:32.343508 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I1204 12:36:32.343531 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (1.57s) === RUN TestLifecyclePrivateSharedSubnet I1204 12:36:32.343971 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:32.344092 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:32.344141 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:32.344175 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:32.344203 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:32.344241 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:32.344273 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:32.344293 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:32.344321 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:32.344342 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I1204 12:36:32.367635 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:32.370971 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:32.371080 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:32.371171 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:32.948486 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:33.098297 17225 iamrole.go:89] ListRoles: { } I1204 12:36:33.099694 17225 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1204 12:36:33.100057 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I1204 12:36:33.100159 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-subnet.example.com" }] } I1204 12:36:33.100657 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I1204 12:36:33.100683 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.100790 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1204 12:36:33.100918 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:33.100929 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:33.100986 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I1204 12:36:33.101090 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:33.101081 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1204 12:36:33.101158 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] }] } I1204 12:36:33.101285 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:33.101373 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:33.101408 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:36:33.101469 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1204 12:36:33.101490 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1204 12:36:33.101527 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:33.101638 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1204 12:36:33.102066 17225 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1204 12:36:33.102200 17225 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1204 12:36:33.102250 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1204 12:36:33.102261 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:36:33.102355 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1204 12:36:33.102380 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1204 12:36:33.102431 17225 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1204 12:36:33.102480 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1204 12:36:33.102480 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1204 12:36:33.102530 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1204 12:36:33.102729 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1204 12:36:33.102677 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1204 12:36:33.102714 17225 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1204 12:36:33.102833 17225 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1204 12:36:33.102901 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1204 12:36:33.102885 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1204 12:36:33.102949 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1204 12:36:33.102968 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1204 12:36:33.103134 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }], VpcId: "vpc-12345678" } I1204 12:36:33.103216 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:33.103257 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:33.103295 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1204 12:36:33.103461 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1204 12:36:33.103537 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:33.103585 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:33.103622 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:33.103659 17225 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I1204 12:36:33.103712 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1204 12:36:33.103832 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:33.103871 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:33.103901 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1204 12:36:33.103988 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1204 12:36:33.104024 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:33.104056 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:33.104087 17225 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" }] } I1204 12:36:33.103934 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1204 12:36:33.104250 17225 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1204 12:36:33.104376 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I1204 12:36:33.104382 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } W1204 12:36:33.104483 17225 loadbalancers.go:35] PageSize not implemented W1204 12:36:33.104495 17225 api.go:53] PageSize not implemented I1204 12:36:33.104603 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.104568 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.104618 17225 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I1204 12:36:33.104678 17225 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I1204 12:36:33.104713 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1204 12:36:33.104733 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.104758 17225 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1204 12:36:33.104782 17225 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } I1204 12:36:33.104801 17225 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } W1204 12:36:33.104876 17225 api.go:53] PageSize not implemented I1204 12:36:33.104905 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.104861 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1204 12:36:33.105084 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.105301 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.105440 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1204 12:36:33.105592 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.105718 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.105849 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" }] }] } I1204 12:36:33.106052 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.106265 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1204 12:36:33.106384 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1204 12:36:33.106486 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1204 12:36:33.106641 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.106759 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.106882 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.106998 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.107132 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I1204 12:36:33.107255 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I1204 12:36:33.107369 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1204 12:36:33.107497 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I1204 12:36:33.107588 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.107685 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.107771 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.107891 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.107989 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I1204 12:36:33.108132 17225 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1204 12:36:33.108196 17225 api.go:53] PageSize not implemented I1204 12:36:33.108234 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:33.108246 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.108335 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W1204 12:36:33.108451 17225 api.go:53] PageSize not implemented I1204 12:36:33.108497 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.108446 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:33.108624 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:33.112821 17225 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1204 12:36:33.113037 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.113158 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.113361 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.113514 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.114064 17225 executor.go:111] Tasks: 115 done / 123 total; 2 can run I1204 12:36:33.114337 17225 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1204 12:36:33.114590 17225 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1204 12:36:33.114631 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:33.114659 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:33.114710 17225 dns.go:235] Pre-creating DNS records I1204 12:36:33.114730 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:33.119761 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:33.122495 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.122555 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.122594 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.696625 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:33.839269 17225 iamrole.go:89] ListRoles: { } I1204 12:36:33.840678 17225 executor.go:111] Tasks: 0 done / 123 total; 46 can run I1204 12:36:33.840917 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] }] } I1204 12:36:33.841058 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:33.841230 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.841640 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:36:33.841750 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1204 12:36:33.841780 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1204 12:36:33.842293 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:33.843828 17225 executor.go:111] Tasks: 46 done / 123 total; 26 can run I1204 12:36:33.843937 17225 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1204 12:36:33.844039 17225 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1204 12:36:33.844038 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I1204 12:36:33.844123 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1204 12:36:33.844100 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I1204 12:36:33.844190 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I1204 12:36:33.844145 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I1204 12:36:33.844221 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I1204 12:36:33.844313 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:33.844361 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I1204 12:36:33.844477 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:33.844515 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:36:33.844591 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I1204 12:36:33.844692 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:33.844730 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I1204 12:36:33.844831 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:33.844892 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I1204 12:36:33.845396 17225 executor.go:111] Tasks: 72 done / 123 total; 31 can run I1204 12:36:33.845531 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:33.845600 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:33.845618 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1204 12:36:33.845653 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1204 12:36:33.845678 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I1204 12:36:33.845707 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } W1204 12:36:33.845731 17225 api.go:53] PageSize not implemented I1204 12:36:33.845735 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I1204 12:36:33.845753 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.845831 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.845858 17225 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1204 12:36:33.845824 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W1204 12:36:33.845918 17225 api.go:53] PageSize not implemented I1204 12:36:33.845927 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.845948 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.846144 17225 executor.go:111] Tasks: 103 done / 123 total; 5 can run W1204 12:36:33.846236 17225 api.go:53] PageSize not implemented I1204 12:36:33.846258 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:33.846315 17225 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I1204 12:36:33.846280 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.846340 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W1204 12:36:33.846361 17225 api.go:53] PageSize not implemented I1204 12:36:33.846367 17225 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I1204 12:36:33.846400 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.846545 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.846650 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.850609 17225 executor.go:111] Tasks: 108 done / 123 total; 7 can run I1204 12:36:33.850722 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.850860 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.850921 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.851043 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.851436 17225 executor.go:111] Tasks: 115 done / 123 total; 2 can run W1204 12:36:33.851521 17225 api.go:53] PageSize not implemented I1204 12:36:33.851539 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.851696 17225 executor.go:111] Tasks: 117 done / 123 total; 6 can run I1204 12:36:33.851842 17225 executor.go:111] Tasks: 123 done / 123 total; 0 can run I1204 12:36:33.854324 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:33.854376 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:33.854400 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:33.854420 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:33.854446 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:33.854466 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:33.854489 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:33.854515 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:33.854541 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1204 12:36:33.854565 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:33.854584 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:33.854607 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:33.854625 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:33.854645 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:33.854667 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:33.854687 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1204 12:36:33.854710 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:33.854735 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:33.854755 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:33.854776 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:33.854798 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:33.854819 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:33.855990 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:33.856048 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:33.856063 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:33.856094 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.856153 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1204 12:36:33.856203 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.856248 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.856278 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.856309 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.856340 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.856366 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I1204 12:36:33.856393 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.856424 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I1204 12:36:33.856448 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W1204 12:36:33.856478 17225 api.go:53] PageSize not implemented I1204 12:36:33.856492 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I1204 12:36:33.856523 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:33.856543 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:33.856556 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I1204 12:36:33.856583 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:33.856603 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:33.856615 17225 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I1204 12:36:33.856659 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:33.856693 17225 iamrole.go:89] ListRoles: { } I1204 12:36:33.856729 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:33.856751 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:33.856785 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:33.856818 17225 routetable.go:53] DescribeRouteTables: { } autoscaling-config:lt-1 ok I1204 12:36:33.857267 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } autoscaling-group:nodes.private-shared-subnet.example.com ok I1204 12:36:33.857288 17225 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I1204 12:36:33.857338 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1204 12:36:33.857443 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions load-balancer:api-private-shared-subnet-n2f8ak ok I1204 12:36:33.857458 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok autoscaling-group:bastion.private-shared-subnet.example.com ok I1204 12:36:33.857511 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } I1204 12:36:33.857532 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } volume:vol-2 ok I1204 12:36:33.857379 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-config:lt-3 ok route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-subnet.example.com. ok I1204 12:36:33.857575 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } iam-instance-profile:masters.private-shared-subnet.example.com ok I1204 12:36:33.857592 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1204 12:36:33.857644 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:33.857750 17225 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I1204 12:36:33.857689 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } W1204 12:36:33.857834 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:33.857847 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:33.857859 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1204 12:36:33.857869 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:33.857897 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok I1204 12:36:33.857928 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1204 12:36:33.857964 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I1204 12:36:33.857904 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W1204 12:36:33.857999 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:33.858010 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1204 12:36:33.857996 17225 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } autoscaling-config:lt-2 ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok I1204 12:36:33.858057 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1204 12:36:33.858165 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I1204 12:36:33.858216 17225 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I1204 12:36:33.858195 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:33.858229 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I1204 12:36:33.858268 17225 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I1204 12:36:33.858242 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I1204 12:36:33.858296 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } W1204 12:36:33.858321 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:33.858329 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I1204 12:36:33.858333 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1204 12:36:33.858340 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I1204 12:36:33.858358 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok I1204 12:36:33.858380 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I1204 12:36:33.858410 17225 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I1204 12:36:33.858420 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I1204 12:36:33.858439 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (1.51s) === RUN TestLifecyclePrivateSharedIP I1204 12:36:33.858824 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:33.858947 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:33.858978 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:33.859010 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:33.859039 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:33.859072 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:33.859107 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:33.859148 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:33.859177 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:33.859198 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I1204 12:36:33.881366 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:33.884154 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.884215 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:33.884257 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:34.460068 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:34.603036 17225 iamrole.go:89] ListRoles: { } I1204 12:36:34.604013 17225 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1204 12:36:34.604163 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:34.604279 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:34.604275 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I1204 12:36:34.604357 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:34.604379 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.private-shared-ip.example.com" }] } I1204 12:36:34.604606 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:34.604748 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:34.604841 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:34.604950 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:34.604950 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:34.605004 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I1204 12:36:34.605073 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:36:34.605153 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.private-shared-ip.example.com" }] } I1204 12:36:34.605169 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.605346 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1204 12:36:34.605327 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I1204 12:36:34.605391 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1204 12:36:34.605418 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1204 12:36:34.607003 17225 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1204 12:36:34.607125 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] }] } I1204 12:36:34.607186 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1204 12:36:34.607365 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1204 12:36:34.607457 17225 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1204 12:36:34.607368 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1204 12:36:34.607305 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:36:34.607512 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1204 12:36:34.607484 17225 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I1204 12:36:34.607582 17225 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1204 12:36:34.607601 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1204 12:36:34.607552 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:34.607656 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1204 12:36:34.607748 17225 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1204 12:36:34.607780 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1204 12:36:34.607761 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I1204 12:36:34.607798 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1204 12:36:34.607846 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1204 12:36:34.607826 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1204 12:36:34.608088 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1204 12:36:34.608286 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1204 12:36:34.608392 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:34.608432 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:34.608482 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1204 12:36:34.608667 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I1204 12:36:34.608749 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1204 12:36:34.608842 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:34.608916 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:34.609006 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1204 12:36:34.609072 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:34.609111 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:34.609158 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:34.609199 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:34.609132 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-12345678" } I1204 12:36:34.609229 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I1204 12:36:34.609397 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I1204 12:36:34.609494 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1204 12:36:34.609538 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:34.609386 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-12345678" } I1204 12:36:34.609576 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:34.609618 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:34.609652 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:34.609427 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1204 12:36:34.609686 17225 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I1204 12:36:34.609825 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:34.609869 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:34.609906 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:34.609951 17225 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1204 12:36:34.610045 17225 executor.go:111] Tasks: 74 done / 132 total; 36 can run I1204 12:36:34.610203 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W1204 12:36:34.610290 17225 api.go:53] PageSize not implemented I1204 12:36:34.610390 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:34.610443 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:34.610368 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1204 12:36:34.610408 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:34.610482 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:34.610518 17225 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I1204 12:36:34.610483 17225 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I1204 12:36:34.610605 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:34.610580 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:34.610639 17225 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1204 12:36:34.610787 17225 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1204 12:36:34.610714 17225 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } I1204 12:36:34.610776 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } W1204 12:36:34.610879 17225 api.go:53] PageSize not implemented I1204 12:36:34.610909 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1204 12:36:34.610930 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:34.610949 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:34.611061 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I1204 12:36:34.611131 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:34.611257 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:34.611392 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.611516 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I1204 12:36:34.611638 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:34.611701 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.611812 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I1204 12:36:34.611909 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } I1204 12:36:34.611987 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I1204 12:36:34.612067 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.612188 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I1204 12:36:34.612268 17225 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1204 12:36:34.612340 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:34.612396 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.612497 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1204 12:36:34.612596 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.612688 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1204 12:36:34.612722 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1204 12:36:34.612752 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1204 12:36:34.612847 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.612943 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.613035 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.613140 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.613236 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I1204 12:36:34.613324 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.613416 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:34.613525 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:34.613558 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.613653 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I1204 12:36:34.613744 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I1204 12:36:34.613834 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I1204 12:36:34.613868 17225 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I1204 12:36:34.613910 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I1204 12:36:34.613977 17225 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1204 12:36:34.614054 17225 api.go:53] PageSize not implemented I1204 12:36:34.614039 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:34.614097 17225 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:34.614095 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:34.614177 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:34.614199 17225 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } W1204 12:36:34.614260 17225 api.go:53] PageSize not implemented I1204 12:36:34.614270 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1204 12:36:34.614300 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:34.614331 17225 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I1204 12:36:34.614305 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:34.614279 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:34.614409 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:34.614476 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:34.618527 17225 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1204 12:36:34.618757 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:34.618886 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I1204 12:36:34.618984 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:34.619062 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:34.619158 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:34.619263 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:34.619838 17225 executor.go:111] Tasks: 124 done / 132 total; 2 can run I1204 12:36:34.620044 17225 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1204 12:36:34.620265 17225 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1204 12:36:34.620308 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:34.620341 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:34.620395 17225 dns.go:235] Pre-creating DNS records I1204 12:36:34.620417 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:34.625424 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:34.628208 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:34.628272 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:34.628311 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:35.202345 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:35.347479 17225 iamrole.go:89] ListRoles: { } I1204 12:36:35.348641 17225 executor.go:111] Tasks: 0 done / 132 total; 46 can run I1204 12:36:35.350731 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.351841 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:35.352209 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.353145 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:35.354012 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I1204 12:36:35.354867 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I1204 12:36:35.354923 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I1204 12:36:35.356939 17225 executor.go:111] Tasks: 46 done / 132 total; 28 can run I1204 12:36:35.357110 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1204 12:36:35.357182 17225 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I1204 12:36:35.357270 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1204 12:36:35.357308 17225 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I1204 12:36:35.357106 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I1204 12:36:35.357411 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:35.357465 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.357579 17225 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1204 12:36:35.357573 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I1204 12:36:35.357665 17225 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1204 12:36:35.357649 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I1204 12:36:35.357755 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:35.357793 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I1204 12:36:35.357908 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:35.357944 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.358055 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I1204 12:36:35.358084 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I1204 12:36:35.358271 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:35.358332 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.358429 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.358546 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:35.359601 17225 executor.go:111] Tasks: 74 done / 132 total; 36 can run W1204 12:36:35.359783 17225 api.go:53] PageSize not implemented I1204 12:36:35.359807 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:35.359803 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:35.359932 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:35.359916 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:35.359995 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:35.359938 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:35.360012 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1204 12:36:35.359973 17225 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I1204 12:36:35.360064 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1204 12:36:35.360090 17225 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I1204 12:36:35.360057 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:35.360137 17225 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I1204 12:36:35.360166 17225 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } W1204 12:36:35.360226 17225 api.go:53] PageSize not implemented I1204 12:36:35.360241 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:35.360239 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:35.360385 17225 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I1204 12:36:35.360456 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:35.360561 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:35.360721 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:35.360827 17225 executor.go:111] Tasks: 110 done / 132 total; 6 can run W1204 12:36:35.360875 17225 api.go:53] PageSize not implemented I1204 12:36:35.360904 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:35.360962 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:35.361048 17225 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I1204 12:36:35.361039 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:35.361108 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1204 12:36:35.361087 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W1204 12:36:35.361258 17225 api.go:53] PageSize not implemented I1204 12:36:35.361257 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I1204 12:36:35.361315 17225 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I1204 12:36:35.361313 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:35.361507 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:35.365097 17225 executor.go:111] Tasks: 116 done / 132 total; 8 can run I1204 12:36:35.365218 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:35.365325 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:35.365482 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:35.365523 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:35.365675 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I1204 12:36:35.366195 17225 executor.go:111] Tasks: 124 done / 132 total; 2 can run W1204 12:36:35.366280 17225 api.go:53] PageSize not implemented I1204 12:36:35.366296 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:35.366450 17225 executor.go:111] Tasks: 126 done / 132 total; 6 can run I1204 12:36:35.366662 17225 executor.go:111] Tasks: 132 done / 132 total; 0 can run I1204 12:36:35.369224 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:35.369275 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:35.369299 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:35.369321 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:35.369340 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:35.369360 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:35.369383 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:35.369413 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:35.369450 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I1204 12:36:35.369475 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I1204 12:36:35.369497 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:35.369519 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:35.369542 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:35.369564 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:35.369586 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I1204 12:36:35.369608 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:35.369629 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:35.369653 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I1204 12:36:35.369674 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I1204 12:36:35.369695 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:35.369724 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:35.369745 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I1204 12:36:35.369767 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:35.369787 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:35.369806 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:35.369829 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:35.369853 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:35.371004 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:35.371062 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:35.371077 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:35.371112 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.371184 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1204 12:36:35.371231 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.371278 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.371310 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.371341 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.371370 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.371399 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I1204 12:36:35.371439 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.371477 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:35.371499 17225 natgateway.go:117] DescribeNatGateways: { } I1204 12:36:35.371529 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I1204 12:36:35.371553 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W1204 12:36:35.371584 17225 api.go:53] PageSize not implemented I1204 12:36:35.371597 17225 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I1204 12:36:35.371624 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:35.371642 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:35.371654 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I1204 12:36:35.371681 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:35.371699 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:35.371714 17225 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" ] } I1204 12:36:35.371761 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:35.371792 17225 iamrole.go:89] ListRoles: { } I1204 12:36:35.371834 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:35.371857 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:35.371892 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:35.371929 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:35.371958 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I1204 12:36:35.371985 17225 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I1204 12:36:35.372010 17225 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } autoscaling-group:nodes.private-shared-ip.example.com ok I1204 12:36:35.372504 17225 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } load-balancer:api-private-shared-ip-exa-ohatqj ok autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok I1204 12:36:35.372547 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I1204 12:36:35.372557 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1204 12:36:35.372627 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1204 12:36:35.372615 17225 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } autoscaling-config:lt-2 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok I1204 12:36:35.372635 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1204 12:36:35.372722 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I1204 12:36:35.372704 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:35.372761 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } iam-instance-profile:bastions.private-shared-ip.example.com ok I1204 12:36:35.372751 17225 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok I1204 12:36:35.372787 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } autoscaling-group:bastion.private-shared-ip.example.com ok I1204 12:36:35.372830 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I1204 12:36:35.372668 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.private-shared-ip.example.com ok I1204 12:36:35.372781 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W1204 12:36:35.372953 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:35.372976 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I1204 12:36:35.373018 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I1204 12:36:35.373061 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I1204 12:36:35.373101 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } W1204 12:36:35.373232 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:35.373250 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I1204 12:36:35.373274 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W1204 12:36:35.373356 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:35.373371 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I1204 12:36:35.373398 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I1204 12:36:35.373440 17225 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok autoscaling-config:lt-3 ok autoscaling-config:lt-1 ok I1204 12:36:35.373566 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I1204 12:36:35.373575 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I1204 12:36:35.373626 17225 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I1204 12:36:35.373618 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I1204 12:36:35.373639 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I1204 12:36:35.373670 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:35.373711 17225 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I1204 12:36:35.373716 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } W1204 12:36:35.373802 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:35.373761 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } I1204 12:36:35.373812 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:35.373839 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I1204 12:36:35.373858 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I1204 12:36:35.373889 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I1204 12:36:35.373914 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I1204 12:36:35.373953 17225 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I1204 12:36:35.373970 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I1204 12:36:35.374004 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I1204 12:36:35.374079 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1204 12:36:35.374152 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (1.52s) === RUN TestLifecycleManyAddons I1204 12:36:35.374557 17225 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:36:35.374674 17225 internetgateways.go:66] CreateInternetGateway: { } I1204 12:36:35.374706 17225 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:36:35.374737 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:36:35.374765 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:36:35.374803 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:36:35.374837 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:36:35.374858 17225 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:36:35.374890 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:36:35.374913 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I1204 12:36:35.396053 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:35.398917 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:35.398990 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:35.984330 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:36.588785 17225 iamrole.go:89] ListRoles: { } I1204 12:36:36.589494 17225 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1204 12:36:36.589710 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:36.589888 17225 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.589951 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:36.589926 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I1204 12:36:36.590022 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1204 12:36:36.590127 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:36.590158 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:36.590260 17225 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I1204 12:36:36.590310 17225 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I1204 12:36:36.590379 17225 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I1204 12:36:36.590813 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:36.590916 17225 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1204 12:36:36.590893 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] }] } I1204 12:36:36.591001 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:36.591213 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I1204 12:36:36.591243 17225 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I1204 12:36:36.591257 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:36.591284 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:36.591307 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:36.591377 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:36.591402 17225 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I1204 12:36:36.591452 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:36.593527 17225 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1204 12:36:36.593661 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1204 12:36:36.593645 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:36.593776 17225 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1204 12:36:36.593792 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1204 12:36:36.593873 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:36.593902 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1204 12:36:36.593949 17225 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1204 12:36:36.593960 17225 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I1204 12:36:36.593999 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1204 12:36:36.594050 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1204 12:36:36.594145 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["minimal.example.com"] }] } I1204 12:36:36.594320 17225 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.594389 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:36.594427 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:36.594500 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I1204 12:36:36.594580 17225 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], VpcId: "vpc-1" } I1204 12:36:36.594595 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:36.594708 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:36.594763 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:36.594798 17225 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I1204 12:36:36.594843 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:36.594950 17225 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1204 12:36:36.595013 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:36.595073 17225 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I1204 12:36:36.595156 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:36.595191 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:36.595227 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:36.595261 17225 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I1204 12:36:36.595324 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:36.595273 17225 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1204 12:36:36.597993 17225 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1204 12:36:36.598071 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:36.598180 17225 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:36.598226 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:36.598348 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I1204 12:36:36.598386 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:36.598551 17225 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I1204 12:36:36.598621 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:36.598701 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:36.598783 17225 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I1204 12:36:36.598893 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.599068 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.599238 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.599343 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.599449 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.599550 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.599643 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.599735 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1204 12:36:36.599829 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1204 12:36:36.599954 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.600045 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1204 12:36:36.600143 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.600243 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:36.600316 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:36.600397 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" }] }] } I1204 12:36:36.600535 17225 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I1204 12:36:36.600634 17225 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I1204 12:36:36.600859 17225 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1204 12:36:36.601041 17225 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1204 12:36:36.601260 17225 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1204 12:36:36.601310 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:36.601346 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:36.601413 17225 dns.go:235] Pre-creating DNS records I1204 12:36:36.601440 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:36.606353 17225 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I1204 12:36:36.609360 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:36.609431 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:37.186950 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:37.810234 17225 iamrole.go:89] ListRoles: { } I1204 12:36:37.811364 17225 executor.go:111] Tasks: 0 done / 108 total; 51 can run I1204 12:36:37.811784 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.811928 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:36:37.811953 17225 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:36:37.812000 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:37.812226 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] }] } I1204 12:36:37.812446 17225 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I1204 12:36:37.812624 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.812776 17225 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I1204 12:36:37.813245 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.814921 17225 executor.go:111] Tasks: 51 done / 108 total; 23 can run I1204 12:36:37.815065 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I1204 12:36:37.815200 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:37.815228 17225 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I1204 12:36:37.815270 17225 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I1204 12:36:37.815246 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.815372 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.815483 17225 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:36:37.815516 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:37.815589 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.815682 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I1204 12:36:37.815790 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:37.815833 17225 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:36:37.817672 17225 executor.go:111] Tasks: 74 done / 108 total; 26 can run I1204 12:36:37.817777 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:37.817939 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:37.818022 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:37.818178 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:37.818311 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:37.818569 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:37.818678 17225 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I1204 12:36:37.819291 17225 executor.go:111] Tasks: 100 done / 108 total; 2 can run I1204 12:36:37.819453 17225 executor.go:111] Tasks: 102 done / 108 total; 6 can run I1204 12:36:37.819644 17225 executor.go:111] Tasks: 108 done / 108 total; 0 can run I1204 12:36:37.822066 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I1204 12:36:37.822134 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I1204 12:36:37.822164 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I1204 12:36:37.822184 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I1204 12:36:37.822204 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I1204 12:36:37.822230 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I1204 12:36:37.822248 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I1204 12:36:37.822275 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I1204 12:36:37.822298 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I1204 12:36:37.822323 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I1204 12:36:37.822346 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I1204 12:36:37.822366 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I1204 12:36:37.822384 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I1204 12:36:37.822405 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I1204 12:36:37.822423 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:36:37.822446 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I1204 12:36:37.822465 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:36:37.822486 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I1204 12:36:37.822506 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I1204 12:36:37.822526 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I1204 12:36:37.822544 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I1204 12:36:37.822565 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I1204 12:36:37.822588 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:36:37.822609 17225 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I1204 12:36:37.823906 17225 delete_cluster.go:128] Looking for cloud resources to delete W1204 12:36:37.823960 17225 instances.go:27] MockEc2::DescribeInstances is stub-implemented I1204 12:36:37.823975 17225 keypairs.go:95] DescribeKeyPairs: { } I1204 12:36:37.824007 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.824048 17225 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1204 12:36:37.824090 17225 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.824151 17225 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.824189 17225 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.824227 17225 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.824256 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.824283 17225 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I1204 12:36:37.824318 17225 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.824354 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I1204 12:36:37.824381 17225 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W1204 12:36:37.824412 17225 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W1204 12:36:37.824436 17225 api.go:53] PageSize not implemented I1204 12:36:37.824461 17225 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W1204 12:36:37.824481 17225 loadbalancers.go:35] PageSize not implemented I1204 12:36:37.824497 17225 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W1204 12:36:37.824517 17225 targetgroups.go:35] PageSize not implemented I1204 12:36:37.824534 17225 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I1204 12:36:37.824573 17225 iaminstanceprofile.go:193] ListInstanceProfiles: { } I1204 12:36:37.824607 17225 iamrole.go:89] ListRoles: { } I1204 12:36:37.824642 17225 zones.go:93] ListHostedZonesPages { } I1204 12:36:37.824664 17225 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I1204 12:36:37.824699 17225 internetgateways.go:101] DescribeInternetGateways: { } I1204 12:36:37.824731 17225 routetable.go:53] DescribeRouteTables: { } I1204 12:36:37.824757 17225 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I1204 12:36:37.825091 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok I1204 12:36:37.825152 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I1204 12:36:37.825191 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I1204 12:36:37.825219 17225 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-group:nodes.minimal.example.com ok I1204 12:36:37.825276 17225 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I1204 12:36:37.825199 17225 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I1204 12:36:37.825347 17225 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I1204 12:36:37.825302 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I1204 12:36:37.825474 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W1204 12:36:37.825654 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:37.825683 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I1204 12:36:37.825726 17225 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I1204 12:36:37.825797 17225 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W1204 12:36:37.825897 17225 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I1204 12:36:37.825917 17225 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok autoscaling-config:lt-1 ok I1204 12:36:37.825972 17225 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I1204 12:36:37.826051 17225 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I1204 12:36:37.826112 17225 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I1204 12:36:37.826227 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I1204 12:36:37.826274 17225 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I1204 12:36:37.826254 17225 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I1204 12:36:37.826295 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } subnet:subnet-1 ok I1204 12:36:37.826337 17225 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I1204 12:36:37.826390 17225 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I1204 12:36:37.826439 17225 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I1204 12:36:37.826457 17225 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I1204 12:36:37.826491 17225 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I1204 12:36:37.826565 17225 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I1204 12:36:37.826652 17225 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I1204 12:36:37.826742 17225 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (2.45s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 115.216s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.004s ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I1204 12:34:42.862896 17453 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.003s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.003s === RUN TestPodController I1204 12:34:42.876605 17455 pod.go:59] starting pod controller I1204 12:34:42.876756 17455 stoppable.go:62] shutting down controller --- PASS: TestPodController (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/watchers 0.019s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.003s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000375f0} route53_test.go:93: Got zone list: [0xc000037610] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c29b8} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000376d0} route53_test.go:93: Got zone list: [0xc0000376f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c29c8} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc0000377a0} route53_test.go:170: Successfully added managed DNS zone: &{0xc00040a210 0xc0000c29e0} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000378d0} route53_test.go:93: Got zone list: [0xc0000378f0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c29f8} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000379c0} route53_test.go:93: Got zone list: [0xc0000379e0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c2a18} route53_test.go:187: Successfully added resource record set: {0xc0003e7d40 0xc0000c2a38} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037c30} route53_test.go:93: Got zone list: [0xc000037c50] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c2ac0} route53_test.go:199: Successfully added resource record set: {0xc0003e7ef0 0xc0000c2ae0} route53_test.go:118: Got 1 recordsets: [0xc000037db0] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000037ed0} route53_test.go:93: Got zone list: [0xc000037ef0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c2b78} route53_test.go:221: Successfully added resource record set: {0xc000412120 0xc0000c2b98} route53_test.go:228: Correctly failed to add duplicate resource record {0xc000412120 0xc0000c2b98}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041e280} route53_test.go:93: Got zone list: [0xc00041e2a0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c2c50} route53_test.go:246: Successfully removed resource set {0xc000412360 0xc0000c2c70} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041e4f0} route53_test.go:93: Got zone list: [0xc00041e510] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c2cf8} route53_test.go:264: Successfully removed resource set {0xc000412510 0xc0000c2d18} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041e770} route53_test.go:93: Got zone list: [0xc00041e790] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c2da8} commontests.go:192: Successfully added resource record set: {0xc0004126c0 0xc0000c2dc8} commontests.go:45: Correctly replaced resource record {0xc0004126c0 0xc0000c2dc8} -> {0xc0004127e0 0xc0000c2e18} commontests.go:142: Got 1 recordsets: [0xc00041ea40] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041ec00} route53_test.go:93: Got zone list: [0xc00041ec20] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c2ec8} commontests.go:192: Successfully added resource record set: {0xc000412ab0 0xc0000c2ee8} commontests.go:70: Correctly replaced resource record {0xc000412ab0 0xc0000c2ee8} -> {0xc000412bd0 0xc0000c2f38} commontests.go:142: Got 1 recordsets: [0xc00041eed0] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041f0c0} route53_test.go:93: Got zone list: [0xc00041f0e0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c2ff8} commontests.go:192: Successfully added resource record set: {0xc000412ea0 0xc0000c3018} commontests.go:142: Got 2 recordsets: [0xc00041f310 0xc00041f330] commontests.go:142: Got 2 recordsets: [0xc00041f380 0xc00041f3a0] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc00041f530} route53_test.go:93: Got zone list: [0xc00041f550] route53_test.go:98: Got at least 1 zone in list:&{0xc0003e1da0 0xc0000c3118} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.009s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.004s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc000196320} clouddns_test.go:71: Got zone list: [0xc0002be2b8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002be288} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc000196360} clouddns_test.go:71: Got zone list: [0xc0002be3d8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002be3a8} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc0001963a0} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc000443180 0xc0002be510} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc000196400} clouddns_test.go:71: Got zone list: [0xc0002be618] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002be5e8} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc000196440} clouddns_test.go:71: Got zone list: [0xc0002be7c8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002be798} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc0001964a0} clouddns_test.go:71: Got zone list: [0xc0002be9a8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002be978} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc000196500} clouddns_test.go:71: Got zone list: [0xc0002bec48] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002bec18} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc000196580} clouddns_test.go:71: Got zone list: [0xc0002bee70] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002bee40} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc0001965e0} clouddns_test.go:71: Got zone list: [0xc0002bf050] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002bf020} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc000196640} clouddns_test.go:71: Got zone list: [0xc0002bf2a8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002bf278} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc000196680} clouddns_test.go:71: Got zone list: [0xc0002bf620] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002bf5f0} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc0001966c0} clouddns_test.go:71: Got zone list: [0xc0002bfa10] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002bf9e0} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc000294030 0xc000196780} clouddns_test.go:71: Got zone list: [0xc0002bfe90] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000442fc0 0xc0002bfe60} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.034s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.016s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.004s ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.054s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I1204 12:34:47.860364 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.860532 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.860586 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.860622 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.860654 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.860701 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.860734 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.860751 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.860785 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.860814 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.868721 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I1204 12:34:47.871700 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.871799 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.871823 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.871849 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.871874 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.871893 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.871908 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.871917 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.871930 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.871940 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.872567 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I1204 12:34:47.874644 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.874694 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.874717 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.874734 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.874745 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.874771 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.874786 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.874795 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.874807 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.874817 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.875410 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:47.877392 18011 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I1204 12:34:47.877463 18011 assetstore.go:111] bin/containerd I1204 12:34:47.877487 18011 assetstore.go:111] bin/containerd-shim I1204 12:34:47.877495 18011 assetstore.go:111] bin/containerd-shim-runc-v1 I1204 12:34:47.877503 18011 assetstore.go:111] bin/containerd-shim-runc-v2 I1204 12:34:47.877511 18011 assetstore.go:111] bin/containerd-stress I1204 12:34:47.877518 18011 assetstore.go:111] bin/ctr I1204 12:34:47.877611 18011 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I1204 12:34:47.877636 18011 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.01s) === RUN TestContainerdBuilder_Flatcar I1204 12:34:47.880477 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.880546 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.880566 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.880590 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.880604 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.880623 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.880641 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.880649 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.880662 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.880673 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.881386 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:47.882321 18011 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I1204 12:34:47.882833 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.882897 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.882914 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.882931 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.882960 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.882980 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.882995 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.883009 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.883025 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.883037 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.883850 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:47.885130 18011 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I1204 12:34:47.885542 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.885598 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.885613 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.885630 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.885644 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.885669 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.885684 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.885692 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.885704 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.885714 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.886278 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:47.887306 18011 assetstore.go:108] Matching assets for "^docker/": I1204 12:34:47.887322 18011 assetstore.go:111] docker/containerd I1204 12:34:47.887326 18011 assetstore.go:111] docker/containerd-shim I1204 12:34:47.887329 18011 assetstore.go:111] docker/ctr I1204 12:34:47.887332 18011 assetstore.go:111] docker/docker I1204 12:34:47.887334 18011 assetstore.go:111] docker/docker-init I1204 12:34:47.887337 18011 assetstore.go:111] docker/docker-proxy I1204 12:34:47.887339 18011 assetstore.go:111] docker/dockerd I1204 12:34:47.887342 18011 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.00s) === RUN TestDockerBuilder_LogFlags I1204 12:34:47.889799 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.889882 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.889908 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.889935 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.889956 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.889984 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.890009 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.890023 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.890042 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.890057 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.890904 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:47.892058 18011 assetstore.go:108] Matching assets for "^docker/": I1204 12:34:47.892079 18011 assetstore.go:111] docker/containerd I1204 12:34:47.892085 18011 assetstore.go:111] docker/containerd-shim I1204 12:34:47.892089 18011 assetstore.go:111] docker/ctr I1204 12:34:47.892092 18011 assetstore.go:111] docker/docker I1204 12:34:47.892095 18011 assetstore.go:111] docker/docker-init I1204 12:34:47.892099 18011 assetstore.go:111] docker/docker-proxy I1204 12:34:47.892103 18011 assetstore.go:111] docker/dockerd I1204 12:34:47.892106 18011 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.00s) === RUN TestDockerBuilder_SkipInstall I1204 12:34:47.893777 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.893846 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.893863 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.893880 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.893893 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.893910 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.893925 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.893933 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.893945 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.893957 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.894541 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:47.895494 18011 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I1204 12:34:47.895586 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.895641 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.895660 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.895680 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.895698 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.895723 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.895739 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.895748 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.895759 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.895767 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.896408 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:47.897357 18011 assetstore.go:108] Matching assets for "^docker/": I1204 12:34:47.897370 18011 assetstore.go:111] docker/docker I1204 12:34:47.897377 18011 assetstore.go:111] docker/docker-containerd I1204 12:34:47.897383 18011 assetstore.go:111] docker/docker-containerd-ctr I1204 12:34:47.897395 18011 assetstore.go:111] docker/docker-containerd-shim I1204 12:34:47.897401 18011 assetstore.go:111] docker/docker-init I1204 12:34:47.897407 18011 assetstore.go:111] docker/docker-proxy I1204 12:34:47.897413 18011 assetstore.go:111] docker/docker-runc I1204 12:34:47.897418 18011 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.00s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I1204 12:34:47.900054 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.900121 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.900141 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.900160 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.900172 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.900188 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.900204 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.900211 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.900225 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.900235 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.901648 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.00s) === RUN TestDockerHooksBuilder I1204 12:34:47.902977 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.903032 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.903047 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.903065 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.903077 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.903096 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.903111 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.903131 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.903146 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.903156 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.904163 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.00s) === RUN TestKopsControllerBuilder I1204 12:34:47.907027 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.907136 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.907154 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.907173 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.907184 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.907200 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.907215 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.907223 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.907235 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.907246 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.908165 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.00s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I1204 12:34:47.911371 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.911425 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.911439 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.911455 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.911467 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.911483 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.911496 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.911505 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.911516 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.911525 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.912493 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I1204 12:34:47.917650 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.917708 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.917724 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.917743 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.917755 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.917773 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.917789 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.917797 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.917809 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.917820 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.919134 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I1204 12:34:47.923077 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.923144 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.923161 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.923178 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.923190 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.923209 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.923223 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.923231 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.923244 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.923253 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.924255 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I1204 12:34:47.931585 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.931670 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.931698 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.931729 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.931750 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.931779 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.931800 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.931815 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.931837 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.931853 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.932961 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I1204 12:34:47.937024 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.937083 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.937101 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.937135 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.937153 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.937177 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.937195 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.937212 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.937234 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.937249 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.938109 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.00s) === RUN TestAwsIamAuthenticator I1204 12:34:47.941773 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.941829 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.941846 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.941862 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.941875 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.941892 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.941906 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.941915 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.941927 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.941937 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.942919 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I1204 12:34:47.950792 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:47.950858 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:47.950877 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:47.950903 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:47.950916 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:47.950936 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:47.950954 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:47.950963 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:47.950975 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:47.950985 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:47.952061 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.60s) === RUN TestKubeAPIServerBuilderARM64 I1204 12:34:49.554922 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:49.555019 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:49.555046 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:49.555076 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:49.555104 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:49.555145 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:49.555172 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:49.555185 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:49.555204 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:49.555219 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:49.556882 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.18s) === RUN TestKubeControllerManagerBuilder I1204 12:34:50.731133 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:50.731226 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:50.731250 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:50.731279 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:50.731297 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:50.731320 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:50.731342 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:50.731354 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:50.731373 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:50.731386 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:50.732774 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I1204 12:34:50.737748 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:50.737824 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:50.737844 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:50.737865 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:50.737882 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:50.737906 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:50.737926 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:50.737936 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:50.737953 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:50.737965 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:50.739314 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.18s) === RUN TestKubeControllerManagerBuilderARM64 I1204 12:34:51.918039 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:51.918144 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:51.918171 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:51.918211 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:51.918232 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:51.918261 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:51.918288 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:51.918303 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:51.918324 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:51.918340 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:51.919740 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.19s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.01s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.01s) === RUN TestKubeProxyBuilder I1204 12:34:53.111434 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:53.111563 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:53.111592 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:53.111627 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:53.111647 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:53.111673 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:53.111699 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:53.111711 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:53.111731 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:53.111749 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:53.113562 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I1204 12:34:53.117357 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:53.117486 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:53.117536 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:53.117587 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:53.117611 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:53.117644 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:53.117666 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:53.117680 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:53.117700 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:53.117715 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:53.119066 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.18s) === RUN TestKubeProxyBuilderARM64 I1204 12:34:54.294862 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:54.294978 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:54.295009 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:54.295047 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:54.295075 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:54.295110 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:54.295164 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:54.295182 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:54.295208 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:54.295227 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:54.297384 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.18s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I1204 12:34:55.472732 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:55.472825 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:55.472851 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:55.472879 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:55.472900 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:55.472926 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:55.472949 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:55.472962 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:55.472984 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:55.472998 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:55.474696 18011 zones.go:93] ListHostedZonesPages { } W1204 12:34:55.477071 18011 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I1204 12:34:55.478601 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:55.478665 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:55.478684 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:55.478702 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:55.478719 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:55.478739 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:55.478758 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:55.478770 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:55.478787 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:55.478799 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:55.480182 18011 zones.go:93] ListHostedZonesPages { } W1204 12:34:56.656529 18011 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.18s) === RUN TestKubeSchedulerBuilderARM64 I1204 12:34:56.658777 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:56.658890 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:56.658922 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:56.658963 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:56.658996 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:56.659029 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:56.659063 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:56.659082 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:56.659110 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:56.659150 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:56.661288 18011 zones.go:93] ListHostedZonesPages { } W1204 12:34:57.826533 18011 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.17s) === RUN TestKubectlBuilder I1204 12:34:57.828800 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:57.828915 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:57.828947 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:57.828979 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:57.829006 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:57.829041 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:57.829072 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:57.829092 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:57.829135 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:57.829157 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:57.831218 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:57.833744 18011 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I1204 12:34:57.836617 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:57.836706 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:57.836755 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:57.836782 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:57.836806 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:57.836835 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:57.836861 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:57.836881 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:57.836905 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:57.836929 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:57.838564 18011 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I1204 12:34:57.843236 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:57.843307 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:57.843349 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:57.843374 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:57.843418 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:57.843449 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:57.843472 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:57.843489 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:57.843509 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:57.843524 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:57.845216 18011 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I1204 12:34:57.852410 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:57.852512 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:57.852538 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:57.852572 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:57.852598 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:57.852626 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:57.852650 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:57.852668 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:57.852690 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:57.852706 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:57.854715 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:57.857021 18011 assetstore.go:108] Matching assets for "protokube$": I1204 12:34:57.857047 18011 assetstore.go:111] /opt/kops/bin/protokube I1204 12:34:57.857059 18011 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I1204 12:34:57.857083 18011 assetstore.go:108] Matching assets for "channels$": I1204 12:34:57.857094 18011 assetstore.go:111] /opt/kops/bin/channels I1204 12:34:57.857107 18011 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I1204 12:34:57.858697 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:57.858783 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:57.858808 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:57.858834 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:57.858860 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:57.858917 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:57.858944 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:57.858961 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:57.858987 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:57.859003 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:57.860939 18011 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I1204 12:34:57.863883 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:57.863968 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:57.863993 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:57.864019 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:57.864043 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:57.864071 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:57.864094 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:57.864126 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:57.864155 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:57.864173 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:57.866196 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:57.868448 18011 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.00s) === RUN TestUpdateServiceBuilderExternal I1204 12:34:57.868945 18011 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:34:57.869031 18011 internetgateways.go:66] CreateInternetGateway: { } I1204 12:34:57.869055 18011 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:34:57.869081 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:34:57.869105 18011 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:34:57.869152 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:34:57.869176 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:34:57.869193 18011 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:34:57.869215 18011 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:34:57.869231 18011 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:34:57.871231 18011 zones.go:93] ListHostedZonesPages { } I1204 12:34:57.873491 18011 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 10.080s ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.031s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.023s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.022s ? k8s.io/kops/pkg/apis/kops/registry [no test files] === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E1204 12:34:47.813238 18015 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E1204 12:34:47.813301 18015 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.009s ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I1204 12:34:47.856155 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856209 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856225 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856236 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856247 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I1204 12:34:47.856342 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856357 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856366 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856375 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856391 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856407 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856423 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856431 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856441 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856453 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856463 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856491 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856501 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856509 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856517 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856532 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856540 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856548 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I1204 12:34:47.856555 18016 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I1204 12:34:47.856635 18016 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I1204 12:34:47.856667 18016 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.061s ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.014s ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W1204 12:34:47.841473 18019 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W1204 12:34:47.842179 18019 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W1204 12:34:47.842761 18019 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W1204 12:34:47.843328 18019 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W1204 12:34:47.843858 18019 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W1204 12:34:47.844476 18019 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host W1204 12:34:47.845059 18019 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.32.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E1204 12:34:47.845521 18019 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E1204 12:34:47.845528 18019 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E1204 12:34:47.845533 18019 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E1204 12:34:47.845537 18019 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.042s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.004s ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.062s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.024s ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.098s ? k8s.io/kops/pkg/commands/commandutils [no test files] === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.079s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.023s ? k8s.io/kops/pkg/configserver [no test files] === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.003s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.003s ? k8s.io/kops/pkg/dump [no test files] === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.01s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.032s === RUN TestFlagToFalse I1204 12:34:48.012180 18622 featureflag_test.go:32] Created flag Unittest1 I1204 12:34:48.012214 18622 featureflag.go:164] FeatureFlag "UnitTest1"=false I1204 12:34:48.012219 18622 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I1204 12:34:48.012258 18622 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.003s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.025s === RUN TestRenderInstanceGroupZones W1204 12:34:48.029852 18625 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.023s === RUN TestWarmPoolOnlyRoll I1204 12:35:00.407819 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.407910 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.407926 19909 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I1204 12:35:00.408310 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.408330 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.409440 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.409459 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.414657 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.414688 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.414697 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.414702 19909 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1204 12:35:00.415621 19909 instancegroups.go:431] Draining the node: "master-1a.local". I1204 12:35:00.415898 19909 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1204 12:35:00.415965 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:00.415979 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.417085 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.417106 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.422292 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.422337 19909 instancegroups.go:431] Draining the node: "master-1b.local". I1204 12:35:00.422728 19909 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1204 12:35:00.422774 19909 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1204 12:35:00.422796 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.423893 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.423910 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.429098 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.429159 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.429175 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.429183 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.429775 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.430219 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.430239 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.431349 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.431369 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.436798 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.436855 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:00.437486 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.437512 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.438632 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.438651 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.443845 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.443896 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:00.444528 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:00.444552 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.445670 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.445694 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.450887 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.450909 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.450917 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.450922 19909 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1204 12:35:00.451339 19909 instancegroups.go:431] Draining the node: "node-2a.local". I1204 12:35:00.451608 19909 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1204 12:35:00.451623 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.452744 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.452767 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.457941 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.457999 19909 instancegroups.go:431] Draining the node: "node-2b.local". I1204 12:35:00.458633 19909 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1204 12:35:00.458664 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.459794 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.459819 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.465038 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.465084 19909 instancegroups.go:431] Draining the node: "node-2c.local". I1204 12:35:00.465617 19909 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1204 12:35:00.465639 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.466746 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.466766 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.471986 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.472023 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.06s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I1204 12:35:00.472289 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.472302 19909 instancegroups.go:469] waiting for 1ms after terminating instance W1204 12:35:00.473427 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.473460 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.473479 19909 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1204 12:35:00.473492 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:00.473506 19909 instancegroups.go:469] waiting for 1ms after terminating instance W1204 12:35:00.474618 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.474640 19909 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1204 12:35:00.474645 19909 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1204 12:35:00.474654 19909 instancegroups.go:469] waiting for 1ms after terminating instance W1204 12:35:00.476062 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.476086 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.476125 19909 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1204 12:35:00.476136 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.476152 19909 instancegroups.go:469] waiting for 1ms after terminating instance W1204 12:35:00.477249 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.477280 19909 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1204 12:35:00.477289 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.477304 19909 instancegroups.go:469] waiting for 1ms after terminating instance W1204 12:35:00.478402 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.478426 19909 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1204 12:35:00.478435 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:00.478448 19909 instancegroups.go:469] waiting for 1ms after terminating instance W1204 12:35:00.479543 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.479555 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.479580 19909 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1204 12:35:00.479589 19909 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1204 12:35:00.479602 19909 instancegroups.go:469] waiting for 1ms after terminating instance W1204 12:35:00.480706 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.480725 19909 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1204 12:35:00.480730 19909 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1204 12:35:00.480740 19909 instancegroups.go:469] waiting for 1ms after terminating instance W1204 12:35:00.481835 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W1204 12:35:00.481861 19909 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I1204 12:35:00.481887 19909 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1204 12:35:00.481903 19909 instancegroups.go:469] waiting for 1ms after terminating instance W1204 12:35:00.482995 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1204 12:35:00.483010 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I1204 12:35:00.483231 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.483241 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.484336 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.484356 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.484369 19909 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.484400 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.484411 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.484422 19909 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.484428 19909 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1204 12:35:00.484965 19909 instancegroups.go:431] Draining the node: "master-1a.local". I1204 12:35:00.485462 19909 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1204 12:35:00.485524 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:00.485543 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.486639 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.486665 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.486677 19909 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.486696 19909 instancegroups.go:431] Draining the node: "master-1b.local". I1204 12:35:00.487150 19909 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1204 12:35:00.487194 19909 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1204 12:35:00.487213 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.488307 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.488331 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.488344 19909 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.488357 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.488367 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.488374 19909 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.488381 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.488983 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.489475 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.489497 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.490594 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.490621 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.490635 19909 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.490665 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:00.491212 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.491239 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.492406 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.492429 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.492441 19909 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.492461 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:00.492972 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:00.492989 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.494077 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.494096 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.494108 19909 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.494123 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.494134 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.494142 19909 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.494149 19909 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1204 12:35:00.494728 19909 instancegroups.go:431] Draining the node: "node-2a.local". I1204 12:35:00.495220 19909 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1204 12:35:00.495246 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.496354 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.496375 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.496387 19909 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.496410 19909 instancegroups.go:431] Draining the node: "node-2b.local". I1204 12:35:00.496850 19909 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1204 12:35:00.496866 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.497971 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.497993 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.498005 19909 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.498026 19909 instancegroups.go:431] Draining the node: "node-2c.local". I1204 12:35:00.498550 19909 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1204 12:35:00.498569 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.499676 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.499696 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W1204 12:35:00.499709 19909 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I1204 12:35:00.499728 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I1204 12:35:00.499939 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I1204 12:35:00.500059 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.500069 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.501147 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.501161 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.506346 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.506426 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.506446 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.506456 19909 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1204 12:35:00.506850 19909 instancegroups.go:431] Draining the node: "master-1a.local". I1204 12:35:00.507175 19909 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1204 12:35:00.507217 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:00.507236 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.508285 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.508320 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.513498 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.513543 19909 instancegroups.go:431] Draining the node: "master-1b.local". I1204 12:35:00.514175 19909 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1204 12:35:00.514228 19909 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1204 12:35:00.514251 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.515359 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.515382 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.520590 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.521284 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.521313 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.521324 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.521907 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.522342 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.522363 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.523475 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.523494 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.528674 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.528715 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:00.529183 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.529204 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.530308 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.530323 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.535504 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.535556 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:00.536107 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:00.536138 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.537519 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.537538 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.542686 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.542719 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.542731 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.542739 19909 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1204 12:35:00.543184 19909 instancegroups.go:431] Draining the node: "node-2a.local". I1204 12:35:00.543476 19909 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1204 12:35:00.543491 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.544578 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.544591 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.550088 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.550150 19909 instancegroups.go:431] Draining the node: "node-2b.local". I1204 12:35:00.550644 19909 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1204 12:35:00.550670 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.551780 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.551795 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.556979 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.557031 19909 instancegroups.go:431] Draining the node: "node-2c.local". I1204 12:35:00.557577 19909 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1204 12:35:00.557598 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.558696 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.558723 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.563916 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.563944 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.06s) === RUN TestRollingUpdateEmptyGroup I1204 12:35:00.564046 19909 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I1204 12:35:00.564291 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.564309 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.565379 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.565393 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1204 12:35:00.565400 19909 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I1204 12:35:00.565511 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.565520 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.566617 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.566629 19909 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1204 12:35:00.566637 19909 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I1204 12:35:00.566712 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.566721 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1204 12:35:00.566726 19909 instancegroups.go:509] Cluster did not validate within 0s E1204 12:35:00.566732 19909 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I1204 12:35:00.566796 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.566810 19909 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1204 12:35:00.566819 19909 instancegroups.go:509] Cluster did not validate within 0s E1204 12:35:00.566828 19909 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I1204 12:35:00.566966 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.566978 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.568078 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.568100 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.573345 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.573413 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.573428 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.573436 19909 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1204 12:35:00.573942 19909 instancegroups.go:431] Draining the node: "master-1a.local". I1204 12:35:00.574375 19909 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1204 12:35:00.574423 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:00.574441 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.576229 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.576254 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1204 12:35:00.576274 19909 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I1204 12:35:00.576471 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.576482 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.577566 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.577580 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.582782 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.582824 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.582833 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.582853 19909 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1204 12:35:00.583237 19909 instancegroups.go:431] Draining the node: "master-1a.local". I1204 12:35:00.583511 19909 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1204 12:35:00.583565 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:00.583578 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.584687 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.584711 19909 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1204 12:35:00.584727 19909 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I1204 12:35:00.584983 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.584998 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.585005 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.585657 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.587499 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.587518 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.588617 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.588637 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.593861 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.593909 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:00.594311 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.594327 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.595416 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.595431 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.600641 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.600703 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:00.601319 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:00.601346 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.602490 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.602512 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.607702 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.607738 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I1204 12:35:00.607959 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.607975 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1204 12:35:00.607987 19909 instancegroups.go:509] Cluster did not validate within 0s E1204 12:35:00.607997 19909 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I1204 12:35:00.608163 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.608177 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1204 12:35:00.608185 19909 instancegroups.go:509] Cluster did not validate within 0s E1204 12:35:00.608194 19909 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I1204 12:35:00.608316 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.608329 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1204 12:35:00.608336 19909 instancegroups.go:509] Cluster did not validate within 0s E1204 12:35:00.608345 19909 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I1204 12:35:00.608482 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.608494 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.608501 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.609083 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.609485 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.609503 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.610637 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.610651 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.616346 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.616396 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:00.616963 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.616984 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.618086 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.618101 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.623224 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.623256 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:00.623634 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:00.623650 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.624778 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.624794 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.629968 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.629986 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.629999 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1204 12:35:00.630008 19909 instancegroups.go:509] Cluster did not validate within 0s E1204 12:35:00.630017 19909 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I1204 12:35:00.630183 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.630193 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.630197 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.630579 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.630849 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.630862 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.631946 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.631962 19909 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E1204 12:35:00.631969 19909 instancegroups.go:509] Cluster did not validate within 0s E1204 12:35:00.631976 19909 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I1204 12:35:00.632075 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.632084 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.632088 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.632462 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.632764 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.632777 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.633917 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.633938 19909 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E1204 12:35:00.633946 19909 instancegroups.go:509] Cluster did not validate within 0s E1204 12:35:00.633953 19909 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I1204 12:35:00.634075 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.634085 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.635162 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.635179 19909 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1204 12:35:00.636260 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.641435 19909 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1204 12:35:00.642555 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.647782 19909 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1204 12:35:00.648904 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.654072 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.654130 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.654145 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.654157 19909 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1204 12:35:00.654498 19909 instancegroups.go:431] Draining the node: "master-1a.local". I1204 12:35:00.654786 19909 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1204 12:35:00.654834 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:00.654853 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.655991 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.656005 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.661173 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.661215 19909 instancegroups.go:431] Draining the node: "master-1b.local". I1204 12:35:00.661572 19909 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1204 12:35:00.661611 19909 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1204 12:35:00.661629 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.662753 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.662774 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.667981 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.668019 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.668033 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.668040 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.668509 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.668776 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.668790 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.669907 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.669926 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.675153 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.675181 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:00.675523 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.675537 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.676668 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.676701 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.681987 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.682038 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:00.682594 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:00.682617 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.683740 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.683759 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.688958 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.688970 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.688978 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.688983 19909 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1204 12:35:00.689320 19909 instancegroups.go:431] Draining the node: "node-2a.local". I1204 12:35:00.689554 19909 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1204 12:35:00.689566 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.690699 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.690737 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.695949 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.695968 19909 instancegroups.go:431] Draining the node: "node-2b.local". I1204 12:35:00.696265 19909 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1204 12:35:00.696278 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.697436 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.697475 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.702681 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.702701 19909 instancegroups.go:431] Draining the node: "node-2c.local". I1204 12:35:00.703190 19909 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1204 12:35:00.703219 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.704378 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.704409 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.709663 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.709686 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.08s) === RUN TestRollingUpdateValidatesAfterBastion I1204 12:35:00.709849 19909 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I1204 12:35:00.709861 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.710976 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.710992 19909 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1204 12:35:00.712098 19909 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1204 12:35:00.713165 19909 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I1204 12:35:00.714261 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.719440 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.719474 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.719485 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.719491 19909 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1204 12:35:00.719884 19909 instancegroups.go:431] Draining the node: "master-1a.local". I1204 12:35:00.720244 19909 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1204 12:35:00.720283 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:00.720297 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.721433 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.721448 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.726551 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.726571 19909 instancegroups.go:431] Draining the node: "master-1b.local". I1204 12:35:00.726859 19909 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1204 12:35:00.726881 19909 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1204 12:35:00.726891 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.727994 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.728010 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.733143 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.733162 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.733170 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.733176 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.733669 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.734052 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.734069 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.735142 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.735160 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.740334 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.740367 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:00.740841 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.740860 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.741964 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.741984 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.747150 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.747192 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:00.747790 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:00.747811 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.748910 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.748929 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.754129 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.754146 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.754152 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.754156 19909 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1204 12:35:00.754485 19909 instancegroups.go:431] Draining the node: "node-2a.local". I1204 12:35:00.754739 19909 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I1204 12:35:00.754753 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.755849 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.755863 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.761013 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.761039 19909 instancegroups.go:431] Draining the node: "node-2b.local". I1204 12:35:00.761391 19909 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I1204 12:35:00.761405 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.762496 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.762509 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.767664 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.767691 19909 instancegroups.go:431] Draining the node: "node-2c.local". I1204 12:35:00.768192 19909 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I1204 12:35:00.768212 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.769319 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.769340 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.774494 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.774515 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.06s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I1204 12:35:00.774865 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.774877 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.774883 19909 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1204 12:35:00.775271 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.775647 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.775664 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.776751 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.776763 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.781947 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.782003 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:00.782710 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.782737 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.783836 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.783853 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.789037 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.789069 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I1204 12:35:00.789263 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.789276 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.789282 19909 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1204 12:35:00.789688 19909 instancegroups.go:431] Draining the node: "master-1a.local". I1204 12:35:00.790048 19909 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1204 12:35:00.790090 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:00.790104 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.791214 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.791230 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.796669 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.796731 19909 instancegroups.go:431] Draining the node: "master-1b.local". I1204 12:35:00.797327 19909 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1204 12:35:00.797382 19909 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1204 12:35:00.797401 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.798507 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.798526 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.803697 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.803723 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I1204 12:35:00.803995 19909 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W1204 12:35:00.804019 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1204 12:35:00.804029 19909 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W1204 12:35:00.804036 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1204 12:35:00.804043 19909 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W1204 12:35:00.804048 19909 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I1204 12:35:00.804055 19909 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1204 12:35:00.804064 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I1204 12:35:00.804206 19909 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I1204 12:35:00.804240 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:00.805340 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.805356 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.810512 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.810529 19909 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I1204 12:35:00.810555 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.810565 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.810572 19909 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I1204 12:35:00.811066 19909 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I1204 12:35:00.811078 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.811087 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.811093 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:00.811507 19909 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1204 12:35:00.811540 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:00.812903 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.812917 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.818074 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.818090 19909 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I1204 12:35:00.818098 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.818105 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.818111 19909 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I1204 12:35:00.818601 19909 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I1204 12:35:00.818630 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:00.819723 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.819736 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:00.824894 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.824911 19909 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I1204 12:35:00.824924 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I1204 12:35:00.825142 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.825159 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.825165 19909 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1204 12:35:00.826261 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:00.826689 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:00.826711 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.827813 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.827832 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.827853 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:00.827889 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:00.828778 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:00.828982 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:00.829024 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.830155 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.830216 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.930576 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.930636 19909 instancegroups.go:431] Draining the node: "node-1d.local". I1204 12:35:00.930635 19909 instancegroups.go:431] Draining the node: "node-1e.local". I1204 12:35:00.931289 19909 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1204 12:35:00.931406 19909 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1204 12:35:00.931434 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.932538 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.932561 19909 instancegroups.go:540] Cluster validated. I1204 12:35:00.932576 19909 instancegroups.go:431] Draining the node: "node-1f.local". I1204 12:35:00.932992 19909 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1204 12:35:00.933011 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:00.934149 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:00.934189 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.034541 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.034599 19909 instancegroups.go:431] Draining the node: "node-1g.local". I1204 12:35:01.035219 19909 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1204 12:35:01.035249 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.036425 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.036462 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.036484 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I1204 12:35:01.036728 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.036752 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.036762 19909 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1204 12:35:01.038143 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:01.038211 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:01.039051 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:01.039311 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:01.039362 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.040520 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.040586 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.141055 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.141162 19909 instancegroups.go:431] Draining the node: "node-1d.local". I1204 12:35:01.141167 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:01.142251 19909 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1204 12:35:01.142440 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:01.142475 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.143600 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.143630 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.143660 19909 instancegroups.go:431] Draining the node: "node-1e.local". I1204 12:35:01.144259 19909 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1204 12:35:01.144285 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.145423 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.145466 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.245865 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.245932 19909 instancegroups.go:431] Draining the node: "node-1f.local". I1204 12:35:01.246716 19909 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1204 12:35:01.246768 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.247988 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.248026 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.248047 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I1204 12:35:01.248270 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.248293 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.248303 19909 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I1204 12:35:01.249814 19909 instancegroups.go:431] Draining the node: "master-1a.local". I1204 12:35:01.250326 19909 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I1204 12:35:01.250371 19909 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I1204 12:35:01.250398 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.251525 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.251558 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.251587 19909 instancegroups.go:431] Draining the node: "master-1c.local". I1204 12:35:01.251653 19909 instancegroups.go:431] Draining the node: "master-1b.local". I1204 12:35:01.252600 19909 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I1204 12:35:01.252661 19909 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I1204 12:35:01.252935 19909 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I1204 12:35:01.252998 19909 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I1204 12:35:01.253041 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.254198 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.254249 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.354658 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.354719 19909 instancegroups.go:431] Draining the node: "master-1e.local". I1204 12:35:01.354738 19909 instancegroups.go:431] Draining the node: "master-1d.local". I1204 12:35:01.355676 19909 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I1204 12:35:01.355761 19909 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I1204 12:35:01.355849 19909 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I1204 12:35:01.355882 19909 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I1204 12:35:01.355907 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.357044 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.357081 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.357110 19909 instancegroups.go:431] Draining the node: "master-1f.local". I1204 12:35:01.357704 19909 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I1204 12:35:01.357748 19909 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I1204 12:35:01.357775 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.358880 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.358907 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.459255 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.459313 19909 instancegroups.go:431] Draining the node: "master-1g.local". I1204 12:35:01.459879 19909 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I1204 12:35:01.459931 19909 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I1204 12:35:01.459959 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.461066 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.461090 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.461105 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I1204 12:35:01.461335 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.461357 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.461364 19909 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1204 12:35:01.462354 19909 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1204 12:35:01.462390 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:01.463490 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.463514 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.463521 19909 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1204 12:35:01.463547 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:01.464649 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.464675 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.464731 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:01.465262 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:01.465381 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:01.465782 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:01.465811 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.466917 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.466952 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.567287 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.567366 19909 instancegroups.go:431] Draining the node: "node-1d.local". I1204 12:35:01.567379 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:01.567982 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:01.568401 19909 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1204 12:35:01.568430 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.569571 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.569597 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.569616 19909 instancegroups.go:431] Draining the node: "node-1e.local". I1204 12:35:01.570021 19909 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1204 12:35:01.570046 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.571197 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.571232 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.671617 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.671681 19909 instancegroups.go:431] Draining the node: "node-1f.local". I1204 12:35:01.672366 19909 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1204 12:35:01.672404 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.673545 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.673571 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.673583 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I1204 12:35:01.673795 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.673816 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.673825 19909 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I1204 12:35:01.677206 19909 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I1204 12:35:01.677239 19909 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I1204 12:35:01.677255 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:01.678377 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.678418 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.678461 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:01.678488 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:01.678826 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:01.679039 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:01.679056 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.680151 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.680202 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.780483 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.780571 19909 instancegroups.go:431] Draining the node: "node-1d.local". I1204 12:35:01.780586 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:01.781677 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:01.781900 19909 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1204 12:35:01.781952 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.783149 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.783175 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.783210 19909 instancegroups.go:431] Draining the node: "node-1e.local". I1204 12:35:01.783820 19909 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1204 12:35:01.783858 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.785059 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.785129 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.885811 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.885875 19909 instancegroups.go:431] Draining the node: "node-1f.local". I1204 12:35:01.886539 19909 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1204 12:35:01.886592 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.887811 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.887861 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.887878 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I1204 12:35:01.888078 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.888097 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.888109 19909 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1204 12:35:01.888715 19909 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1204 12:35:01.888745 19909 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I1204 12:35:01.888776 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:01.889934 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.889959 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:01.895173 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.895204 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:01.895239 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:01.895964 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:01.895999 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.896271 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:01.896309 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.897207 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.897244 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:01.902517 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.902552 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I1204 12:35:01.902681 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.902689 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.902695 19909 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I1204 12:35:01.902933 19909 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E1204 12:35:01.902991 19909 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I1204 12:35:01.903003 19909 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E1204 12:35:01.903021 19909 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I1204 12:35:01.903047 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:01.904193 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.904221 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:01.909464 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.909510 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:01.909579 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:01.910431 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:01.910461 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.910628 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:01.910648 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.911665 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.911706 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:01.917015 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.917049 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I1204 12:35:01.917319 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.917348 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.917359 19909 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I1204 12:35:01.918263 19909 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I1204 12:35:01.918315 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:01.919491 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.919540 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.919552 19909 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I1204 12:35:01.919598 19909 instancegroups.go:203] waiting for 1ms after detaching instance I1204 12:35:01.920766 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:01.920808 19909 instancegroups.go:540] Cluster validated. I1204 12:35:01.920847 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:01.920887 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:01.920911 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:01.921678 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:01.921706 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.921944 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:01.921964 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.922046 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:01.922064 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:01.922910 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.023767 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.023851 19909 instancegroups.go:431] Draining the node: "node-1d.local". I1204 12:35:02.024341 19909 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1204 12:35:02.024391 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.025607 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.025656 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.025676 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I1204 12:35:02.025875 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.025898 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.025909 19909 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I1204 12:35:02.027448 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:02.028019 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:02.028056 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.029196 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.029236 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.029277 19909 instancegroups.go:431] Draining the node: "node-1e.local". I1204 12:35:02.029345 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:02.030254 19909 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I1204 12:35:02.030454 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:02.030490 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.031687 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.031752 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.132579 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.132647 19909 instancegroups.go:431] Draining the node: "node-1g.local". I1204 12:35:02.132689 19909 instancegroups.go:431] Draining the node: "node-1f.local". I1204 12:35:02.133670 19909 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I1204 12:35:02.133882 19909 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I1204 12:35:02.133920 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.135105 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.135157 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.135178 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:02.135697 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:02.135734 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.136945 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.137014 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.237862 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.237930 19909 instancegroups.go:431] Draining the node: "node-1d.local". I1204 12:35:02.238784 19909 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I1204 12:35:02.238835 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.240035 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.240084 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.240140 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I1204 12:35:02.240416 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.240444 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.240466 19909 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1204 12:35:02.240486 19909 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1204 12:35:02.240504 19909 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1204 12:35:02.240538 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I1204 12:35:02.240699 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.240725 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.240742 19909 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I1204 12:35:02.241477 19909 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I1204 12:35:02.241502 19909 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I1204 12:35:02.241516 19909 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I1204 12:35:02.241567 19909 instancegroups.go:431] Draining the node: "node-1a.local". I1204 12:35:02.242136 19909 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I1204 12:35:02.242171 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.243346 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.243375 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:02.248618 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.248647 19909 instancegroups.go:431] Draining the node: "node-1b.local". I1204 12:35:02.249034 19909 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I1204 12:35:02.249056 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.250257 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.250283 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:02.255667 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.255715 19909 instancegroups.go:431] Draining the node: "node-1c.local". I1204 12:35:02.256243 19909 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I1204 12:35:02.256268 19909 instancegroups.go:469] waiting for 1ms after terminating instance I1204 12:35:02.257428 19909 instancegroups.go:504] Validating the cluster. I1204 12:35:02.257458 19909 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I1204 12:35:02.262694 19909 instancegroups.go:540] Cluster validated. I1204 12:35:02.262722 19909 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 1.931s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.005s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.015s === RUN TestParse E1204 12:35:00.349583 19913 versions.go:96] unable to parse Kubernetes version "" E1204 12:35:00.349665 19913 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.008s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.038s ? k8s.io/kops/pkg/kopscontrollerclient [no test files] === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.10s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.158s ? k8s.io/kops/pkg/kubemanifest [no test files] === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.01s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.070s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.063s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.070s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I1204 12:35:00.401485 19917 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.066s ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] === RUN Test_RunEtcdManagerBuilder I1204 12:35:00.406392 19922 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W1204 12:35:00.434348 19922 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W1204 12:35:00.435941 19922 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.04s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.104s ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] === RUN Test_RunKubeApiserverBuilder I1204 12:35:00.406581 19927 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.01s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.01s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.073s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.01s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.074s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.021s ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.067s === RUN TestServerGroupBuilder I1204 12:35:00.406750 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.414478 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.425682 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.440169 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.448197 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.465032 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.476741 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.484706 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.497635 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.507563 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.512822 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.518493 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.526414 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.529926 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.547809 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.552053 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.555983 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:00.561928 19931 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.16s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.228s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.031s ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.033s ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.021s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.00s) --- PASS: TestGenerateCertificate/selfsigned (0.00s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (0.46s) --- PASS: TestIssueCert/ca (0.18s) --- PASS: TestIssueCert/client (0.23s) --- PASS: TestIssueCert/clientOneYear (0.04s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 0.465s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.004s ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] === RUN TestAddUntaggedRouteTables I1204 12:35:05.392055 21339 routetable.go:53] DescribeRouteTables: { } W1204 12:35:05.392144 21339 tags.go:67] cluster tag not found on route-table:rtb-1234 I1204 12:35:05.392151 21339 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I1204 12:35:05.392214 21339 iaminstanceprofile.go:193] ListInstanceProfiles: { } W1204 12:35:05.392268 21339 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I1204 12:35:05.392309 21339 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I1204 12:35:05.392353 21339 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I1204 12:35:05.392392 21339 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I1204 12:35:05.392430 21339 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I1204 12:35:05.392490 21339 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I1204 12:35:05.392506 21339 volumes.go:128] DescribeVolumes: { } W1204 12:35:05.392522 21339 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I1204 12:35:05.392607 21339 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:05.392667 21339 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:05.392685 21339 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:05.392718 21339 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:05.392743 21339 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:05.392787 21339 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:05.392837 21339 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:05.392859 21339 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:05.392879 21339 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:05.392912 21339 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:05.392933 21339 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I1204 12:35:05.392955 21339 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I1204 12:35:05.392975 21339 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I1204 12:35:05.393003 21339 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I1204 12:35:05.393019 21339 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I1204 12:35:05.393040 21339 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I1204 12:35:05.393063 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I1204 12:35:05.393093 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I1204 12:35:05.393109 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I1204 12:35:05.393137 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I1204 12:35:05.393152 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I1204 12:35:05.393166 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I1204 12:35:05.393188 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I1204 12:35:05.393201 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I1204 12:35:05.393216 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I1204 12:35:05.393227 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I1204 12:35:05.393242 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I1204 12:35:05.393253 21339 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.056s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.032s ? k8s.io/kops/pkg/resources/digitalocean [no test files] === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.055s ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.009s ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.005s ? k8s.io/kops/pkg/try [no test files] === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.005s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.007s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.009s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.00s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.035s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.076s ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.007s ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] === RUN TestRemovesDuplicateGuardedBlocks W1204 12:35:05.354518 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.354564 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.354570 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.354574 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.354579 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.354583 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.354587 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.354591 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.354596 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.354601 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.354606 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.354612 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.354617 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.354622 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.354627 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.354635 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363191 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363235 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363303 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363311 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363370 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363378 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363435 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363444 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363501 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363509 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363565 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363573 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363624 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363631 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363698 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363706 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363763 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363770 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363821 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363830 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363884 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363892 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.363959 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.363973 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364037 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364045 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364098 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364105 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364165 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364173 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364227 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364235 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364289 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364314 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364370 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364378 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364452 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364461 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364550 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364559 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364612 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364619 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364673 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364680 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364728 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364736 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364789 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364797 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364853 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364861 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364914 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364922 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.364976 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.364983 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365041 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365049 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365100 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365107 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365169 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365178 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365227 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365241 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365308 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365335 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365396 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365404 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365456 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365463 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365513 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365520 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365573 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365580 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365637 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365646 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365699 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365708 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365761 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365769 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365824 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365832 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365912 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.365920 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.365995 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.366003 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.366067 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.366078 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.366275 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.366311 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.366391 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.366422 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.366507 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.366540 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.366616 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.366647 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.366726 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.366757 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.366832 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.366863 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.366939 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.366981 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.367077 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.367169 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.367328 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.367369 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.367455 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.367485 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.367561 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.367628 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.367704 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.367715 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368365 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368381 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368439 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368447 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368494 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368501 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368546 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368554 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368601 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368608 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368655 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368662 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368709 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368717 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368810 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368819 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368886 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368894 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368943 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.368950 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.368997 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369003 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369048 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369054 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369098 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369104 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369154 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369159 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369190 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369194 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369222 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369226 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369257 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369269 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369301 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369304 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369333 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369336 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369368 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369372 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369401 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369405 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369432 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369435 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369471 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369475 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369503 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369507 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369543 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369547 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369578 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369581 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369612 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369619 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369651 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369656 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369711 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369716 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369750 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369754 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369789 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369793 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369823 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369828 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369864 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369869 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369902 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369906 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369938 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369945 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.369978 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.369982 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370012 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370018 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370051 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370054 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370083 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370087 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370135 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370142 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370179 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370186 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370218 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370261 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370302 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370311 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370352 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370358 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W1204 12:35:05.370662 21359 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1204 12:35:05.370671 21359 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1204 12:35:05.370677 21359 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1204 12:35:05.370682 21359 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W1204 12:35:05.370686 21359 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1204 12:35:05.370689 21359 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1204 12:35:05.370692 21359 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W1204 12:35:05.370707 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370712 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370715 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370719 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370722 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370725 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370728 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370731 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370734 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370737 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370740 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370745 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370750 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370755 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.370760 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.370763 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386106 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386133 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386177 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386183 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386213 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386219 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386251 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386256 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386312 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386318 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386348 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386353 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386386 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386391 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386421 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386425 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386455 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386461 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386491 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386496 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386525 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386530 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386560 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386565 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386601 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386607 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386638 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386644 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386673 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386678 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386707 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386712 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386742 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386746 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386776 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386781 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386832 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386838 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386869 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386875 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386906 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386912 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386942 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386947 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.386979 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.386984 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387013 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387018 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387060 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387065 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387098 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387103 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387146 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387159 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387192 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387196 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387237 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387243 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387273 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387278 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387307 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387311 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387340 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387345 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387374 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387379 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387408 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387412 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387441 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387446 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387476 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387481 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387511 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387516 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387546 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387551 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387582 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387588 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387618 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387623 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387652 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387657 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387687 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387691 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387742 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387748 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387781 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387787 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387817 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387822 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387852 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387857 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387886 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387891 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387919 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387926 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387955 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387961 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.387989 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.387996 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388026 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388030 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388063 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388067 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388105 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388110 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388155 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388162 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388191 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388196 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388227 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388232 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388262 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388267 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388296 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388302 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388332 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388337 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388367 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388372 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388401 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388406 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388434 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388439 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388468 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388474 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388505 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388510 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388546 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388551 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388580 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388585 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388614 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388619 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388649 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388654 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388684 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388689 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388719 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388724 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388754 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388759 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388789 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388794 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388824 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388829 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388857 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388862 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388890 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388895 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388925 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388930 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.388971 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.388976 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389006 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389011 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389040 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389044 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389074 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389079 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389108 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389125 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389160 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389165 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389194 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389199 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389228 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389233 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389264 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389269 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389297 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389302 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389332 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389338 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389368 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389372 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389402 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389407 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389439 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389444 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389473 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389478 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389508 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389512 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389541 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389546 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389575 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389579 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389608 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389612 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389641 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389645 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389674 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389678 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389707 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389712 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W1204 12:35:05.389740 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W1204 12:35:05.389746 21359 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.02s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.041s ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.037s ? k8s.io/kops/tests/fuzz [no test files] === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.01s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.058s ? k8s.io/kops/tests/integration/channel/simple [no test files] === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.01s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.01s) PASS ok k8s.io/kops/tests/integration/conversion 0.028s ? k8s.io/kops/upup/models [no test files] === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I1204 12:35:07.885962 23369 files.go:57] Writing file "/tmp/TestWriteFile349571995/001/SubDir/test1.tmp" I1204 12:35:07.886052 23369 files.go:113] Changing file mode for "/tmp/TestWriteFile349571995/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.00s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.028s === RUN TestBootstrapChannelBuilder_BuildTasks I1204 12:35:12.465804 23628 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:12.465913 23628 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:12.465936 23628 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:12.465960 23628 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:12.465977 23628 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:12.466005 23628 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:12.466024 23628 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:12.466031 23628 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:12.466051 23628 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:12.466064 23628 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:12.470563 23628 zones.go:93] ListHostedZonesPages { } I1204 12:35:12.553191 23628 zones.go:93] ListHostedZonesPages { } I1204 12:35:12.682474 23628 zones.go:93] ListHostedZonesPages { } I1204 12:35:12.816512 23628 zones.go:93] ListHostedZonesPages { } I1204 12:35:12.954813 23628 zones.go:93] ListHostedZonesPages { } I1204 12:35:13.093466 23628 zones.go:93] ListHostedZonesPages { } I1204 12:35:13.228542 23628 zones.go:93] ListHostedZonesPages { } I1204 12:35:13.393780 23628 zones.go:93] ListHostedZonesPages { } I1204 12:35:13.972448 23628 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.64s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I1204 12:35:14.107665 23628 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:14.107753 23628 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:14.107805 23628 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:14.107842 23628 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:14.107870 23628 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:14.107902 23628 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:14.107937 23628 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:14.107962 23628 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:14.107987 23628 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:14.108005 23628 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:14.108026 23628 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I1204 12:35:14.109371 23628 zones.go:93] ListHostedZonesPages { } I1204 12:35:14.259007 23628 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.15s) === RUN TestBootstrapChannelBuilder_AWSCloudController I1204 12:35:14.259199 23628 featureflag.go:164] FeatureFlag "ImageDigest"=false I1204 12:35:14.259283 23628 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:14.259337 23628 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I1204 12:35:14.259377 23628 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I1204 12:35:14.259406 23628 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I1204 12:35:14.259441 23628 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I1204 12:35:14.259468 23628 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I1204 12:35:14.259485 23628 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I1204 12:35:14.259514 23628 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I1204 12:35:14.259534 23628 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I1204 12:35:14.260948 23628 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.12s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.06s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W1204 12:35:14.463993 23628 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I1204 12:35:14.511239 23628 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I1204 12:35:14.511340 23628 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I1204 12:35:14.511355 23628 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I1204 12:35:14.511448 23628 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I1204 12:35:14.511462 23628 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I1204 12:35:14.511551 23628 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I1204 12:35:14.511644 23628 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I1204 12:35:14.511737 23628 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1204 12:35:14.511757 23628 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I1204 12:35:14.511851 23628 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I1204 12:35:14.511872 23628 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I1204 12:35:14.512029 23628 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I1204 12:35:14.512209 23628 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I1204 12:35:14.512306 23628 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I1204 12:35:14.512317 23628 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I1204 12:35:14.512323 23628 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I1204 12:35:14.512341 23628 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I1204 12:35:14.512356 23628 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I1204 12:35:14.512363 23628 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I1204 12:35:14.512372 23628 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I1204 12:35:14.512380 23628 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I1204 12:35:14.514237 23628 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I1204 12:35:14.514524 23628 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.128s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I1204 12:35:12.460050 23629 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender430109522/001 I1204 12:35:12.460247 23629 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender430109522/001 I1204 12:35:12.460367 23629 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender430109522/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.00s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I1204 12:35:12.462995 23629 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1204 12:35:12.463060 23629 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1204 12:35:12.463101 23629 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I1204 12:35:12.463197 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.463275 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.463329 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.463337 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.463420 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:35:12.463445 23629 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1204 12:35:12.463465 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.463500 23629 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1204 12:35:12.463544 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1204 12:35:12.463580 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.463604 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.463625 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.463632 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.463648 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.463665 23629 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1204 12:35:12.463698 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I1204 12:35:12.463795 23629 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1204 12:35:12.463819 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.463862 23629 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1204 12:35:12.463888 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:35:12.463899 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.463911 23629 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1204 12:35:12.463945 23629 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1204 12:35:12.464268 23629 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1204 12:35:12.464302 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:35:12.464314 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.464338 23629 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1204 12:35:12.464371 23629 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:35:12.464437 23629 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I1204 12:35:12.464471 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:35:12.464481 23629 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" },{ Key: "AssociatedElasticIp", Value: "192.0.2.1" }] } I1204 12:35:12.464499 23629 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1204 12:35:12.464538 23629 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1204 12:35:12.464560 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.464581 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.464589 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.464601 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.464614 23629 executor.go:111] Tasks: 1 done / 3 total; 1 can run I1204 12:35:12.464633 23629 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1204 12:35:12.464659 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.464671 23629 executor.go:111] Tasks: 2 done / 3 total; 1 can run I1204 12:35:12.464690 23629 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:35:12.464713 23629 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I1204 12:35:12.464732 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I1204 12:35:12.464757 23629 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I1204 12:35:12.464790 23629 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I1204 12:35:12.464806 23629 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I1204 12:35:12.464825 23629 internetgateways.go:66] CreateInternetGateway: { } I1204 12:35:12.464833 23629 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I1204 12:35:12.464856 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.464875 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.464900 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.464907 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.464937 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:35:12.464953 23629 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1204 12:35:12.464968 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.465004 23629 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1204 12:35:12.465043 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1204 12:35:12.465068 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.465087 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.465105 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.465111 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.465150 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.465179 23629 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I1204 12:35:12.465207 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I1204 12:35:12.465445 23629 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender3328014461/001 I1204 12:35:12.465621 23629 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender3328014461/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I1204 12:35:12.465840 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.465864 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.465909 23629 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1204 12:35:12.465927 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:35:12.465936 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.465961 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.465995 23629 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1204 12:35:12.466106 23629 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I1204 12:35:12.466142 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I1204 12:35:12.466163 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1204 12:35:12.466202 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.466224 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.466246 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.466253 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.466264 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.466275 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.466296 23629 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I1204 12:35:12.466340 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I1204 12:35:12.466457 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.466480 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.466518 23629 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1204 12:35:12.466534 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:35:12.466556 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.466568 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.466588 23629 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1204 12:35:12.466635 23629 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1204 12:35:12.466666 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:35:12.466676 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.466689 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1204 12:35:12.466748 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.466770 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.466791 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.466797 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.466808 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.466819 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.466838 23629 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1204 12:35:12.466863 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.466890 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I1204 12:35:12.466946 23629 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1204 12:35:12.466966 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.467001 23629 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1204 12:35:12.467017 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:35:12.467027 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.467038 23629 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1204 12:35:12.467060 23629 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1204 12:35:12.467108 23629 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1204 12:35:12.467153 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:35:12.467166 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.467222 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.467367 23629 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1204 12:35:12.467408 23629 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1204 12:35:12.467498 23629 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1204 12:35:12.467535 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.467566 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.467581 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.467605 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.467624 23629 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1204 12:35:12.467658 23629 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1204 12:35:12.467703 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.467719 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.467752 23629 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I1204 12:35:12.467861 23629 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1204 12:35:12.467892 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.467948 23629 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1204 12:35:12.467989 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:35:12.468006 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.468030 23629 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1204 12:35:12.468062 23629 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1204 12:35:12.468152 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.468228 23629 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I1204 12:35:12.468281 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:35:12.468308 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.468326 23629 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I1204 12:35:12.468354 23629 executor.go:111] Tasks: 3 done / 3 total; 0 can run I1204 12:35:12.468401 23629 executor.go:111] Tasks: 0 done / 3 total; 1 can run I1204 12:35:12.468445 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.468471 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.468485 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.468516 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.468536 23629 executor.go:111] Tasks: 1 done / 3 total; 2 can run I1204 12:35:12.468567 23629 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I1204 12:35:12.468635 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.468652 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.468692 23629 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I1204 12:35:12.468742 23629 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I1204 12:35:12.468789 23629 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I1204 12:35:12.468851 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.468881 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.468904 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.468916 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.468959 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:35:12.468977 23629 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1204 12:35:12.469009 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.469036 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.469102 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I1204 12:35:12.469124 23629 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I1204 12:35:12.469166 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run I1204 12:35:12.469216 23629 executor.go:111] Tasks: 0 done / 2 total; 1 can run I1204 12:35:12.469246 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.469283 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.469293 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.469319 23629 executor.go:111] Tasks: 1 done / 2 total; 1 can run I1204 12:35:12.469349 23629 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I1204 12:35:12.469404 23629 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I1204 12:35:12.469470 23629 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.469500 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.469549 23629 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I1204 12:35:12.469569 23629 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I1204 12:35:12.469588 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.469608 23629 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1204 12:35:12.469632 23629 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.469661 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I1204 12:35:12.469698 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.469709 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.469728 23629 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I1204 12:35:12.469747 23629 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I1204 12:35:12.469838 23629 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I1204 12:35:12.469877 23629 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.469906 23629 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I1204 12:35:12.469929 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I1204 12:35:12.469941 23629 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I1204 12:35:12.469964 23629 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.056s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.043s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.027s === RUN TestDiskRenderAzure I1204 12:35:12.441976 23632 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I1204 12:35:12.442907 23632 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I1204 12:35:12.443092 23632 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I1204 12:35:12.443540 23632 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I1204 12:35:12.443678 23632 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I1204 12:35:12.443840 23632 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I1204 12:35:12.444065 23632 resourcegroup.go:108] Creating a new Resource Group with name: rg I1204 12:35:12.444078 23632 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I1204 12:35:12.444249 23632 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I1204 12:35:12.444600 23632 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I1204 12:35:12.444740 23632 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I1204 12:35:12.444849 23632 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I1204 12:35:12.445029 23632 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I1204 12:35:12.445206 23632 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.031s ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.029s ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] === RUN TestProjectIAMBinding I1204 12:35:12.461722 23634 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.462067 23634 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1204 12:35:12.462081 23634 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.462353 23634 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1204 12:35:12.462368 23634 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.462450 23634 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I1204 12:35:12.462527 23634 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.462578 23634 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1204 12:35:12.462597 23634 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.462662 23634 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1204 12:35:12.462674 23634 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.462697 23634 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I1204 12:35:12.462764 23634 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.462893 23634 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1204 12:35:12.462905 23634 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.463086 23634 executor.go:111] Tasks: 1 done / 1 total; 0 can run I1204 12:35:12.463103 23634 executor.go:111] Tasks: 0 done / 1 total; 1 can run I1204 12:35:12.463183 23634 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.049s ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.01s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.00s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.050s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.040s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.029s ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.031s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.005s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.026s ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I1204 12:35:12.465015 23642 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I1204 12:35:12.465063 23642 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I1204 12:35:12.465072 23642 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I1204 12:35:12.465079 23642 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I1204 12:35:12.465085 23642 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I1204 12:35:12.465091 23642 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I1204 12:35:12.465097 23642 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W1204 12:35:12.465393 23642 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.051s ? k8s.io/kops/upup/pkg/fi/secrets [no test files] === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.005s ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.006s ? k8s.io/kops/util/pkg/env [no test files] === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.004s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.005s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.005s ? k8s.io/kops/util/pkg/mirrors [no test files] === RUN TestGetProxyEnvVars W1204 12:35:12.436325 23648 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.020s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.030s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.005s ? k8s.io/kops/util/pkg/tables [no test files] === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.004s ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.023s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W1204 12:35:16.266058 24065 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.050s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... kubernetes >>> kops*: Package size: 146.5 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r15.apk >>> kops: Build complete at Thu, 04 Dec 2025 12:36:40 +0000 elapsed time 0h 3m 44s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/4) Purging .makedepends-kops (20251204.123257) (2/4) Purging kubernetes (1.34.2-r1) (3/4) Purging go (1.25.5-r0) (4/4) Purging bash (5.3.3-r1) Executing bash-5.3.3-r1.pre-deinstall Executing busybox-1.37.0-r29.trigger OK: 441 MiB in 107 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...